Electronic device for photographing moving image, method of operating

Abstract

According to an embodiment, an electronic device (101) may include at least one microphone (250), at least one speaker (255), a display (160), and at least one processor (120). The at least one processor may be configured to output a reference sound through the at least one speaker in response to receiving a user request to capture a moving image. The at least one processor may be configured to obtain an acoustic signal corresponding to a reference sound through the at least one microphone. The at least one processor may be configured to analyze the obtained acoustic signal. The at least one processor may be configured to display information on a normal recording state or an abnormal recording state on at least a portion of the display based on a result of the analysis of the obtained acoustic signal.

Description

Technical Field

[0001] Embodiments disclosed in this document relate to an electronic device for shooting a video, a method of operating the electronic device, and a storage medium. Background Art

[0002] As various services and additional functions provided by electronic devices such as smart phones are gradually increasing, various applications that can be run on electronic devices are being developed. In addition, the hardware and / or software parts of electronic devices are also constantly developing.

[0003] For example, there is a camera application for shooting video (e.g., moving images) using a camera mounted on an electronic device, and the number of users shooting videos using the camera application is increasing. During shooting video (e.g., image recording or audio recording) in various environments using the camera of the electronic device, not only the video but also the sound (or audio) is recorded, and the user can recognize the recording status by playing back the recorded video. Summary of the invention

[0004] According to one aspect of the present disclosure, an electronic device (101) may include at least one microphone (250), at least one speaker (255), a display (160), and at least one processor (120). The at least one processor may be configured to output a reference sound through the at least one speaker in response to receiving a user request for shooting a video. The at least one processor may be configured to obtain an acoustic signal corresponding to the reference sound through the at least one microphone. The at least one processor may be configured to analyze the obtained acoustic signal. The at least one processor may be configured to display information about a normal recording state or an abnormal recording state on at least a portion of the display based on a result of analyzing the obtained acoustic signal.

[0005] According to an embodiment, a method for shooting a video in an electronic device may include: in response to receiving a user request for shooting a video, outputting a reference sound through at least one speaker. According to an embodiment, the method may include obtaining an acoustic signal corresponding to the reference sound through at least one microphone. According to an embodiment, the method may include analyzing the obtained acoustic signal. According to an embodiment, the method may include displaying information about a normal recording state or an abnormal recording state based on an analysis result of the obtained acoustic signal.

[0006] According to an embodiment, in a non-volatile storage medium storing instructions, the instructions may be configured to cause the electronic device (101) to perform at least one operation when executed by at least one processor (120), and the at least one operation may include: in response to receiving a user request for shooting a video, outputting a reference sound through at least one speaker; obtaining an acoustic signal corresponding to the reference sound through at least one microphone; analyzing the obtained acoustic signal; and displaying information about a normal recording state or an abnormal recording state based on a result of the analysis of the obtained acoustic signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a block diagram illustrating electronic devices in a network environment according to an embodiment.

[0008] Figure 2a is a diagram illustrating an example of an electronic device according to an embodiment.

[0009] Figure 2b is a diagram illustrating an example of an electronic device according to an embodiment.

[0010] Figure 3 is a diagram showing an abnormal recording situation according to an embodiment.

[0011] Figure 4 is a block diagram showing an internal structure of an electronic device according to an embodiment.

[0012] Figure 5 is a flowchart illustrating an operation of an electronic device for shooting a video according to an embodiment.

[0013] Figure 6 is a flowchart illustrating an operation of an electronic device when starting to shoot a video according to an embodiment.

[0014] Figure 7 is an exemplary diagram illustrating a method of recognizing a recording situation using a reference sound through a microphone according to an embodiment.

[0015] Figure 8 : is a diagram showing an example of a screen indicating an abnormal recording situation according to an embodiment.

[0016] Fig. 9 is a flowchart illustrating an operation of an electronic device for identifying an abnormal recording situation during shooting of a video according to an embodiment.

[0017] Fig.10 is a diagram showing an example of a screen indicating abnormal microphone positions according to an embodiment.

[0018] In conjunction with the description of the drawings, the same or similar reference numerals may be used for the same or similar components. DETAILED DESCRIPTION

[0019] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160).

[0020] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent or combined with the main processor 121. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0021] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning can be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN) or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0022] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0023] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0024] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0025] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as playing multimedia or playing records. The receiver may be used to receive incoming calls. Depending on the embodiment, the receiver may be implemented as a separate part from the speaker, or as part of the speaker.

[0026] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display module 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0027] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0028] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0029] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0030] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0031] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.

[0032] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0033] The power management module 188 may manage power supply to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0034] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0035] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN)). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components (e.g., multiple chips) separated from each other. The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0036] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 can support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip).

[0037] The antenna module 197 may transmit a signal or power to the outside of the electronic device 101 (e.g., an external electronic device) or receive a signal or power from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element, the radiating element being formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 197.

[0038] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, an RFIC, and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a specified high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the specified high frequency band.

[0039] At least some of the above components can be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0040] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the function or service requested, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request in the case of further processing the result or in the case of not further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on 5G communication technology or IoT-related technologies.

[0041] Figure 2a and Figure 2b is a diagram illustrating an example of an electronic device according to an embodiment.

[0042] refer to Figure 2a and Figure 2b, the electronic device 101 according to the embodiment may be configured such that the display module 160 is arranged so that the display panel is exposed on the first side (e.g., the front side) 210 of the housing, and the cameras included in the camera module 180 (e.g., the front camera 180a and the rear camera 180b) are arranged on a portion of the first side and a portion of the second side (e.g., the rear side) 220 of the housing, respectively. For example, the surface on which the display is arranged (or the surface on which the display module 160 is visible from the outside of the electronic device 101) may be defined as the front surface of the electronic device 101. The surface opposite to the front surface may be defined as the rear surface of the electronic device 101. In addition, the surface surrounding the space between the front surface and the rear surface may be defined as the side surface of the electronic device 101.

[0043] According to an embodiment, the electronic device 101 may be configured to arrange at least one microphone 250a or 250b on the third surface (e.g., the upper surface) or the fourth surface (e.g., the lower surface) of the housing, respectively. According to an embodiment, the electronic device 101 may include at least one speaker 255a or 255b. Figure 2a As shown, at least one speaker 255a or 255b may be arranged on a third surface (e.g., upper surface) or a fourth surface (e.g., lower surface) of the housing of the electronic device 201. For example, at least one speaker 255a or 255b may be arranged adjacent to at least one microphone 250a or 250b.

[0044] In an embodiment, at least one speaker 255a or 255b is Figure 2a In the illustrated embodiment, the speaker 255a or 255b is arranged on the side surface, but is not limited thereto, and at least one speaker 255a or 255b or a speaker not shown may be provided as other separate structures and arranged at the combined or assembled structure or both edges of the electronic device 101. In this way, at least one speaker 255a or 255b may be designed to be included in the structure of the electronic device 101 according to its appearance and use state.

[0045] exist Figure 2a In the embodiment, two microphones and two speakers are arranged at the top or the bottom, respectively, but the positions or numbers of the microphones and the speakers may not be limited thereto.

[0046] Figure 3 is a diagram showing an abnormal recording situation according to an embodiment.

[0047] Figure 3 1 shows a situation (or state) in which a user uses the electronic device 101 to shoot a video. Figure 3As shown, when a user holds the electronic device 101 with a hand so that the camera of the electronic device 101 is pointed at an object for shooting a video and the user presses a recording start button, the electronic device 101 can store videos output from the cameras included in the camera module (e.g., the front camera 180a and the rear camera 180b).

[0048] For example, during video shooting (recording or shooting) using the camera of the electronic device 101, not only the video but also the sound (or audio) is recorded, and the user can recognize the recording state by playing back the recorded video. However, when the microphone is covered depending on the position in which the user holds the electronic device during video shooting, recording may continue without taking this into account, which may make it difficult to obtain sound.

[0049] According to an embodiment, information about a recording situation may be provided to a user during video shooting in the electronic device 101. Therefore, the user may shoot a video while recognizing whether a recording situation is normal during video shooting, thereby improving user convenience.

[0050] For example, when a user shoots a video while holding a portion of the electronic device 101 with a hand, at least one microphone 250a or 250b arranged on the electronic device 101 may be partially covered depending on the position 310 where the user holds the electronic device 101. In this case, even if the video of the object is recorded normally, the surrounding sounds including the sounds emitted by the object may not be recorded normally. In addition, when at least one microphone 250a or 250b is partially blocked by foreign matter, it may be difficult to record normally. In this way, when sound cannot be obtained by at least one microphone 250a or 250b during video shooting, the surrounding situation during video shooting may not be accurately recorded. In this case, the user may recognize that the recording is abnormal only after terminating the video shooting.

[0051] Therefore, when the user can recognize whether normal recording or abnormal recording is being performed while shooting a video, user convenience can be improved.

[0052] In the following detailed description, the same or omitted reference numerals may be given to components that are easily understood by the aforementioned embodiments, and their detailed descriptions may also be omitted. The electronic device 101 according to the embodiments disclosed in this document may be implemented so that components of different embodiments are selectively combined, and components of one embodiment may be replaced by components of another embodiment. For example, it should be noted that the present disclosure is not limited to specific drawings or embodiments.

[0053] Figure 4 is a block diagram showing an internal structure of an electronic device according to an embodiment.

[0054] refer to Figure 4 , the electronic device 101 may include at least one processor 120 , a memory 130 , a display 160 , a camera module 180 , a microphone unit 250 , and / or a speaker unit 255 . Figure 4 The electronic device 101 may be Figure 1 Here, it is not Figure 4 All components shown in the figure are necessary components of the electronic device 101, and the electronic device 101 can be Figure 4 The components shown may be implemented with more or fewer components. Figure 4 When the electronic device 101 is similar to Figure 1 The components of the embodiments may be omitted in detail, or may be described by Figure 1 These detailed descriptions are easily understood by the embodiments of the present invention.

[0055] refer to Figure 4 According to an embodiment, the processor 120 may be electrically connected to the memory 130 , the display 160 , the camera module 180 , the microphone unit 250 , and the speaker unit 255 .

[0056] According to an embodiment, the speaker unit 255 may receive an electrical signal from the processor 120, generate a sound, and output the generated sound to the outside.

[0057] According to an embodiment, the microphone unit 250 may include a plurality of microphones 250a, 250b, ... and 250n. For example, the microphone unit 250 or the electronic device 101 may sense the direction of the sound or detect the external sound through the plurality of microphones 250a, 250b, ... and 250n. The electronic device 101 or the processor 120 may suppress or remove noise based on the external sound detected by the microphone unit 250. For example, the processor 120 may weaken the sound other than the multimedia sound or the call sound output by the speaker unit 255 based on the external sound detected by the microphone unit 250. In the voice call mode, at least one of the plurality of microphones 250a, 250b, ... and 250n may collect the user's voice. The electronic device 101 or the processor 120 may improve the call quality in the voice call mode by using the sound collected by the plurality of microphones 250a, 250b, ... and 250n to strengthen the user's voice and suppress the external sound.

[0058] In an embodiment, in the video shooting mode, at least one microphone among the plurality of microphones 250a, 250b, ... and 250n may be activated during shooting a video to receive the sound of at least one object and the sound generated around the object. For example, in the video shooting mode, one microphone among the plurality of microphones 250a, 250b, ... and 250n is activated during shooting a video to receive the sound of at least one object and the sound generated around the object. In the video shooting mode, two or more microphones among the plurality of microphones 250a, 250b, ... and 250n are activated during shooting a video to receive the sound of at least one object and the sound generated around the object.

[0059] According to an embodiment, when a camera application (e.g., a program or function) for shooting a video is executed, the processor 120 may control the camera module 180 to be driven. The processor 120 may recognize that there is a request for shooting a video and execute the camera application when receiving an input of an execution icon (e.g., an object, a graphic element, a menu, a button, or a shortcut image) (not shown) representing a camera application displayed on a main screen (not shown) of the display module 160, a designated button input, or an input of a designated gesture.

[0060] The processor 120 of the electronic device 101 according to an embodiment may control a camera including at least one camera (eg, Figure 2a and Figure 2b The processor 120 may control the display module 160 to display a preview screen during video shooting. For example, the processor 120 may activate the microphone of the microphone unit 250 (e.g., Figure 2a and Figure 2b The microphones (250a, 250b) are used to receive acoustic signals (or audio signals) corresponding to sounds generated by a user, sounds of an object, or sounds around an object during shooting of a video.

[0061] According to an embodiment, the processor 120 may obtain an acoustic signal corresponding to the sound input by the plurality of microphones 250a, 250b, ..., and 250n activated during video shooting. For example, the processor 120 may analyze the obtained acoustic signal and identify a normal microphone or an abnormal microphone among the plurality of microphones 250a, 250b, ..., and 250n based on the analysis result.

[0062] According to an embodiment, the memory 130 may store an operating system related to the operation of the electronic device 101, and / or store a program or at least one application supporting at least one user function run by the electronic device 101. In an embodiment, the memory 130 may store a program that uses acoustic signals collected by multiple microphones 250a, 250b, ... and 250n to identify an abnormal recording state. In an embodiment, the memory 130 may store a reference sound for identifying an abnormal recording state. For example, the reference sound is a sound output by the speaker unit 255 during the shooting of the video, and an acoustic signal corresponding to the reference sound may be input to the multiple microphones 250a, 250b, ... and 250n in response to the reference sound output by the speaker unit 255. In an embodiment, the reference sound may be a shooting start sound provided when the video is started, or may be a sound in an inaudible frequency band. For example, the sound in the inaudible frequency band may include a sound in a specific frequency band set to a sound that the user cannot perceive, such as a sound above the audible frequency band or a sound in an extremely low frequency band (e.g., a pilot tone). According to an embodiment, a plurality of reference sounds may be provided to independently identify the plurality of microphones 250a, 250b, ... and 250n. For example, the electronic device 101 may be configured to output a first reference sound (e.g., 19kHz) through a speaker positioned on the upper surface of the electronic device 101 (e.g., 255a of FIG. 2 ), and to output a second reference sound (e.g., 20kHz) through a speaker positioned on the lower surface of the electronic device 101 (e.g., 255b of FIG. 2 ).

[0063] In an embodiment, the memory 130 may temporarily store acoustic signals collected by the plurality of microphones 250a, 250b, ..., and 250n at the start of shooting under the control of the processor 120. Here, the temporarily stored acoustic signal may be a signal corresponding to the start sound output through the speaker unit 250 input at the same time as the start of shooting, and may be used to detect whether there is an abnormal recording (or microphone error).

[0064] In an embodiment, the memory 130 may temporarily store in a buffer acoustic signals periodically or continuously collected by the plurality of microphones 250 a , 250 b , . . . , and 250 n activated during photographing in a specific unit.

[0065] In an embodiment, the memory 130 may store a threshold value (or threshold level) associated with an acoustic signal for determining abnormal recording. For example, the threshold value may be used to compare with the amplitude of the acoustic signal collected in response to starting shooting. For example, the threshold value may be used to compare with the amplitude of the acoustic signal obtained by the plurality of microphones 250a, 250b, ... and 250n. The processor 120 may identify a normal recording state or an abnormal recording state based on the result of comparing the amplitude of the obtained acoustic signal with the threshold value.

[0066] In an embodiment, the memory 130 may store characteristics of a default signal corresponding to a reference sound for identifying a normal recording state or an abnormal recording state. For example, the memory 130 may store characteristics (or patterns) of an acoustic signal corresponding to a shooting start sound provided when starting to shoot a video. In an embodiment, when the shooting start sound is not set (for example, when the electronic device 101 is set to mute), the memory 130 may store characteristics (or patterns) of an acoustic signal corresponding to a reference sound in an inaudible frequency band. The pattern of an acoustic signal may refer to a change in signal size over frequency.

[0067] For example, the memory 130 may store a pattern of an acoustic signal (or a default signal) for identifying a normal recording state or an abnormal recording state, and may be used to compare the stored pattern of the acoustic signal with the pattern of the acoustic signal obtained by the plurality of microphones 250a, 250b, ... and 250n at the start of shooting or during shooting. For example, the pattern of the acoustic signal corresponding to the shooting start sound provided at the start of shooting a video and the pattern of the acoustic signal corresponding to the reference sound of an inaudible frequency band may be different from each other. For example, the pattern of the acoustic signal (or reference pattern) used as a reference for identifying a normal recording state or an abnormal recording state at the start of shooting and the pattern of the acoustic signal (or reference pattern) used as a reference for identifying a normal recording state or an abnormal recording state during shooting may also be different from each other.

[0068] In an embodiment, the processor 120 may analyze the acoustic signal obtained (or received) by the plurality of microphones 250a, 250b, ... and 250n. For example, the processor 120 may compare the amplitude of the obtained acoustic signal with a threshold value through analysis of the obtained acoustic signal. Based on the result of comparing the amplitude of the acoustic signal with the threshold value, the processor 120 may identify a normal recording state or an abnormal recording state.

[0069] In an embodiment, the processor 120 may convert the acoustic signal into a frequency band, and compare the pattern of the acoustic signal converted into the frequency band with the reference pattern stored in the memory 130. Based on the result of comparing the pattern of the acoustic signal with the reference pattern, the processor 120 may identify a normal recording state or an abnormal recording state.

[0070] The processor 120 according to an embodiment may display information about a normal recording state or an abnormal recording state on the display 160 during shooting of a video. For example, the processor 120 may display an object indicating a normal microphone or an abnormal microphone on at least a portion of the display 160. The processor 120 may display an object (e.g., a graphic element, a function, or an indicator) indicating a normal microphone or an abnormal microphone on a portion of a preview screen during shooting of a video.

[0071] According to the embodiment as described above, by displaying information related to normal recording or abnormal recording on the video shooting screen when starting to shoot a video or during shooting a video, the user can recognize in real time whether the recording is being performed normally. In addition, when the recording is not performed normally, the user can recognize the abnormal recording situation, change the state of holding the electronic device 101, or recognize whether there is a foreign object in the microphone. In addition, by displaying an object indicating the microphone, the user can also recognize the position of the microphone in an abnormal state, thereby improving the convenience of shooting a video.

[0072] According to an embodiment, the electronic device 101 may include at least one microphone 250, at least one speaker 255, a display 160, and at least one processor 120. The at least one processor may be configured to output a reference sound through the at least one speaker in response to receiving a user request for shooting a video. The at least one processor may be configured to obtain an acoustic signal corresponding to the reference sound through the at least one microphone. The at least one processor may be configured to analyze the obtained acoustic signal. The at least one processor may be configured to display information about a normal recording state or an abnormal recording state on at least a portion of the display based on the analysis result of the obtained acoustic signal.

[0073] According to an embodiment, the reference sound may be a shooting start sound provided when shooting of a video starts or a sound in an inaudible frequency band.

[0074] According to an embodiment, the at least one processor may be configured to identify whether the electronic device is set to be muted, and when the electronic device is set to be muted, output a sound in an inaudible frequency band through the at least one speaker.

[0075] According to an embodiment, the at least one processor may be configured to, in response to receiving a user request for capturing a video, output a capturing start sound through the at least one speaker when the electronic device is not set to mute.

[0076] According to an embodiment, the at least one processor may be configured to compare the amplitude of the obtained acoustic signal with a threshold value through analysis of the obtained acoustic signal, and identify a normal recording state or an abnormal recording state based on a result of the comparison.

[0077] According to an embodiment, at least one processor may be configured to: display information about an abnormal recording state on at least a portion of the display when an amplitude of the obtained acoustic signal is less than a threshold value by analyzing the obtained acoustic signal.

[0078] According to an embodiment, at least one processor may be configured to: identify whether there is an acoustic signal less than or equal to a threshold among acoustic signals obtained by at least one microphone; identify the microphone that has obtained the acoustic signal less than or equal to the threshold in response to the acoustic signal less than or equal to the threshold; and display information about an abnormal recording status guiding the position of the identified microphone on at least a portion of the display.

[0079] According to an embodiment, at least one processor may be configured to obtain an acoustic signal through at least one microphone during video shooting, and based on a result of an analysis of the acoustic signal obtained through the at least one microphone, display information about a normal recording status or an abnormal recording status on at least a portion of a display.

[0080] According to an embodiment, at least one processor may be configured to: compare the amplitudes of acoustic signals obtained through at least one microphone during video shooting, identify whether a difference greater than or equal to a specified value occurs based on a result of the amplitude comparison between the acoustic signals, output a sound in an inaudible frequency band through at least one speaker in response to a difference greater than or equal to the specified value, obtain an acoustic signal corresponding to the sound in the inaudible frequency band through at least one microphone, and display information about a normal recording status or an abnormal recording status on at least a portion of a display based on a result of an analysis of the obtained acoustic signal.

[0081] According to an embodiment, the at least one processor may be configured to display a message indicating an abnormal recording state on at least a portion of the display in response to an acoustic signal less than or equal to a threshold value among acoustic signals obtained through the at least one microphone.

[0082] According to an embodiment, at least one processor may be configured to: compare the amplitudes of acoustic signals obtained through at least one microphone during video shooting, identify whether a difference greater than or equal to a specified value occurs based on a result of the amplitude comparison between the acoustic signals, output a sound in an inaudible frequency band through at least one speaker in response to a difference greater than or equal to the specified value, obtain an acoustic signal corresponding to the sound in the inaudible frequency band through at least one microphone, and display information about a normal recording status or an abnormal recording status on at least a portion of a display based on a result of an analysis of the obtained acoustic signal.

[0083] Figure 5 is a flowchart showing the operation of an electronic device for shooting a video according to an embodiment. Figure 5 , the operating method of the electronic device may include operations 505 to 520. Figure 5 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 4 The electronic device 101 or at least one processor of the electronic device (eg, Figure 1 2)). In an embodiment, at least one operation of operations 505 to 520 may be omitted, the order of some operations may be changed, or other operations may be added.

[0084] In operation 505, the electronic device 101 may, in response to receiving a user request for shooting a video, generate a signal through at least one speaker (eg, 255a, 255b or 255c of FIG. 2). Figure 4 The reference sound may be output by the speaker unit 255 of the speaker unit 255. In an embodiment, the reference sound may be a shooting start sound provided when shooting of a video is started, or a sound in an inaudible frequency band.

[0085] In operation 510, the electronic device 101 may use at least one microphone (eg, 250a, 250b, Figure 4 The microphone unit 250 of the electronic device 101 obtains an acoustic signal corresponding to the reference sound. In an embodiment, the electronic device 101 can identify whether the electronic device 101 is set to be muted. When the electronic device 101 is set to be muted, the electronic device 101 can output a sound in an inaudible frequency band through at least one speaker. On the other hand, when the electronic device 101 is not set to be muted, the electronic device 101 can output a shooting start sound through at least one speaker.

[0086] In operation 515, the electronic device 101 may analyze the obtained acoustic signal. According to an embodiment, the electronic device 101 may compare the amplitude of the obtained acoustic signal with a threshold value through analysis of the obtained acoustic signal. Based on the comparison result, the electronic device 101 may identify a normal recording state or an abnormal recording state.

[0087] In operation 520 , the electronic device 101 may display information on a normal recording state or an abnormal recording state based on the analysis result of the obtained acoustic signal.

[0088] According to an embodiment, through analysis of the obtained acoustic signal, when the amplitude of the obtained acoustic signal is less than or equal to a threshold value, the electronic device 101 may display information on an abnormal recording state.

[0089] According to an embodiment, the electronic device 101 may identify whether there is an acoustic signal less than or equal to a threshold value among acoustic signals obtained by at least one microphone. In response to the acoustic signal less than or equal to the threshold value, the electronic device 101 may identify the microphone that obtained the acoustic signal less than or equal to the threshold value. The electronic device 101 may display information about an abnormal recording state that guides the position of the identified microphone.

[0090] According to an embodiment, the electronic device 101 may obtain an acoustic signal through at least one microphone during shooting a video. The electronic device 101 may display information about a normal recording state or an abnormal recording state based on a result of analyzing the acoustic signal obtained through at least one microphone.

[0091] According to an embodiment, the electronic device 101 may compare the amplitudes of acoustic signals obtained by at least one microphone during video shooting. The electronic device 101 may identify whether a difference greater than or equal to a specified value is generated based on the result of the amplitude comparison between the acoustic signals. For example, the electronic device 101 may display information about a normal recording state or an abnormal recording state based on the result of the amplitude comparison between the acoustic signals. In an embodiment, the electronic device 101 may output a sound in an inaudible frequency band through at least one speaker in response to a difference greater than or equal to a specified value. The electronic device 101 may obtain an acoustic signal corresponding to a sound in an inaudible frequency band through at least one microphone. The electronic device 101 may display information about a normal recording state or an abnormal recording state based on the analysis result of the obtained acoustic signal.

[0092] Figure 6 is a flowchart showing the operation of the electronic device when starting to shoot a video according to an embodiment. Figure 6 , the operating method of the electronic device may include operations 605 to 645. Figure 6 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 4 The electronic device 101 or at least one processor of the electronic device (eg, Figure 12)). In an embodiment, at least one of operations 605 to 645 may be omitted, the order of some operations may be changed, or other operations may be added.

[0093] In operation 605, the electronic device 101 may run an application. The electronic device 101 may display a running screen of the application. According to an embodiment, the application may be a camera application. According to an embodiment, the running screen of the application may include a preview area that displays in real time the image captured by the camera (e.g., Figure 1 or Figure 4 For example, the running screen of the application may be a video shooting screen, and the video being shot (e.g., a recorded video or a video output as a low-resolution continuous image frame before shooting the video) is displayed as the running screen displayed by the display 160. According to an embodiment, the running screen of the application may include an area for displaying detailed information corresponding to the preview. For example, the detailed information corresponding to the preview may include shooting information, and the running screen may display objects related to the configuration to be used when shooting the video (e.g., options, menus, graphic elements, functions, or shortcut icons).

[0094] When the record button displayed on the video shooting screen is selected, the electronic device 101 can record the video being shot, and in operation 610, the electronic device 101 can activate the microphone during recording to store the acoustic signal received by the microphone together with the video. Here, the recorded video can be a video of continuous image frames.

[0095] In operation 615, the electronic device 101 may identify whether a photographing start sound is configured. For example, the photographing start sound may be a sound that guides the start of photographing when a record button is selected after running an application.

[0096] When the shooting start sound is configured, the electronic device 101 may output a reference sound corresponding to the shooting start sound through the speaker in operation 625. For example, the electronic device 101 may output a reference sound corresponding to the shooting start sound through each speaker while starting shooting.

[0097] When the shooting start sound is not configured, in operation 620, the electronic device 101 may output a reference sound through a speaker. For example, the case where the shooting start sound is not configured may correspond to a case where the electronic device 101 is configured to be silent. For example, the electronic device 101 may output a reference sound of an inaudible frequency band while starting shooting. When the electronic device 101 includes one speaker, the reference sound may be output. For example, when two or more speakers are arranged at different positions in the electronic device 101, the reference sound output by each speaker may be configured differently in consideration of the arrangement position. Figure 7 This will be described in detail.

[0098] Figure 7 is an exemplary diagram illustrating a method of recognizing a recording situation using a reference sound through a microphone according to an embodiment. Figure 7 , shows a case where different reference sounds 710 and 720 are output from the speakers 255a and 255b when a video shooting screen 730 is being displayed. The reference sounds 710 and 720 output from the speakers 255a and 255b may be input through the microphones 250a and 250b. The microphones 250a and 250b may obtain acoustic signals corresponding to the reference sounds 710 and 720.

[0099] In operation 630 , the electronic device 101 may recognize an acoustic signal corresponding to a reference sound received through the microphone.

[0100] According to an embodiment, when the shooting start sound is output as the reference sound, the electronic device 101 may obtain an acoustic signal corresponding to the shooting start sound through a microphone. For example, the electronic device 101 may analyze the obtained acoustic signal and compare the amplitude of the obtained acoustic signal with a threshold.

[0101] According to an embodiment, when the electronic device 101 outputs a sound in an inaudible frequency band as a reference sound when the electronic device 101 is configured to be silent, the electronic device 101 may obtain an acoustic signal corresponding to the sound in the inaudible frequency band through a microphone.

[0102] In operation 635, the electronic device 101 may identify whether the amplitude of the acoustic signal from the activated microphone is greater than or equal to the threshold. In operation 645, when the amplitude of the acoustic signal from the activated microphone is greater than or equal to the threshold, the electronic device 101 may capture a video. In this way, when an acoustic signal greater than or equal to the threshold is obtained through each microphone, it can be considered that recording is being performed normally.

[0103] On the other hand, in operation 640, when the amplitude of the acoustic signal from the activated microphone is not greater than or equal to the threshold value, the electronic device 101 can warn of an abnormal recording situation. For example, in the presence of two activated microphones, the electronic device 101 can warn of an abnormal recording situation when the amplitude of the acoustic signal from the two microphones is not greater than or equal to the threshold value. For example, even when the amplitude of the acoustic signal from any one of the activated microphones is not greater than or equal to the threshold value, the electronic device 101 can also warn of an abnormal recording situation. For example, when the amplitude of the acoustic signal of any one of the activated microphones is less than the threshold value, it can be considered that the acoustic signal less than the threshold value is associated with abnormal recording. For example, it can be considered that a recording error has occurred in the microphone that obtains an acoustic signal less than the threshold value among the multiple microphones 250a, 250b, ... and 250n. Therefore, when an abnormal recording situation occurs, the electronic device 101 can warn the user of the abnormal recording situation.

[0104] According to an embodiment, the electronic device 101 may control the display 160 to Figure 8 As shown, information indicating abnormal recording conditions is displayed on the video shooting screen. Figure 8 is an exemplary diagram illustrating a screen indicating an abnormal recording situation according to an embodiment.

[0105] refer to Figure 8 , the electronic device 101 may display objects (e.g., graphic elements, functions, or indicators) 820 and 830 indicating a normal microphone or an abnormal microphone on the video shooting screen. In addition, the electronic device 101 may display information indicating an abnormal recording situation 810. For example, by displaying the object 830 indicating an abnormal microphone, the user can intuitively recognize which microphone has a problem.

[0106] According to an embodiment, the electronic device 101 may notify the user of an abnormal recording situation by a warning sound or vibration in addition to the warning screen. For example, when the user holds the electronic device 101, a vibration may be generated at a position corresponding to the microphone that has received an acoustic signal corresponding to the abnormal situation. In this way, the electronic device may notify the user of an abnormal recording situation by using an object (or graphic element) indicating the amplitude of the acoustic signal received by the activated microphone related to the recording situation when starting to shoot a video or during shooting a video.

[0107] In the case where the amplitude of the acoustic signal from the activated microphone in operation 635 is greater than or equal to the threshold value, the electronic device 101 may perform video shooting in operation 645, but perform video shooting in operation 645 while warning of the abnormal recording situation in operation 640. According to an embodiment, even when a warning situation occurs at the beginning of video shooting or during video shooting, the electronic device 101 may continue to shoot the video while outputting a notification indicating the abnormal situation. For example, the electronic device 101 may output a notification on at least a portion of the preview screen while displaying the preview screen during video shooting. When the user holds the electronic device 101 again in a manner to prevent the microphone from being covered by the user, thereby resolving the abnormal recording situation, the electronic device 101 no longer displays the notification on the preview screen.

[0108] Meanwhile, as described above, a method of recognizing a microphone status at the start of photographing is described, and hereinafter, a method of recognizing a microphone status periodically or continuously during photographing and notifying a user of the recognized microphone status will be described.

[0109] Fig. 9 is a flowchart illustrating an operation of an electronic device for identifying abnormal recording conditions during video shooting according to an embodiment. Fig. 9 , the operating method of the electronic device may include operations 905 to 950. Fig. 9 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 4 The electronic device 101 or at least one processor of the electronic device (eg, Figure 1 2)). In an embodiment, at least one operation of operations 905 to 950 may be omitted, the order of some operations may be changed, or other operations may be added.

[0110] In operation 905, the electronic device 101 may be in the process of shooting a video. During the shooting of the video, at least one microphone may be activated to receive an acoustic signal.

[0111] In operation 910, the electronic device 101 may recognize an acoustic signal received through a microphone. For example, the electronic device 101 may receive an acoustic signal through at least one microphone activated during video shooting.

[0112] In operation 915, the electronic device 101 may identify whether the amplitude of the acoustic signal from the microphone is less than or equal to the threshold value. For example, the electronic device 101 may identify whether the amplitude of the acoustic signal from all activated microphones is less than or equal to the threshold value. When the amplitude of the acoustic signal from all activated microphones is not less than or equal to the threshold value, the electronic device 101 may identify the difference in the acoustic signal between the activated microphones in operation 920. Alternatively, even when the amplitude of the acoustic signal from any one of the activated microphones is not less than or equal to the threshold value, the electronic device 101 may identify the difference in the acoustic signal between the activated microphones in operation 920.

[0113] In an embodiment, when the amplitude of the acoustic signal from the microphone is identified as being less than or equal to the threshold in operation 915, the electronic device 101 may perform operation 930. For example, the electronic device 101 may identify that the amplitude of the acoustic signal from all activated microphones is less than or equal to the threshold. For example, when the amplitude of the acoustic signal from all activated microphones is less than or equal to the threshold, it may correspond to a very quiet situation. When the sound generated by the user and the object or the sound generated by the surrounding environment of the object is very small during the video shooting, the amplitude of the acoustic signal obtained by the activated microphone may also be very small. Therefore, when the amplitude of the acoustic signal from all microphones in the activated state is less than or equal to the threshold, the electronic device 101 may output a specified reference sound through a speaker in operation 930. For example, even when the surrounding environment is very quiet, it is necessary to determine whether the microphone is abnormal during the video shooting. Therefore, the specified reference sound output by at least one speaker can be used to identify the microphone condition. For example, the reference sound may include a sound in an inaudible frequency band.

[0114] By performing the operation of identifying the difference of the acoustic signal between the microphones in the activated state in operation 920, the electronic device 101 can identify whether there is an acoustic signal difference greater than or equal to a specified value in at least one microphone in operation 925. For example, depending on the receiving sensitivity of the microphone or due to various factors such as the distance from at least one object or the sound generated by the surrounding environment of the object, at least one microphone among the activated microphones may have an acoustic signal difference compared to other microphones. Therefore, unless an acoustic signal difference greater than or equal to a specified value corresponding to an abnormal condition of the microphone is generated, for example, an acoustic signal difference less than or equal to the specified value can be ignored, the electronic device 101 can continue to perform shooting video.

[0115] Therefore, when it is determined in operation 925 that an acoustic signal difference greater than or equal to a specified value is not recognized from at least one microphone, the video shooting may continue to be performed, and the electronic device 101 may identify whether to terminate the video shooting in operation 950. On the other hand, in response to recognizing an acoustic signal difference greater than or equal to a specified value from at least one microphone, the electronic device 101 may output a reference sound from a speaker in operation 930. For example, when the difference in acoustic signals between microphones in an activated state is greater than or equal to a specified value, it is necessary to determine whether the difference is caused by surrounding sounds or a problem with the microphone.

[0116] For example, when obtaining acoustic signals using multiple microphones in an activated state, when the difference in acoustic signals between one microphone and the remaining microphones is greater than or equal to a specific threshold (for example, approximately 20 dB), a reference sound in an inaudible frequency band can be output through at least one speaker to determine whether there is an abnormality in the microphone.

[0117] In operation 935, the electronic device 101 may identify an abnormal recording situation based on an acoustic signal corresponding to a reference sound received through a microphone. For example, the electronic device 101 may compare a pattern of an acoustic signal corresponding to a reference sound in an inaudible frequency band with a stored reference pattern, and identify a normal recording situation or an abnormal recording situation based on the comparison result.

[0118] In operation 940, the electronic device 101 may identify whether there is an abnormal recording situation. For example, the electronic device 101 may identify whether the two completely match each other or match each other at a certain percentage or higher based on the comparison result of the pattern of the acoustic signal corresponding to the reference sound in the inaudible frequency band and the stored reference pattern. In the case that the result of identifying the abnormal recording situation in operation 940 is not an abnormal recording situation, the electronic device 101 may proceed to operation 950 to identify whether to terminate the video shooting. For example, when the user presses the video shooting stop button, the video shooting may be terminated. Unless the user requests to terminate the video shooting in operation 950, the electronic device 101 may return to operation 905 and continue to shoot the video, and repeat the above operations.

[0119] Meanwhile, in the case where an abnormal recording situation is found based on the result of identifying the abnormal recording situation in operation 940, the electronic device 101 may warn of the abnormal recording situation in operation 945. For example, the electronic device 101 may display a screen indicating the abnormal recording situation, such as Fig.10 shown. Fig.10 is a diagram showing an example of a screen indicating abnormal microphone positions according to an embodiment.

[0120] refer to Fig.10, the electronic device 101 may display objects (e.g., graphic elements, functions, or indicators) 1020 and 1030 indicating a normal microphone or an abnormal microphone on the video shooting screen. For example, the object 103 may be configured in various ways by displaying the object 103 in different colors or using a flashing scheme so that the user can recognize the abnormal recording situation at a glance. In an embodiment, the electronic device 101 may display information 1010 indicating the abnormal recording situation. In an embodiment, the electronic device 101 may display an object 1040 indicating the location of a microphone in an abnormal state so that the user can intuitively recognize the location of the microphone with the problem.

[0121] In an embodiment, in the case of not an abnormal recording situation, the electronic device 101 may identify whether to terminate the video shooting in operation 950. The electronic device 101 may return to operation 905, in which the video shooting is not terminated in operation 950 and the aforementioned video shooting is continued. According to an embodiment, the operation for identifying the abnormal recording situation may be performed periodically or at a specified number of times (e.g., twice).

[0122] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0123] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or replacement forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element can be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0124] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, depending on the embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0125] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.

[0126] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) The computer program product may be published online (e.g., downloaded or uploaded) or the computer program product may be distributed directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a relay server).

[0127] According to various embodiments, each component (for example, module or program) in the above-mentioned components can include a single entity or multiple entities, and some entities in multiple entities can be separately arranged in different components. According to various embodiments, one or more components in the above-mentioned components can be omitted, or one or more other components can be added. Selectively or additionally, multiple components (for example, module or program) can be integrated into a single component. In this case, according to various embodiments, the integrated component can still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operation performed by a module, program or another component can be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operation can be run or omitted in different orders, or one or more other operations can be added.

[0128] According to an embodiment, in a non-volatile storage medium storing instructions, the instructions may be configured to cause the electronic device 101 to perform at least one operation when executed by the at least one processor 120, and the at least one operation may include: in response to receiving a user request for shooting a video, outputting a reference sound through at least one speaker; obtaining an acoustic signal corresponding to the reference sound through at least one microphone; analyzing the obtained acoustic signal; and displaying information about a normal recording status or an abnormal recording status based on a result of the analysis of the obtained acoustic signal.

Claims

1. An electronic device (101), comprising: at least one microphone (250), at least one speaker (255), a display (160), and at least one processor (120), Wherein, the at least one processor is configured to: In response to receiving a user request for capturing a video, outputting a reference sound through the at least one speaker; obtaining an acoustic signal corresponding to the reference sound through the at least one microphone; analyzing the acquired acoustic signals; and Based on the analysis result of the obtained acoustic signal, information on a normal recording state or an abnormal recording state is displayed on at least a part of the display.

2. The electronic device according to claim 1, wherein: The reference sound is a shooting start sound provided when shooting of a video is started or a sound in an inaudible frequency band.

3. The electronic device according to claim 1 or 2, wherein: The at least one processor is configured to: Identifying whether the electronic device is set to be muted; When the electronic device is set to be muted, outputting the sound in the inaudible frequency band through the at least one speaker; and When the electronic device is not set to mute, in response to receiving the user request for shooting a video, the shooting start sound is output through the at least one speaker.

4. The electronic device according to any one of claims 1 to 3, wherein: The at least one processor is configured to: By analyzing the obtained acoustic signal, comparing the amplitude of the obtained acoustic signal with a threshold value; and The normal recording state or the abnormal recording state is identified based on a result of the comparison.

5. The electronic device according to any one of claims 1 to 4, wherein: The at least one processor is configured to: display information about the abnormal recording state on at least a portion of the display when the amplitude of the obtained acoustic signal is less than the threshold value by analyzing the obtained acoustic signal.

6. The electronic device according to any one of claims 1 to 5, wherein: The at least one processor is configured to: Identify whether there is an acoustic signal less than or equal to the threshold value among the acoustic signals obtained by the at least one microphone; In response to the acoustic signal being less than or equal to the threshold, identifying a microphone that obtained the acoustic signal being less than or equal to the threshold; as well as Information about the abnormal recording state guiding the position of the identified microphone is displayed on at least a portion of the display.

7. The electronic device according to any one of claims 1 to 6, wherein: The at least one processor is configured to: During video capture, obtaining an acoustic signal through the at least one microphone; and Information on the normal recording state or the abnormal recording state is displayed on at least a part of the display based on a result of analyzing the acoustic signal obtained by the at least one microphone.

8. The electronic device according to any one of claims 1 to 7, wherein: The at least one processor is configured to: comparing the amplitude of the acoustic signal obtained by the at least one microphone during capturing the video; identifying whether a difference greater than or equal to a specified value occurs based on a result of the amplitude comparison between the acoustic signals; outputting the sound in the inaudible frequency band through the at least one speaker in response to the difference being greater than or equal to the designated value; obtaining, by the at least one microphone, an acoustic signal corresponding to the sound in the inaudible frequency band; and Based on the analysis result of the obtained acoustic signal, information on the normal recording state or the abnormal recording state is displayed on at least a part of the display.

9. The electronic device according to any one of claims 1 to 8, wherein: The at least one processor is configured to display a message indicating the abnormal recording state on at least a portion of the display in response to an acoustic signal less than or equal to the threshold value among the acoustic signals obtained through the at least one microphone.

10. A method for shooting a video in an electronic device, the method comprising: In response to receiving a user request for capturing a video, outputting a reference sound through at least one speaker; obtaining an acoustic signal corresponding to the reference sound by at least one microphone; analyzing the acquired acoustic signals; and Based on the analysis result of the obtained acoustic signal, information on a normal recording state or an abnormal recording state is displayed.

11. The method according to claim 10, wherein: The reference sound is a shooting start sound provided when shooting of a video starts or a sound in an inaudible frequency band.

12. The method according to claim 10 or 11, wherein: Outputting the reference sound through the at least one speaker includes: Identifying whether the electronic device is set to be muted; When the electronic device is set to be muted, outputting the sound in the inaudible frequency band through the at least one speaker; and When the electronic device is not set to mute, in response to receiving the user request for shooting a video, the shooting start sound is output through the at least one speaker.

13. The method according to any one of claims 10 to 12, wherein: The acoustic signals obtained by the analysis include: By analyzing the obtained acoustic signal, comparing the amplitude of the obtained acoustic signal with a threshold value; and The normal recording state or the abnormal recording state is identified based on a result of the comparison.

14. The method according to any one of claims 10 to 13, further comprising: Identify whether there is an acoustic signal less than or equal to the threshold value among the acoustic signals obtained by the at least one microphone; In response to the acoustic signal being less than or equal to the threshold, identifying a microphone that obtained the acoustic signal being less than or equal to the threshold; as well as Information on the abnormal recording state guiding the position of the identified microphone is displayed.

15. A non-volatile storage medium storing instructions, wherein: The instructions are configured to cause the electronic device (101) to perform at least one operation when executed by at least one processor (120). The at least one operation comprises: In response to receiving a user request for capturing a video, outputting a reference sound through at least one speaker; obtaining an acoustic signal corresponding to the reference sound through at least one microphone; analyzing the acquired acoustic signals; and Based on the analysis result of the obtained acoustic signal, information on a normal recording state or an abnormal recording state is displayed.

Images