Voice photo shooting method and device, voice photo display method and device, equipment and storage medium

Abstract

The invention discloses a voice photo shooting method and device, a voice photo display method and device, equipment and a storage medium, and the method comprises the steps: determining a shooting object in a view finding range of an image collection module under the condition that a voice photo shooting mode is started; when it is monitored that the shooting button is in a pressed state, acquiring voice information corresponding to the shooting object by using a voice acquisition module; acquiring a target image corresponding to the view finding range by using an image acquisition module; the target image comprises the shooting object; and establishing an association relationship between the shooting object in the target image and the voice information to obtain a target voice photo. According to the embodiment of the invention, while the richness of the recorded content of the target voice photo is improved, the occupation amount of the memory space of the electronic equipment is reduced, and the accommodation and usability of the memory space of the electronic equipment in the embodiment of the invention are improved.

Description

Technical Field

[0001] The present application belongs to the field of information processing technology, and specifically relates to a method for taking a voice photo, a method for displaying a voice photo, a device, a equipment and a storage medium. Background Art

[0002] With the continuous development of science and technology, various high-techs have been applied to daily life, and various smart home devices have also emerged, making smart phones, smart TVs, smart refrigerators, smart speakers and other home appliances have the function of taking photos and videos.

[0003] In the related art, the shooting mode of smart home devices with the function of shooting photos and videos can only shoot and store one of the following at a time: photos, videos, and live photos. However, the shooting and storage of photos can only record images, resulting in a single recorded content; although videos and live photos can record images and voices at the same time, they have the problem of occupying a large amount of memory space. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a method, display method, device, equipment and storage medium for taking voice photos, which can solve the problems of single content and large memory space occupation in the smart home devices of related technologies during the shooting process.

[0005] In a first aspect, an embodiment of the present application provides a method for taking a voice photo, which is applied to a first electronic device, wherein the first electronic device includes an image acquisition module and a voice acquisition module; the method includes:

[0006] When the voice photo shooting mode is enabled, determining a shooting object within the framing range of the image acquisition module;

[0007] When it is detected that the shooting button of the first electronic device is in a pressed state, using the voice acquisition module to acquire voice information corresponding to the shooting object;

[0008] Using the image acquisition module to acquire a target image corresponding to the framing range; the target image includes the photographed object;

[0009] An association relationship between the photographed object in the target image and the voice information is established to obtain a target voice photo; the target voice photo includes the target image and the voice information.

[0010] Optionally, when the number of the photographed objects is greater than 1, when it is detected that the photographing button of the first electronic device is in a pressed state, acquiring voice information corresponding to the photographed objects by using the voice acquisition module includes:

[0011] When detecting that a shooting button of the first electronic device is in a pressed state, receiving a first focusing instruction;

[0012] Focusing on a first object indicated by the first focus instruction among the photographed objects;

[0013] Using the voice acquisition module to obtain first audio track information corresponding to the first object until a second focus instruction is received;

[0014] Focusing on a second object indicated by the second focus instruction in the photographed object;

[0015] Using the voice acquisition module to obtain second audio track information corresponding to the second object;

[0016] Determine voice information corresponding to the photographed object according to the first audio track information and the second audio track information.

[0017] Optionally, establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes:

[0018] Creating a first voice link identifier in a first target area corresponding to the first object in the target image, and creating a second voice link identifier in a second target area corresponding to the second object;

[0019] A link relationship between the first voice link identifier and the first audio track information is established, and a link relationship between the second voice link identifier and the second audio track information is established to obtain a target voice photo.

[0020] Optionally, when the number of the photographed objects is greater than 1, the method further includes:

[0021] When it is detected that the shooting button of the first electronic device is in a pressed state, the image acquisition module is used to acquire image information within the framing range.

[0022] Optionally, establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes:

[0023] Performing lip analysis on the photographed object based on the image information, and separating audio track information corresponding to each photographed object in the image information from the voice information;

[0024] Determining a correspondence between a photographed object in the image information and a photographed object in the target image according to the image information and the target image;

[0025] According to the corresponding relationship, an association relationship between the photographed object in the target image and the audio track information is established to obtain a target voice photo.

[0026] Optionally, when the number of the photographed objects is 1, when it is detected that the photographing button of the first electronic device is in a pressed state, acquiring voice information corresponding to the photographed object by using the voice acquisition module includes:

[0027] When it is detected that the shooting button of the first electronic device is in a pressed state, the voice collection module is used to acquire voice information to obtain voice information corresponding to the shooting object.

[0028] Optionally, establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes:

[0029] Creating a third voice link mark in a third target area in the target image;

[0030] A link relationship is established between the third voice link identifier and the voice information corresponding to the photographed object to obtain a target voice photo.

[0031] In a second aspect, an embodiment of the present application provides a method for displaying a voice photo, which is applied to a second electronic device, wherein the second electronic device includes a display and a voice player; the method includes:

[0032] In the case of receiving a display instruction, obtaining a target voice photo indicated by the display instruction; the target voice photo is obtained by the voice photo shooting method according to any one of claims 1 to 7; the target voice photo includes a target image and voice information;

[0033] Displaying the target image using the display;

[0034] The voice player is used to play the voice information.

[0035] In a third aspect, an embodiment of the present application provides a device for taking a voice photo, which is applied to a first electronic device, wherein the first electronic device includes an image acquisition module and a voice acquisition module; the device includes:

[0036] A first determination module, used to determine a photographing object within the framing range of the image acquisition module when the voice photo shooting mode is enabled;

[0037] A first acquisition module is used to acquire voice information corresponding to the photographed object by using the voice acquisition module when detecting that the shooting button of the first electronic device is in a pressed state;

[0038] A second acquisition module, configured to acquire a target image corresponding to the framing range using the image acquisition module; the target image includes the photographed object;

[0039] The association module is used to establish an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo; the target voice photo includes the target image and the voice information.

[0040] In a fourth aspect, an embodiment of the present application provides a display device for a voice photo, which is applied to a second electronic device, wherein the second electronic device includes a display and a voice player; the device includes:

[0041] A third acquisition module is used to acquire, upon receiving a display instruction, a target voice photo indicated by the display instruction; the target voice photo is obtained by the voice photo shooting method according to any one of claims 1 to 7; the target voice photo includes a target image and voice information;

[0042] A display module, used for displaying the target image using the display;

[0043] The playing module is used to play the voice information using the voice player.

[0044] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising an image acquisition module, a voice acquisition module, a display, a voice player, a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the method for taking a voice photo as described in any one of the above items, or execute the method for displaying a voice photo as described above.

[0045] In the sixth aspect, an embodiment of the present application provides a readable storage medium. When the instructions in the readable storage medium are executed by a processor of an electronic device, the processor is enabled to execute the method for taking a voice photo as described in any of the above items, or to execute the method for displaying a voice photo as described above.

[0046] The embodiments of the present application include the following advantages:

[0047] The method for taking a voice photo provided in an embodiment of the present application is as follows: when the voice photo shooting mode is enabled, the first electronic device first determines the shooting object within the framing range of the image acquisition module; when it is detected that the shooting button of the first electronic device is in a pressed state, the voice acquisition module is used to obtain voice information corresponding to the shooting object, and the image acquisition module is used to obtain a target image including the shooting object corresponding to the framing range; finally, an association relationship between the shooting object in the target image and the voice information is established to obtain a target voice photo, so that the captured target voice photo can simultaneously record the target image within the framing range and the voice information corresponding to the shooting object in the target image, thereby improving the richness of the content recorded by the first electronic device during the photo shooting process, and the memory space occupied is less than that of videos and live photos. While improving the richness of the content recorded by the target voice photo, the embodiment of the present application also reduces the memory space occupied by the first electronic device, thereby improving the capacity and ease of use of the memory space of the first electronic device in the embodiment of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 This is a flowchart of a method for taking a voice photo provided by an embodiment of the present application;

[0049] Figure 2 is a schematic diagram of a photographed object within a framing range of an image acquisition module provided in an embodiment of the present application;

[0050] Figure 3 is a schematic diagram of a target voice photo provided in an embodiment of the present application;

[0051] Figure 4 is a schematic diagram of an object photographed within a framing range of another image acquisition module provided in an embodiment of the present application;

[0052] Figure 5 is a schematic diagram of another target voice photo provided in an embodiment of the present application;

[0053] Figure 6 is a schematic diagram of another target voice photo provided in an embodiment of the present application;

[0054] Figure 7 is a schematic diagram of another target voice photo provided in an embodiment of the present application;

[0055] Figure 8 It is a logic block diagram of a method for taking a voice photo provided in an embodiment of the present application;

[0056] Fig. 9 It is a logic block diagram of another method for taking a voice photo provided in an embodiment of the present application;

[0057] Fig.10 It is a flowchart of a method for displaying a voice photo provided by an embodiment of the present application;

[0058] Fig.11 It is a logic block diagram of a voice photo shooting device provided in an embodiment of the present application;

[0059] Fig.12 This is a logical block diagram of a voice photo display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0061] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0062] Method Embodiment

[0063] The following is a detailed description of the method for taking voice photos provided in the embodiment of the present application through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0064] Reference Figure 1 , shows a flowchart of the steps of a method for taking a voice photo provided by an embodiment of the present application, the method specifically comprising:

[0065] Step S101: When the voice photo shooting mode is enabled, determine the shooting object within the framing range of the image acquisition module.

[0066] Step S102: when it is detected that the shooting button of the first electronic device is in a pressed state, using a voice acquisition module to acquire voice information corresponding to the shooting object.

[0067] Step S103: using the image acquisition module to acquire a target image corresponding to the framing range; the target image includes the photographed object.

[0068] Step S104: establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo; the target voice photo includes the target image and the voice information.

[0069] The method for taking a voice photo provided in an embodiment of the present application can be applied to a first electronic device, and the first electronic device includes an image acquisition module and a voice acquisition module. It is understandable that the first electronic device can be any electronic device including an image acquisition module and a voice acquisition module and having a data processing function. The first electronic device may include, but is not limited to: a smart terminal, a computer, a personal digital assistant (PDA), a tablet computer, an e-book reader, a laptop, a vehicle-mounted device, a smart TV, a wearable device, etc.; specifically, the first electronic device may be a smart home device, such as a smart phone, a smart TV, a smart refrigerator, and a smart speaker.

[0070] In an embodiment of the present application, the first electronic device can implement a voice photo shooting function based on the image acquisition module and the voice acquisition module. When the first electronic device detects that the voice photo shooting mode is enabled, it can determine the shooting object within the framing range of the image acquisition module through the image acquisition module.

[0071] The image acquisition module includes a viewfinder, which is used to capture and provide image information to be captured within a viewing range in real time, so that the user can preview the image information to be captured; it can be understood that the viewing range of the image acquisition module is specifically the viewing range of the viewfinder, and the image information to be captured within the viewing range includes the captured object. In some embodiments, the first electronic device may also include a display, and in step S101, the first electronic device may display the captured object within the viewing range of the image acquisition module to the user in real time through the display.

[0072] The photographed object is an object to be photographed within the framing range, and the photographed object may include but is not limited to: people, animals, plants, etc. In the embodiment of the present application, the number of the photographed objects within the framing range is at least one.

[0073] In an embodiment of the present application, when the first electronic device detects that the shooting button of the first electronic device is in a pressed state, the first electronic device can use the voice acquisition module to obtain voice information corresponding to the shooting object; wherein the shooting button of the first electronic device can be a hardware button set in the first electronic device, or it can be a function button in the interface of the first electronic device that displays the shooting object within the framing range of the image acquisition module to the user.

[0074] Reference Figure 2, which shows a schematic diagram of photographing an object within a viewing range of an image acquisition module provided in an embodiment of the present application, Figure 2 , the number of photographed objects is 3; the photographing button of the first electronic device is a function button in an interface of the first electronic device that displays to the user the photographed objects within the framing range of the image acquisition module.

[0075] Specifically, when voice information needs to be acquired, the user may press a capture button of the first electronic device, so that the first electronic device performs an operation corresponding to step S102 when detecting that the capture button is in a pressed state.

[0076] It can be understood that when the first electronic device detects that the shooting button is in a pressed state, it can use the voice acquisition module to continuously obtain voice information corresponding to the shooting object. Until the state of the shooting button changes from a pressed state to a released state, the first electronic device controls the voice acquisition module to end the acquisition of voice information, and determines the voice information continuously obtained by the voice acquisition module between the first moment when the state of the shooting button changes from a released state to a pressed state and the second moment when the state of the shooting button changes from a pressed state to a released state as the voice information corresponding to the shooting object.

[0077] Among them, the voice information corresponding to the photographed object refers to the voice information that can be collected by the voice collection module when the shooting button of the first electronic device is in a pressed state. The voice information can be emitted by the photographed object or by other objects other than the photographed object. The embodiment of the present application does not make specific limitations on this.

[0078] In the embodiment of the present application, the first electronic device may also use the image acquisition module to obtain a target image corresponding to the framing range in step S103 as a cover photo of the voice information obtained by the first electronic device in step S102.

[0079] Among them, the first electronic device can execute step S103 before step S102, and can also execute step S103 after step S102; specifically, the first electronic device can obtain the target image corresponding to the framing range by using the image acquisition module through step S103 at the first moment when it detects that the state of the shooting button is changed from the released state to the pressed state; the first electronic device can also obtain the target image corresponding to the framing range by using the image acquisition module through step S103 at the second moment when it detects that the state of the shooting button is changed from the pressed state to the released state. The embodiment of the present application does not specifically limit the execution order of step S102 and before step S103.

[0080] It should be noted that the content and number of the photographed objects within the framing range in step S101 and the photographed objects in the target image in step S103 are the same, but the relative positions between the photographed objects may be the same or different.

[0081] In an embodiment of the present application, after the first electronic device obtains the voice information corresponding to the photographed object through step S102 and obtains the target image including the photographed object through step S103, it can execute step S104 to establish an association relationship between the photographed object and the voice information in the target image to obtain a target voice photo.

[0082] The target voice photo includes a target image and voice information.

[0083] In step S104, the first electronic device can store the voice information obtained in step S102 and the target image obtained in step S103 in a one-to-one correspondence in a first preset storage area of ​​the first electronic device to obtain a target voice photo, wherein the first preset storage area can be a storage area corresponding to the photo album in the first electronic device.

[0084] When the user views the target voice photo through the first electronic device, the first electronic device can display the target image in the target voice photo through the display, and at the same time obtain the voice information corresponding to the target image from the first preset storage area, and play the voice information, thereby providing the user with both visual and auditory experience, and increasing the fun of the voice photo shooting process by the first electronic device.

[0085] As an example, see Figure 3 , shows a schematic diagram of a target voice photo provided by an embodiment of the present application, such as Figure 3 As shown, the target voice photo includes a target image and an overall voice link identifier corresponding to voice information with a duration of 8 seconds. The first electronic device can obtain the voice information corresponding to the target image from the first preset cache area based on the overall voice link identifier. When the user views the target voice photo through the album of the first electronic device, the first electronic device can display the target image in the target voice photo through the display, and at the same time obtain the voice information corresponding to the target image from the first preset storage area, and play the voice information; wherein the number of photographed objects in the target image is 3.

[0086] In the related art, the shooting mode of smart home devices with the function of shooting photos and videos can only shoot and store one of the following items at a time: photos, videos, and live photos. However, the shooting and storage of photos can only record images, resulting in a single recorded content; although videos and live photos can record images and voices at the same time, they have the problem of occupying a large amount of memory space. The method for taking a voice photo provided in the embodiment of the present application is that, when the voice photo shooting mode is enabled, the first electronic device first determines the shooting object within the framing range of the image acquisition module; when it is detected that the shooting button of the first electronic device is in a pressed state, the voice acquisition module is used to obtain voice information corresponding to the shooting object, and the image acquisition module is used to obtain a target image including the shooting object corresponding to the framing range; finally, an association relationship between the shooting object in the target image and the voice information is established to obtain a target voice photo, so that the captured target voice photo can simultaneously record the target image within the framing range and the voice information corresponding to the shooting object in the target image, thereby improving the richness of the content recorded by the first electronic device during the photo shooting process, and the memory space occupied is less than that of videos and live photos. While improving the richness of the content recorded by the target voice photo, the embodiment of the present application also reduces the memory space occupied by the first electronic device, thereby improving the capacity and ease of use of the memory space of the first electronic device in the embodiment of the present application, thereby improving the fun of the user in the process of taking a voice photo through the first electronic device, and improving the user's quality of life and usage experience.

[0087] As an optional implementation, refer to Figure 4 , shows a schematic diagram of photographing an object within the framing range of another image acquisition module provided in an embodiment of the present application, Figure 4 In the embodiment, the shooting button of the first electronic device is a function button in an interface of the first electronic device that displays to the user the shooting object within the framing range of the image acquisition module.

[0088] Among them, the shooting button of the first electronic device includes a first button and a second button, the first button is used to control the first electronic device to use the voice acquisition module to obtain the voice information corresponding to the shooting object; the second button is used to control the first electronic device to use the image acquisition module to obtain the target image corresponding to the framing range. Specifically, when the first electronic device detects that the first button is in a pressed state, the voice acquisition module is used to obtain the voice information corresponding to the shooting object; when the first electronic device detects that the second button is in a pressed state, the image acquisition module is used to obtain the target image corresponding to the framing range; it should be noted that, when the shooting button includes the first button and the second button, the first electronic device can independently realize the acquisition of voice information and the acquisition of target image according to the pressed state of the first button and the pressed state of the second button respectively; it can be understood that when the first button and the second button are both in a pressed state, the first electronic device can simultaneously perform the operations corresponding to step S102 and step S103.

[0089] Optionally, when the number of the photographed objects is greater than 1, in step S102, when it is detected that the photographing button of the first electronic device is in a pressed state, acquiring voice information corresponding to the photographed objects by using the voice acquisition module includes:

[0090] Step S1021: receiving a first focusing instruction when it is detected that the shooting button of the first electronic device is in a pressed state.

[0091] Step S1022: focusing on a first object indicated by the first focusing instruction in the photographed object.

[0092] Step S1023: using the voice acquisition module to obtain first audio track information corresponding to the first object until a second focus instruction is received.

[0093] Step S1024: focusing on a second object indicated by the second focusing instruction in the photographed object.

[0094] Step S1025: Utilize the voice acquisition module to obtain second audio track information corresponding to the second object.

[0095] Step S1026: Determine the voice information corresponding to the photographed object according to the first audio track information and the second audio track information.

[0096] In an embodiment of the present application, when the number of photographic objects within the framing range of the image acquisition module is greater than one, that is, the number of photographic objects is multiple, the first electronic device, upon detecting that the shooting button of the first electronic device is in a pressed state, uses the voice acquisition module to obtain voice information corresponding to the photographic object. Specifically, steps S1021 to S1026 can be used to obtain the voice information corresponding to each photographic object in sequence according to the focusing order of each photographic object within the framing range.

[0097] Among them, the first object is any one of the multiple objects, and the second object is any object among the multiple objects except the first object. It can be understood that the number of the first objects is 1, and the number of the second objects is greater than or equal to 1.

[0098] Specifically, when the first electronic device detects that the shooting button is in a pressed state and receives a first focus instruction, it can execute step S1022 according to the first focus instruction, and focus on the first object indicated by the first focus instruction in the photographed object through the image acquisition module; wherein the first focus instruction is used to instruct the first electronic device to focus on the first object in the photographed objects within the framing range; the first focus instruction can be a focus instruction for the first object automatically determined by the first electronic device from the photographed objects within the framing range according to a preset focus rule; the first focus instruction can also be a focus instruction for the first object input by the user to the electronic device according to the photographed objects within the framing range displayed by the first electronic device.

[0099] The preset focus rules may include but are not limited to: 1) focusing on the objects within the framing range in order from left to right, and determining the object located at the leftmost side of the framing range as the first object; 2) focusing on the objects within the framing range in order from right to left, and determining the object located at the rightmost side of the framing range as the first object.

[0100] After focusing on the first object indicated by the first focus instruction in the photographed object through step S1022, the first electronic device can use the voice acquisition module to obtain the first audio track information corresponding to the first object through step S1023, and when receiving the second focus instruction, control the voice acquisition module to end the acquisition of the first audio track information, and determine the voice information continuously acquired by the voice acquisition module between the third moment of receiving the first focus instruction and the second moment of receiving the second focus instruction as the first audio track information corresponding to the first object.

[0101] After receiving the second focus instruction, the first electronic device may execute step S1024 to focus on the second object indicated by the second focus instruction in the photographed object, and execute step S1025 to obtain the second audio track information corresponding to the second object using the voice acquisition module. When the number of second objects is greater than 1, the first electronic device may repeat steps S1024 to S1025 until the second audio track information corresponding to all second objects is obtained and / or the state of the shooting button is changed from the pressed state to the released state, the second audio track information corresponding to the second object is obtained, and step S1026 is executed to determine the voice information corresponding to the photographed object according to the first audio track information and the second audio track information. It should be noted that the process of the first electronic device executing steps S1024 and S1025 is similar to the process of executing steps S1022 and S1023, and will not be repeated here to avoid repetition.

[0102] In step S1026, the first electronic device may combine the first audio track information and the second audio track information in chronological order to obtain voice information corresponding to the photographed object. It is understandable that the voice information corresponding to the photographed object includes the first audio track information and the second audio track information.

[0103] As an example, the photographed objects include photographed object 1, photographed object 2 and photographed object 3, the first object is photographed object 1, the second object includes photographed object 2 and photographed object 3, and the first focus instruction is the focus instruction corresponding to photographed object 1, and the second focus instruction includes a first sub-instruction corresponding to photographed object 2 and a second sub-instruction corresponding to photographed object 3. After receiving the first focus instruction, the first electronic device executes step S1022 to focus on the photographed object 1, executes step S1023 to use the voice acquisition module to obtain the first audio track information corresponding to the photographed object 1, and completes the acquisition of the first audio track information corresponding to the photographed object 1 when the first sub-instruction is received; then, the first electronic device executes step S1024 to focus on the photographed object 2, executes step S1025 to use the voice acquisition module to obtain the second audio track information corresponding to the photographed object 2, and completes the acquisition of the second audio track information corresponding to the photographed object 2 when the second sub-instruction is received; then, the first electronic device executes step S1024 to focus on the photographed object 3, executes step S1025 to use the voice acquisition module to obtain the second audio track information corresponding to the photographed object 3, and completes the acquisition of the second audio track information corresponding to the photographed object 3 when it is detected that the state of the shooting button of the first electronic device is changed from the pressed state to the released state. At this point, the first electronic device completes the acquisition of the second audio track information corresponding to all second objects; finally, the first electronic device determines the voice information corresponding to the photographed object according to the first audio track information and the second audio track information.

[0104] The method for taking voice photos provided in the embodiment of the present application can, when the number of photographed objects is greater than 1, sequentially obtain the voice information corresponding to each photographed object according to the focusing order of each photographed object within the framing range, thereby improving the completeness and richness of the voice information and improving the feasibility of the embodiment of the present application.

[0105] Optionally, the step S104 of establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes:

[0106] Step S1041: creating a first voice link identifier in a first target area corresponding to the first object in the target image, and creating a second voice link identifier in a second target area corresponding to the second object.

[0107] Step S1042: establish a link relationship between the first voice link identifier and the first audio track information, and establish a link relationship between the second voice link identifier and the second audio track information to obtain a target voice photo.

[0108] In an embodiment of the present application, when the number of photographic objects within the framing range of the image acquisition module is greater than one, that is, the number of photographic objects is multiple, after acquiring the voice information corresponding to the photographic objects through steps S1021 to S1026, and acquiring the target image through step S103, the first electronic device can establish an association relationship between each photographic object and the audio track information corresponding to the photographic object through steps S1041 to S1042, so that when the user views the target voice photo, the first electronic device can play the audio track information corresponding to different photographic objects according to the association relationship between the photographic object and the audio track information corresponding to the photographic object, thereby improving the flexibility and interest of the embodiment of the present application.

[0109] The target image includes a first target region corresponding to the first object and a second target region corresponding to the second object; it can be understood that when the number of the second objects is greater than 1, the number of the second target regions is also greater than 1.

[0110] The second target area may be an area in the target image where the first object is located, or the first target area may be an area in the target image close to the first object. Accordingly, the second target area may be an area in the target image where the second object is located, or the second target area may be an area in the target image close to the second object.

[0111] Specifically, the first electronic device may first create a first voice link identifier in the first target area and a second voice link identifier in the second target area through step S1041; wherein the first voice link identifier is an identifier in the target image for establishing a link relationship between the first object and the first audio track information; the second voice link identifier is an identifier in the target image for establishing a link relationship between the second object and the second audio track information; thereafter, the first electronic device may perform step S1042 according to the focusing order of the photographed object and the acquisition order of the voice information to sequentially establish a link relationship between the first voice link identifier and the first audio track information, and a link relationship between the second voice link identifier and the second audio track information, to obtain a target audio photo. It is understandable that at least the target image and the first audio track information and the second audio track information corresponding to the target image are stored in the first preset storage area.

[0112] In the target voice photo, each photographed object can establish a link relationship with the audio track information corresponding to the photographed object. When the user is viewing the target voice photo, the first electronic device can display the target image in the target voice photo through the display; in the embodiment of the present application, the target image can also include a first voice link identifier and a second voice link identifier; when the user clicks on either the first voice link identifier or the second voice link identifier, the first electronic device obtains the audio track information corresponding to the voice link identifier clicked by the user and plays it based on the link relationship between the first voice link identifier and the first audio track information and the link relationship between the second voice link identifier and the second audio track information.

[0113] As an example, see Figure 5 , shows a schematic diagram of another target voice photo provided in an embodiment of the present application, where the photographed objects include photographed object 1, photographed object 2, and photographed object 3, the first object is photographed object 1, and the second object includes photographed object 2 and photographed object 3; Figure 5 As shown, the target image includes subject 1, subject 2, and subject 3, as well as a first voice link identifier that establishes a link relationship with the first audio track information corresponding to subject 1, and a second voice link identifier that establishes a link relationship with the second audio track information corresponding to subject 2 and subject 3. When the user clicks the first voice link identifier while viewing the target voice photo, the first electronic device can obtain the first audio track information corresponding to subject 1 from the first preset storage area based on the link relationship between the first voice link identifier and the first audio track information and play it.

[0114] As an optional implementation, after the first electronic device creates the first voice link identifier and the second voice link identifier in step S1041, it can also create an overall voice link identifier in an area outside the first target area and the second target area in the target image; after the first electronic device establishes the link relationship between the first voice link identifier and the first track information and the link relationship between the second voice link identifier and the second track information in step S1042, it can also establish a link relationship between the voice information corresponding to the photographed object determined according to the first track information and the second track information and the overall voice link identifier, so that the target image includes the overall voice link identifier in addition to the photographed object, the first voice link identifier and the second voice link identifier. It can be understood that at least the target image and the first track information and the second track information corresponding to the target image, as well as the voice information determined according to the first track information and the second track information are stored in the first preset storage area.

[0115] As an example, see Figure 6 , shows a schematic diagram of another target voice photo provided in an embodiment of the present application, where the photographed objects include photographed object 1, photographed object 2, and photographed object 3, the first object is photographed object 1, and the second object includes photographed object 2 and photographed object 3; Figure 6 As shown, the target image includes the photographed object 1, the photographed object 2 and the photographed object 3, as well as the first voice link identifier and the second voice link identifier, and also includes an overall voice link identifier that establishes a link relationship with the voice information. When the user clicks the overall voice link identifier while viewing the target voice photo, the first electronic device can obtain the voice information from the first preset storage area based on the link relationship between the overall voice link identifier and the voice information and play it.

[0116] Optionally, when the number of the photographed objects is greater than 1, the method for photographing a voice photo provided in the embodiment of the present application further includes:

[0117] Step A11: when it is detected that the shooting button of the first electronic device is in a pressed state, the image acquisition module is used to acquire image information within the framing range.

[0118] The image information refers to the continuous image information within the framing range acquired by the image acquisition module in the process of the first electronic device acquiring the voice information by the voice acquisition module. It can be understood that the image information is the image information within the framing range continuously acquired by the image acquisition module between the first moment when the state of the shooting button changes from the released state to the pressed state and the second moment when the state of the shooting button changes from the pressed state to the released state.

[0119] In an embodiment of the present application, when the number of photographic objects within the framing range of the image acquisition module is greater than one, that is, the number of photographic objects is multiple, in order to assign the audio track information corresponding to different photographic objects in the voice information obtained in step S102 to the corresponding photographic objects, the first electronic device may, before executing step S104, use the image acquisition module to acquire image information within the framing range through step A11 when it is detected that the shooting button of the first electronic device is in a pressed state.

[0120] Optionally, the step S104 of establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes:

[0121] Step S1043: Perform lip shape analysis on the photographed subject based on the image information, and separate audio track information corresponding to each photographed subject in the image information from the voice information.

[0122] Step S1044: Determine a correspondence between the photographed object in the image information and the photographed object in the target image according to the image information and the target image.

[0123] Step S1045: establishing an association relationship between the photographed object in the target image and the audio track information according to the corresponding relationship, and obtaining a target voice photo.

[0124] In an embodiment of the present application, when the number of photographic objects within the framing range of the image acquisition module is greater than one, that is, when the number of photographic objects is multiple, in order to assign the audio track information corresponding to different photographic objects in the voice information obtained in step S102 to the corresponding photographic objects, before executing step S104, the first electronic device may obtain the image information within the framing range using the image acquisition module through step A11, and when the voice information corresponding to the photographic object is obtained through step S102, establish an association relationship between the photographic object in the target image and the voice information through the corresponding operations of steps S1043 to S1045 to obtain the target voice photo.

[0125] Specifically, in step S1043, the first electronic device can separate the human voice based on the image information by using a speech segmentation and clustering method using a mixed feature of Mel-frequency cepstral coefficients and gamma-frequency cepstral coefficients, and use AI recognition technology to perform lip shape analysis on the subject in the image information, so as to separate the audio track information corresponding to each subject in the image information from the voice information obtained in step S102, so as to match different audio track information to different subjects in the image information.

[0126] It should be noted that the content and number of the photographed objects in the image information are the same as the content and number of the photographed objects in the target image, but the relative positions between the photographed objects in the image information and the relative positions between the photographed objects in the target image may be the same or different. In order to improve the accuracy of the allocation of audio track information, in step S1044, the first electronic device may determine the correspondence between the photographed objects in the image information and the photographed objects in the target image based on the image information and the target image.

[0127] In step S1045, the first electronic device may associate the audio track information corresponding to the object in the image information separated from the voice information in step S1043 to the corresponding object in the target image based on the correspondence between the object in the image information and the object in the target image, and establish an association relationship between the object in the target image and the audio track information, thereby obtaining the target voice photo.

[0128] Among them, the audio track information corresponding to the photographed object in the image information separated from the voice information in step S1043 is associated with the corresponding photographed object in the target image. The specific implementation process of establishing the association relationship between the photographed object in the target image and the audio track information can refer to the detailed description of steps S1041 to S1042, and will not be repeated here to avoid repetition.

[0129] It should be noted that after the first electronic device establishes an association relationship between the photographed object in the target image and the audio track information to obtain the target voice photo through step S1045, it can delete the image information obtained through step A11 to release storage space of the first electronic device.

[0130] In an embodiment of the present application, the voice information obtained through step S102 may be voice information composed of audio track information obtained in sequence in accordance with the focusing order through the methods described in steps S1021 to S1026, and the voice information obtained through step S102 may be voice information simultaneously emitted by each shooting object obtained between a first moment when the state of the shooting button changes from a released state to a pressed state and a second moment when the state of the shooting button changes from a pressed state to a released state.

[0131] The method for taking voice photos provided in the embodiment of the present application is suitable for application scenarios in which multiple shooting objects within the framing range output voices at the same time, and application scenarios in which multiple shooting objects within the framing range output voices in sequence according to the focus order. It is not restricted by the order in which the voices are output between the shooting objects. While ensuring the accuracy of allocating the audio track information in the voice information to each shooting object, it also improves the feasibility of the embodiment of the present application and expands the application scope of the embodiment of the present application.

[0132] Optionally, when the number of the photographed objects is 1, in step S102, when it is detected that the photographing button of the first electronic device is in a pressed state, acquiring voice information corresponding to the photographed object by using the voice acquisition module includes:

[0133] Step S1027: when it is detected that the shooting button of the first electronic device is in a pressed state, the voice acquisition module is used to acquire voice information to obtain voice information corresponding to the shooting object.

[0134] In an embodiment of the present application, when the number of photographic objects within the field of view of the image acquisition module is 1, the first electronic device, upon detecting that the shooting button of the first electronic device is in a pressed state, uses the voice acquisition module to obtain voice information corresponding to the photographic object. Specifically, the voice information corresponding to the photographic object can be obtained through step S1027.

[0135] Specifically, when there is only one photographing subject within the framing range, the first electronic device can use the voice collection module to obtain voice information when it detects that the shooting button of the first electronic device is in a pressed state, and the voice information continuously obtained by the voice collection module between the first moment when the state of the shooting button changes from a released state to a pressed state and the second moment when the state of the shooting button changes from a pressed state to a released state is determined as the voice information corresponding to the photographing subject.

[0136] Optionally, the step S104 of establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes:

[0137] Step S1046: Create a third voice link mark in the third target area in the target image.

[0138] Step S1047: establishing a link relationship between the third voice link identifier and the voice information corresponding to the photographed object to obtain a target voice photo.

[0139] In an embodiment of the present application, when the number of photographic objects within the framing range of the image acquisition module is 1, after acquiring the voice information corresponding to the photographic object through step S1027 and acquiring the target image through step S103, the first electronic device can establish an association relationship between the photographic object and the voice information through steps S1046 to S1047, so that when the user views the target voice photo, the first electronic device can play the voice information corresponding to the photographic object according to the association relationship between the photographic object and the voice information, thereby improving the flexibility and interest of the embodiment of the present application.

[0140] The third target area may be any area in the target image.

[0141] Specifically, first, the first electronic device creates a third voice link identifier in the third target area through step S1046; wherein the third voice link identifier is an identifier in the target image for establishing a link relationship between the photographed object and the voice information.

[0142] Then, the first electronic device executes step S1047 to establish a link relationship between the third voice link identifier and the voice information obtained in step S1027 to obtain the target voice photo. Figure 7 , shows a schematic diagram of another target voice photo provided by an embodiment of the present application, such as Figure 7 As shown, the target image includes the photographed object and the third voice link identifier.

[0143] The method for taking voice photos provided in the embodiment of the present application provides an implementation method for obtaining voice information corresponding to the photographed object and establishing an association relationship between the photographed object and the voice information in the target image in an application scenario where the number of photographed objects is 1, thereby expanding the application scope of the embodiment of the present application.

[0144] As an example, see Figure 8, shows a logic block diagram of a method for shooting a voice photo provided by an embodiment of the present application, specifically: when the voice photo shooting mode is enabled, the first electronic device determines the shooting object within the framing range of the image acquisition module through the image acquisition module; when the first electronic device detects that the shooting button of the first electronic device is in a pressed state, the first electronic device receives an auto focus instruction or a manual focus instruction, and focuses on the shooting object within the framing range according to the auto focus instruction or the manual focus instruction; when the shooting button of the first electronic device is in a pressed state, the first electronic device uses the image acquisition module to obtain image information within the framing range and stores the image information in a first preset storage area; when the shooting button is in a pressed state, the first electronic device uses the voice acquisition module to obtain voice information corresponding to the shooting object and stores the voice information in the first preset storage area; when the first electronic device detects that the state of the shooting button is changed from a pressed state to a released state, the first electronic device uses the image acquisition module to obtain a target image corresponding to the framing range and stores the target image in the first preset storage area; the first electronic device performs AI analysis based on the image information, the target image and the voice information in the first preset storage area, establishes an association relationship between the shooting object in the target image and the audio track information, obtains a target voice photo, and stores the target voice photo in the first preset storage area. Among them, the first electronic device performs AI analysis based on the image information, target image and voice information in the first preset storage area, and the specific implementation process of establishing the association relationship between the photographed object in the target image and the audio track information can refer to the detailed description of steps S1043 to S1045, which will not be repeated here.

[0145] As another example, refer to Fig. 9, shows a logic block diagram of another voice photo shooting method provided by an embodiment of the present application, specifically: when the voice photo shooting mode is enabled, the first electronic device determines the shooting object within the framing range of the image acquisition module through the image acquisition module; when the first electronic device detects that the shooting button of the first electronic device is in a pressed state, the first electronic device receives an automatic focus instruction or a manual focus instruction, and focuses on the shooting object within the framing range according to the automatic focus instruction or the manual focus instruction; when the first electronic device detects that the state of the shooting button is changed from a released state to a pressed state, the first electronic device uses the image acquisition module to obtain a target image corresponding to the framing range, and stores the target image in a first preset storage area; when the shooting button is in a pressed state, the first electronic device uses the image acquisition module to obtain image information within the framing range and stores the image information in the first preset storage area; when the shooting button is in a pressed state, the first electronic device uses the voice acquisition module to obtain voice information corresponding to the shooting object, and stores the voice information in the first preset storage area; the first electronic device performs AI analysis based on the image information, the target image and the voice information in the first preset storage area, establishes an association relationship between the shooting object in the target image and the audio track information, obtains the target voice photo, and stores the target voice photo in the first preset storage area. Among them, the first electronic device performs AI analysis based on the image information, target image and voice information in the first preset storage area, and the specific implementation process of establishing the association relationship between the photographed object in the target image and the audio track information can refer to the detailed description of steps S1043 to S1045, which will not be repeated here.

[0146] Reference Fig.10 , shows a flowchart of a method for displaying a voice photo provided by an embodiment of the present application, the method specifically comprising:

[0147] Step S201: upon receiving a display instruction, obtaining a target voice photo indicated by the display instruction; the target voice photo includes a target image and voice information.

[0148] Step S202: Display the target image using a display.

[0149] Step S203: using a voice player to play the voice information.

[0150] The method for displaying a voice photo provided in an embodiment of the present application can be applied to a second electronic device, and the second electronic device includes a display and a voice player. It is understandable that the second electronic device is any electronic device including a display and a voice player. The second electronic device may include, but is not limited to: a smart terminal, a computer, a personal digital assistant, a tablet computer, an e-book reader, a laptop, a vehicle-mounted device, a smart TV, a wearable device, etc.; specifically, the second electronic device may be a smart home device, such as a smart phone, a smart TV, a smart refrigerator, and a smart speaker.

[0151] In the embodiment of the present application, the second electronic device and the first electronic device may be the same device or different devices.

[0152] Specifically, when the second electronic device receives the display instruction, it can execute step S201 to obtain the target voice photo indicated by the display instruction; wherein the target voice photo is the voice photo obtained by the first electronic device through the voice photo shooting method as described above.

[0153] Among them, the target voice photo includes a target image and voice information, the target image is a target image corresponding to the framing range obtained by the first electronic device using the image acquisition module, and the target image includes a photographed object within the framing range; when the voice photo shooting mode is enabled, the first electronic device can use the image acquisition module to determine the photographed object within the framing range of the image acquisition module; the voice information is the voice information corresponding to the photographed object obtained by the first electronic device using the voice acquisition module when it is detected that the shooting button of the first electronic device is in a pressed state; after obtaining the voice information and the target image, the first electronic device establishes an association relationship between the photographed object in the target image and the voice information to obtain the target voice photo obtained by the second electronic device in step S201.

[0154] In the case where the second electronic device and the first electronic device are different electronic devices, before step S201, the second electronic device may obtain the target voice photo from the first preset storage area in the first electronic device, and store the target voice photo in the second preset storage area of ​​the second electronic device. In step S201, the second electronic device may obtain the target voice photo from the second preset cache area when receiving the display instruction.

[0155] The method in which the second electronic device obtains the target voice photo from the first preset storage area in the first electronic device may include but is not limited to: obtaining through a communication connection with the first electronic device, obtaining using a mobile storage medium, etc.

[0156] Among them, the display instruction is an instruction sent to the second electronic device when the user clicks the icon or photo name corresponding to the target voice photo in the photo album of the second electronic device. The display instruction is used to instruct the second electronic device to obtain the target voice photo and display the target voice photo.

[0157] When the second electronic device displays the target voice photo, it can execute step S202 to display the target image in the target voice photo using the display; and execute step S203 to play the voice information in the target voice photo using the voice player.

[0158] In the embodiment of the present application, the second electronic device may execute step S203 while executing step S202; the second electronic device may also first execute step S202, and then execute step S203 when receiving a voice playback instruction.

[0159] Optionally, in some embodiments, the target image of the target voice photo includes the photographed object, a voice link identifier that establishes a link relationship with the audio track information corresponding to the photographed object, and an overall voice link identifier that establishes a link relationship with the voice information. The voice information includes the audio track information corresponding to the photographed object.

[0160] When the user is viewing the target voice photo through the second electronic device, the user can send a voice playback instruction to the second electronic device by clicking on the voice link mark in the target image that establishes a link relationship with the audio track information corresponding to the photographed object, or clicking on the overall voice link mark in the target image that establishes a link relationship with the voice information; when the user sends a voice playback instruction to the second electronic device by clicking on the voice link mark that establishes a link relationship with the audio track information corresponding to the photographed object, the second electronic device can obtain the audio track information that has a link relationship with the voice link mark from the second preset cache area and play the audio track information; when the user sends a voice playback instruction to the second electronic device by clicking on the overall voice link mark that establishes a link relationship with the voice information, the second electronic device can obtain the voice information that has a link relationship with the overall voice link mark from the second preset cache area and play the voice information.

[0161] It can be understood that after the second electronic device stores the target voice photo in the second preset storage area of ​​the second electronic device, the second preset storage area stores the target image in the target voice photo, the audio track information that establishes a link relationship with the voice link identifier corresponding to the photographed object in the target image, and the voice information that establishes a link relationship with the overall voice link identifier in the target image.

[0162] Optionally, when viewing the target voice photo through the second electronic device, the user can adjust the volume of the voice information or audio track information played by the voice player, or directly mute the voice bar, by long pressing the voice link mark in the target image that establishes a link relationship with the audio track information corresponding to the photographed object, or the overall voice link mark that establishes a link relationship with the voice information.

[0163] Optionally, when viewing the target voice photo through the second electronic device, the user can choose to convert the voice information or audio track information into text by long pressing the voice link icon in the target image that establishes a link relationship with the audio track information corresponding to the photographed object, or the overall voice link icon that establishes a link relationship with the voice information.

[0164] The method for displaying voice photos provided in the embodiment of the present application is that when the second electronic device receives a display instruction, it obtains the target voice photo indicated by the display instruction, displays the target image in the target voice photo by using a display, and plays the voice information in the target voice photo by using a voice player. While improving the richness of the content recorded in the target voice photo, the embodiment of the present application also reduces the amount of memory space occupied by the second electronic device, improves the capacity and ease of use of the memory space of the second electronic device in the embodiment of the present application, thereby improving the user's interest in displaying voice photos through the second electronic device, and improving the user's quality of life and usage experience.

[0165] Device Embodiment

[0166] like Fig.11 As shown, Fig.11 A logical block diagram of a device for taking a voice photo provided by an embodiment of the present application is shown, which is applied to a first electronic device, wherein the first electronic device includes an image acquisition module and a voice acquisition module; the device may include:

[0167] A determination module 1101 is used to determine a photographing object within a framing range of the image acquisition module when the voice photo shooting mode is enabled;

[0168] A first acquisition module 1102 is used to acquire voice information corresponding to the photographed object by using the voice acquisition module when detecting that the shooting button of the first electronic device is in a pressed state;

[0169] A second acquisition module 1103 is used to acquire a target image corresponding to the framing range by using the image acquisition module; the target image includes the photographed object;

[0170] The association module 1104 is used to establish an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo; the target voice photo includes the target image and the voice information.

[0171] Optionally, when the number of the photographed objects is greater than 1, the first acquisition module includes:

[0172] A receiving submodule, configured to receive a first focusing instruction when detecting that a shooting button of the first electronic device is in a pressed state;

[0173] A first focusing submodule, configured to focus on a first object indicated by the first focusing instruction in the photographed object;

[0174] A first acquisition submodule, configured to acquire first audio track information corresponding to the first object by using the voice acquisition module until a second focus instruction is received;

[0175] A second focusing submodule, used for focusing on a second object indicated by the second focusing instruction in the photographed object;

[0176] A second acquisition submodule, used for acquiring second audio track information corresponding to the second object by using the voice acquisition module;

[0177] The first determining submodule is used to determine the voice information corresponding to the photographed object according to the first audio track information and the second audio track information.

[0178] Optionally, the association module includes:

[0179] A first creation submodule, configured to create a first voice link identifier in a first target area corresponding to the first object in the target image, and to create a second voice link identifier in a second target area corresponding to the second object;

[0180] The first establishing submodule is used to establish a link relationship between the first voice link identifier and the first audio track information, and to establish a link relationship between the second voice link identifier and the second audio track information, so as to obtain a target voice photo.

[0181] Optionally, when the number of the photographed objects is greater than 1, the device further includes:

[0182] The fourth acquisition module is used to acquire the image information within the framing range by using the image acquisition module when detecting that the shooting button of the first electronic device is in a pressed state.

[0183] Optionally, the association module includes:

[0184] A soundtrack separation submodule, configured to perform lip analysis on the photographed object based on the image information, and separate the soundtrack information corresponding to each photographed object in the image information from the voice information;

[0185] A second determination submodule, configured to determine a correspondence between a photographed object in the image information and a photographed object in the target image according to the image information and the target image;

[0186] The second establishing submodule is used to establish an association relationship between the photographed object in the target image and the audio track information according to the corresponding relationship, so as to obtain a target voice photo.

[0187] Optionally, when the number of the photographed object is 1, the first acquisition module includes:

[0188] The third acquisition submodule is used to acquire voice information using the voice acquisition module when it is detected that the shooting button of the first electronic device is in a pressed state, so as to obtain the voice information corresponding to the shooting object.

[0189] Optionally, the association module includes:

[0190] A second creation submodule, configured to create a third voice link mark in a third target area in the target image;

[0191] The third establishing submodule is used to establish a link relationship between the third voice link identifier and the voice information corresponding to the photographed object to obtain a target voice photo.

[0192] like Fig.12 As shown, Fig.12 A logical block diagram of a device for displaying a voice photo provided by an embodiment of the present application is shown, which is applied to a second electronic device, wherein the second electronic device includes a display and a voice player; the device may include:

[0193] The third acquisition module 1201 is used to acquire the target voice photo indicated by the display instruction when receiving the display instruction; the target voice photo is obtained by the voice photo shooting method as described above; the target voice photo includes a target image and voice information;

[0194] A display module 1202, configured to display the target image using the display;

[0195] The playing module 1203 is used to play the voice information using the voice player.

[0196] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0197] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0198] An embodiment of the present application provides an electronic device, which includes an image acquisition module, a voice acquisition module, a display, a voice player, a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; the memory is used to store executable instructions, and the executable instructions enable the processor to execute the method for taking a voice photo as described above, or execute the method for displaying a voice photo as described above.

[0199] An embodiment of the present application also provides a non-temporary computer-readable storage medium. When the instructions in the readable storage medium are executed by a processor of an electronic device, the processor is enabled to execute the method for taking a voice photo as described above, or to execute the method for displaying a voice photo as described above.

[0200] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0201] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0202] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0203] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a predictable manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0204] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0205] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0206] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0207] The above is a detailed introduction to the voice photo shooting method, display method, device, equipment and storage medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for taking a voice photo, characterized in that: Applied to a first electronic device, the first electronic device includes an image acquisition module and a voice acquisition module; the method includes: When the voice photo shooting mode is enabled, determining a shooting object within the framing range of the image acquisition module; When it is detected that the shooting button of the first electronic device is in a pressed state, using the voice acquisition module to acquire voice information corresponding to the shooting object; Using the image acquisition module to acquire a target image corresponding to the framing range; the target image includes the photographed object; An association relationship between the photographed object in the target image and the voice information is established to obtain a target voice photo; the target voice photo includes the target image and the voice information.

2. The method according to claim 1, characterized in that When the number of the photographed objects is greater than 1, when it is detected that the photographing button of the first electronic device is in a pressed state, acquiring voice information corresponding to the photographed objects by using the voice acquisition module includes: When detecting that a shooting button of the first electronic device is in a pressed state, receiving a first focusing instruction; Focusing on a first object indicated by the first focus instruction among the photographed objects; Using the voice acquisition module to obtain first audio track information corresponding to the first object until a second focus instruction is received; Focusing on a second object indicated by the second focus instruction in the photographed object; Using the voice acquisition module to obtain second audio track information corresponding to the second object; Determine voice information corresponding to the photographed object according to the first audio track information and the second audio track information.

3. The method according to claim 2, characterized in that The step of establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes: Creating a first voice link identifier in a first target area corresponding to the first object in the target image, and creating a second voice link identifier in a second target area corresponding to the second object; A link relationship between the first voice link identifier and the first audio track information is established, and a link relationship between the second voice link identifier and the second audio track information is established to obtain a target voice photo.

4. The method according to claim 1, characterized in that: When the number of the photographed objects is greater than 1, the method further includes: When it is detected that the shooting button of the first electronic device is in a pressed state, the image acquisition module is used to acquire image information within the framing range.

5. The method according to claim 4, characterized in that The step of establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes: Performing lip analysis on the photographed object based on the image information, and separating audio track information corresponding to each photographed object in the image information from the voice information; Determining a correspondence between a photographed object in the image information and a photographed object in the target image according to the image information and the target image; According to the corresponding relationship, an association relationship between the photographed object in the target image and the audio track information is established to obtain a target voice photo.

6. The method according to claim 1, characterized in that When the number of the photographed objects is 1, when it is detected that the photographing button of the first electronic device is in a pressed state, acquiring voice information corresponding to the photographed object by using the voice acquisition module includes: When it is detected that the shooting button of the first electronic device is in a pressed state, the voice collection module is used to acquire voice information to obtain voice information corresponding to the shooting object.

7. The method according to claim 6, characterized in that The step of establishing an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo includes: Creating a third voice link mark in a third target area in the target image; A link relationship is established between the third voice link identifier and the voice information corresponding to the photographed object to obtain a target voice photo.

8. A method for displaying a voice photo, characterized in that: Applied to a second electronic device, the second electronic device includes a display and a voice player; the method includes: In the case of receiving a display instruction, obtaining a target voice photo indicated by the display instruction; the target voice photo is obtained by the voice photo shooting method according to any one of claims 1 to 7; the target voice photo includes a target image and voice information; Displaying the target image using the display; The voice player is used to play the voice information.

9. A device for taking a voice photo, characterized in that: Applied to a first electronic device, the first electronic device includes an image acquisition module and a voice acquisition module; the device includes: A determination module, used to determine a photographing object within the framing range of the image acquisition module when the voice photo shooting mode is enabled; A first acquisition module is used to acquire voice information corresponding to the photographed object by using the voice acquisition module when detecting that the shooting button of the first electronic device is in a pressed state; A second acquisition module, configured to acquire a target image corresponding to the framing range using the image acquisition module; the target image includes the photographed object; The association module is used to establish an association relationship between the photographed object in the target image and the voice information to obtain a target voice photo; the target voice photo includes the target image and the voice information.

10. A device for displaying a voice photo, characterized in that: Applied to a second electronic device, the second electronic device includes a display and a voice player; the device includes: A third acquisition module is used to acquire, upon receiving a display instruction, a target voice photo indicated by the display instruction; the target voice photo is obtained by the voice photo shooting method according to any one of claims 1 to 7; the target voice photo includes a target image and voice information; A display module, used for displaying the target image using the display; The playing module is used to play the voice information using the voice player.

11. An electronic device, characterized in that: The electronic device comprises an image acquisition module, a voice acquisition module, a display, a voice player, a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store executable instructions, and the executable instructions enable the processor to execute the method for taking a voice photo as described in any one of claims 1 to 7, or execute the method for displaying a voice photo as described in claim 8.

12. A readable storage medium, characterized in that: When the instructions in the readable storage medium are executed by a processor of an electronic device, the processor is enabled to execute the method for taking a voice photo as described in any one of claims 1 to 7, or execute the method for displaying a voice photo as described in claim 8.

Images