Shooting mode switching method, electronic device and readable storage medium

Abstract

The present application relates to the technical field of electronic devices, and more particularly to a method for switching shooting modes, an electronic device, and a readable storage medium. The method comprises: the electronic device displays a first shooting interface of a first application; based on a first preview image, determines that the electronic device is in a first shooting scene; and the electronic device displays a second shooting interface. The method for switching shooting modes provided in an embodiment of the present application allows the electronic device to determine whether the electronic device is in the first shooting scene based on acquired real-time image data, and can intelligently switch the shooting mode to the second shooting mode when it is determined that the electronic device is in the first shooting scene. This method does not require the user to determine the current shooting scene themselves, nor does it require the user to manually switch shooting modes. The operation is simple, and the user experience is enhanced.

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and in particular to a method for switching shooting modes, an electronic device, and a readable storage medium. Background Art

[0002] With the continuous development of Internet technology, people's demands for electronic devices are becoming increasingly diverse. For example, to meet users' needs for saving and viewing documents on electronic devices at any time, many electronic devices support document scanning. For example, users can use the document shooting function of electronic devices to shoot documents, various certificates, slides, or handwritten blackboards. Users can operate the relevant controls on the shooting interface of the electronic device, select the document scanning control, shoot a document image, and realize functions such as extracting text from the document image and saving the image as an electronic document.

[0003] In the current solution, for different types of documents, users can switch between document capture modes by selecting different document scanning controls on the display interface of the electronic device. Specifically, the user needs to manually find and select the desired document scanning control on the display interface of the electronic device to switch to the corresponding document scanning function.

[0004] It can be seen that the user needs to manually operate the electronic device to switch the file scanning mode, which is cumbersome and the user experience is not good. Summary of the Invention

[0005] The embodiments of the present application provide a shooting mode switching method, an electronic device, and a readable storage medium, which are easy for users to operate and provide a better user experience.

[0006] In a first aspect, an embodiment of the present application provides a method for switching shooting modes, which is applied to an electronic device, including: the electronic device displays a first shooting interface of a first application, the first shooting interface includes a first preview image, and the electronic device is in a first shooting mode when displaying the first shooting interface; based on the first preview image, it is determined that the electronic device is in a first shooting scene, wherein the first shooting scene includes a scene in which a user scans a document for a presentation of a meeting scene; the electronic device displays a second shooting interface, the second shooting interface includes a second preview image, and the electronic device is in a second shooting mode corresponding to the first shooting scene when displaying the second shooting interface, and the second preview image includes a document image of a document for a presentation of the meeting scene.

[0007] It is understood that the first application can be an application with a shooting function, such as a camera, a memo, a document scanning application, etc., and this application does not limit this. The first shooting interface can be an interface displayed by the electronic device in response to the user clicking the first application on the desktop of the electronic device.

[0008] It is understood that the first shooting scene can be a shooting scene in which a user scans a document for a conference scene presentation, namely the conference shooting scene hereinafter, and the second shooting mode is the conference mode. The first shooting mode and the second shooting mode are different shooting modes.

[0009] It can be understood that in other embodiments, the second shooting mode can also be named as other shooting modes other than the conference mode. The conference mode below is only an example of the second shooting mode, and this application does not limit this.

[0010] The method for switching the photographing mode provided in the embodiment of the present application allows the electronic device to determine whether the electronic device is in the first shooting scene based on the acquired real-time image data, and when it is determined that the electronic device is in the first shooting scene, the shooting mode can be intelligently switched to the second shooting mode. The user does not need to determine the current shooting scene by himself, nor does the user need to manually switch the shooting mode. The operation is simple and the user experience is better.

[0011] In a possible implementation of the first aspect above, the meeting scene includes at least one of the following: an office meeting scene, an open discussion scene, a report scene, and a classroom scene; the documents presented in the meeting scene include at least one of the following: a document projected and displayed by a projector in a meeting scene, a document displayed on an electronic screen in a meeting shooting scene, and a document displayed on a handwritten blackboard.

[0012] In a possible implementation of the first aspect above, determining that the electronic device is in the first shooting scene based on the first preview image includes: when the electronic device uses a neural network model to determine that the scene corresponding to the first preview image is the first shooting scene, determining that the electronic device is in the first shooting scene, wherein the input of the neural network model is image data, and the output of the neural network model is the shooting scene corresponding to the image data.

[0013] In a possible implementation of the first aspect, determining that the electronic device is in the first shooting scene based on the first preview image includes: determining that the electronic device is in the first shooting scene if the first preview image meets a first preset condition.

[0014] In a possible implementation of the first aspect above, the first preset condition includes at least one of the following: a brightness feature of the first preview image satisfies a preset brightness threshold; the first preview image includes moiré patterns; a texture feature of the first preview image matches a preset texture feature; and a material feature of the first preview image matches a preset material feature.

[0015] It can be understood that the electronic device can judge whether it is in a conference shooting scene through a neural network model, or it can be based on traditional image processing, according to the extracted image features and combined with the corresponding first preset conditions for judgment. This application does not impose any restrictions on this.

[0016] In a possible implementation of the first aspect above, the method further includes: the electronic device obtains device status data and user schedule data; based on the first preview image, determining that the electronic device is in the first shooting scene, including: based on the first preview image, the device status data and the user schedule data, determining that the electronic device is in the first shooting scene.

[0017] In a possible implementation of the first aspect above, determining that the electronic device is in the first shooting scene based on the first preview image, device status data and user schedule data includes: the electronic device determines that the scene corresponding to the first preview image is the first shooting scene; the electronic device determines that the device status data satisfies the second preset condition, and / or determines that the user schedule data satisfies the third preset condition; and determines that the electronic device is in the first shooting scene.

[0018] In a possible implementation of the first aspect above, the device status data includes at least one of the following: location data of the electronic device; inclination data of the electronic device; real-time audio data of the electronic device; determining that the device status data meets the second preset condition includes at least one of the following: determining that the location data matches a preset office area; determining that the inclination data matches a target inclination or a target inclination range; determining that the scene corresponding to the real-time audio data is a conference shooting scene.

[0019] In a possible implementation of the first aspect, determining whether the user schedule data satisfies the third preset condition includes: determining, based on the meeting time period in the user schedule data, that the current time matches the meeting time period.

[0020] In a possible implementation of the above-mentioned first aspect, the above-mentioned method also includes: the electronic device displays a first prompt pop-up window on the first shooting interface, and the first prompt pop-up window includes a first control for entering the second shooting mode; in response to the user's first operation on the first control, the electronic device displays the second shooting interface.

[0021] In a possible implementation of the first aspect above, the method also includes: the electronic device displays a third shooting interface of the first application, the third shooting interface includes a third preview image, and the electronic device is in a second shooting mode when displaying the third shooting interface; based on the third preview image, it is determined that the electronic device is in a second shooting scene, and the second shooting scene includes a shooting scene of a target shooting object outside a document presented by the user to the conference scene; the fourth shooting interface is electronically displayed, the fourth shooting interface includes a fourth preview image, and the electronic device is in a third shooting mode corresponding to the second shooting scene when displaying the fourth shooting interface, and the fourth preview image includes a first shot image of the first shooting object.

[0022] It can be understood that the embodiment of the present application can also exit the second shooting mode when it is determined that the electronic device is no longer in the first shooting scene. The user does not need to pay attention to the changes in the current shooting mode and switch manually. The operation is simple and the user experience is high.

[0023] In a possible implementation of the first aspect above, determining that the electronic device is in the second shooting scene based on the third preview image includes: when the electronic device uses a neural network model to determine that the scene corresponding to the first preview image is the second shooting scene, determining that the electronic device is in the second shooting scene, wherein the input of the neural network model is the image data, and the output of the neural network model is the shooting scene corresponding to the image data.

[0024] In a possible implementation of the first aspect, determining that the electronic device is in the second shooting scene based on the third preview image includes: determining that the electronic device is in the second shooting scene when the third preview image meets a fourth preset condition.

[0025] In a possible implementation of the first aspect above, the third preview image satisfies the fourth preset condition, including at least one of the following: the third preview image does not include a document; the third preview image does not include a document for conference scene demonstration; the third preview image includes a first captured image and a second captured image of a document for conference scene demonstration, and the area ratio of the first captured image and the second captured image satisfies a preset ratio threshold; the third preview image includes the first captured image and the second captured image, and it is determined that the first position of the first captured object and the second position of the document for conference scene demonstration satisfy a preset position relationship; the third preview image includes the first captured image and the second captured image, and the number of first captured objects satisfies a preset number threshold.

[0026] In a possible implementation of the first aspect above, determining that the first position of the first photographed object and the second position of the document of the conference scene presentation satisfy a preset position relationship includes: the electronic device obtains first depth of field data of the first photographed object and second depth of field data of the document of the conference scene presentation; the electronic device determines that the first depth of field data is smaller than the second depth of field data.

[0027] In a possible implementation of the first aspect above, when the third preview image satisfies a fourth preset condition, determining that the electronic device is in the second shooting scene includes: determining that the third preview image satisfies the fourth preset condition; and determining that the shooting scene corresponding to the third preview image is the second shooting scene.

[0028] In a possible implementation of the first aspect, the first shooting mode or the third shooting mode includes at least one of the following: a general document scanning mode, a general shooting mode, a video recording mode, and a portrait mode.

[0029] In a possible implementation of the above-mentioned first aspect, the above-mentioned method also includes: the electronic device displays a second prompt pop-up window on the third shooting interface, and the second prompt pop-up window includes a second control for exiting the second shooting mode; in response to the user's second operation on the second control, the electronic device displays a fourth shooting interface.

[0030] In a possible implementation of the first aspect, determining that the electronic device is in the second shooting scene based on the third preview image includes: determining that the electronic device is in the second shooting scene when the third preview image meets a fourth preset condition.

[0031] In a possible implementation of the first aspect above, the third preview image satisfies the fourth preset condition, including at least one of the following: the third preview image does not include a presentation; the third preview image does not include a document; the third preview image includes a presentation and a non-presentation, and the area ratio of the presentation and the non-presentation satisfies a preset ratio threshold; the third preview image includes a presentation and a non-presentation, and it is determined that the first position of the presentation object corresponding to the presentation and the second position of the non-presentation object corresponding to the non-presentation satisfy a preset position relationship; the third preview image includes a presentation and a non-presentation, and the number of non-presentation objects corresponding to the non-presentation satisfies a preset number threshold.

[0032] In a possible implementation of the first aspect above, determining that a first position of a presentation object corresponding to a presentation and a second position of a non-presentation object corresponding to a non-presentation satisfy a preset position relationship includes: the electronic device acquiring first depth of field data of the presentation object and second depth of field data of the non-presentation object; and the electronic device determining that the first depth of field data is greater than the second depth of field data.

[0033] In a possible implementation of the first aspect above, when the third preview image satisfies a fourth preset condition, determining that the electronic device is in the second shooting scene includes: determining that the third preview image satisfies the fourth preset condition; and determining that the shooting scene corresponding to the third preview image is the second shooting scene.

[0034] In a possible implementation of the first aspect, the first shooting mode or the third shooting mode includes at least one of the following: a general document scanning mode, a general shooting mode, a video recording mode, and a portrait mode.

[0035] In a possible implementation of the above-mentioned first aspect, the above-mentioned method also includes: the electronic device displays a second prompt pop-up window on the third shooting interface, and the second prompt pop-up window includes a second control for exiting the second shooting mode; in response to the user's second operation on the second control, the electronic device displays a fourth shooting interface.

[0036] In a second aspect, an embodiment of the present application provides an electronic device comprising: one or more processors; one or more memories; one or more memories storing one or more programs, which, when executed by one or more processors, enables the electronic device to execute the above-mentioned shooting mode switching method.

[0037] In a third aspect, an embodiment of the present application provides a computer-readable storage medium having instructions stored thereon. When the instructions are executed on a computer, the computer executes the above-mentioned window switching method.

[0038] In a fourth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which implements the above-mentioned shooting mode switching method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 The figure shows a scenario diagram provided by an embodiment of the present application;

[0040] Figures 2a to 2c A schematic diagram of an interface for switching document shooting modes in some embodiments is shown;

[0041] Figures 3a to 3h According to embodiments of the present application, some other interface schematic diagrams showing the switching process of shooting modes of some electronic devices are shown;

[0042] Figure 4 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0043] Figure 5 According to an embodiment of the present application, a flowchart of a method for switching shooting modes is shown;

[0044] Figures 6a to 6b Shown are some schematic diagrams of interface changes for switching to a general document scanning mode provided in an embodiment of the present application;

[0045] Figure 7 According to an embodiment of the present application, a flowchart of a method for switching shooting modes is shown;

[0046] Figure 8 According to an embodiment of the present application, a flowchart of a method for switching shooting modes is shown;

[0047] Figure 9 According to an embodiment of the present application, a flowchart of a method for switching shooting modes is shown;

[0048] Figure 10 According to an embodiment of the present application, a software structure block diagram of an electronic device is shown. DETAILED DESCRIPTION

[0049] The following combination Figure 1 The applicable scenarios of the technical solution of this application are introduced.

[0050] Figure 1 The following is a schematic diagram of a scenario provided by an embodiment of the present application. Figure 1 As shown, the scene may include: an electronic device 100 and a document screen 200 to be photographed. The electronic device 100 has a document photographing function and can photograph the document screen 200 to be photographed through a camera to obtain a corresponding scanned copy.

[0051] It can be understood that the document image 200 to be captured can be an image of an electronic document output and displayed through a projector, display screen, etc., or it can be an image corresponding to a handwritten blackboard produced by an electronic brush (such as a handwriting or marking brush of an electronic device) or a physical brush (such as chalk, a marker, a stylus, etc.).

[0052] It can be understood that the document screen 200 to be photographed is displayed on the intelligent collaborative screen 300. The intelligent collaborative screen can be used in various conferences, open discussions and reports, and generally includes multiple functional modes such as recognition and output of user writing and drawing content, and key marking.

[0053] In other embodiments, the document to be photographed can also be displayed on other devices or objects outside the display screen. For example, if the document screen 200 to be photographed is a screen projected by a projector, the document screen 200 to be photographed can be displayed on a screen or a wall. For another example, if the document screen 200 to be photographed is a screen corresponding to a handwriting blackboard, the document screen 200 to be photographed can be displayed on a handwriting board, a blackboard, etc. It can be understood that the electronic devices in the embodiments of the present application include but are not limited to tablet computers, mobile phones (including foldable screen mobile phones), laptop computers, desktop computers, servers, wearable devices, head-mounted displays, mobile email devices, car equipment, portable game consoles, reader devices, televisions embedded with or coupled with one or more processors, and other types of electronic devices with image capture functions.

[0054] As mentioned above, the user can manually operate the display interface of the electronic device 100 to select the required document shooting mode and scan the document. The following takes the electronic device 100 as an example of a mobile phone to introduce the process of switching the document shooting mode and the corresponding interface changes in some solutions.

[0055] For example, Figures 2a to 2c Schematic diagram of the interface for switching document shooting mode in some embodiments is shown. Figure 2a and Figure 2b In the corresponding embodiment, the user's operation switches the document shooting mode, and uses the shooting function corresponding to the corresponding document shooting mode to shoot the document screen 200 to be shot.

[0056] When the mobile phone 100 receives the user's operation to open the camera application, and the lens of the mobile phone 100 is aimed at the document screen 200 to be photographed, the mobile phone 100 can display the following Figure 2a When the user opens the camera application, the camera application will select the general photo mode by default, that is, the photo option 202 in the mode menu bar 201 of the camera application is selected. The interface may also include a document preview image 204 of the document screen 200 to be photographed under the lens viewfinder of the mobile phone 100.

[0057] like Figure 2a As shown, since the image pointed at by the mobile phone 100 is an electronic slide (hereinafter referred to as a slide), in order to shoot a document image with a higher degree of restoration of the publication page, the user can slide left and right on the mode menu bar to select the corresponding document shooting mode. Figure 2a When the mobile phone 100 detects the user's operation ① and detects that the more option 203 is selected, the mobile phone 100 may display the following Figure 2b The interface shown in the figure is as follows. Figure 2bAs shown, the user can click the document scanning control 206 to switch the shooting mode of the mobile phone 100 to the document scanning mode.

[0058] When the mobile phone 100 detects that the user clicks the document scanning control 206, it will display the following Figure 2c The interface shown in the figure is as follows. Figure 2c As shown, the document scanning option 207 in the mode menu bar 201 is selected.

[0059] When the mobile phone 100 detects that the user clicks the photo control 208, the collected text preview image 204 can be subjected to document scanning processing to obtain the final text scan image, which is stored in the gallery of the mobile phone 100, and the text scan image can be displayed as a thumbnail on the control 209 for opening the gallery.

[0060] It is understandable that users need to switch the document shooting mode, which requires users to manually search and select. The user operation is cumbersome and the user experience is not high.

[0061] In order to solve the above-mentioned problems, an embodiment of the present application provides a method for switching shooting modes. In this method, when the electronic device determines that the electronic device is in a conference shooting scene through the acquired real-time image data, the electronic device can switch the shooting mode to the conference mode. Among them, the conference scene can be various office meetings, open discussions, reports, classes and other scenes, and the conference shooting scene can be a shooting scene in which the user scans the document presented in the conference scene. Correspondingly, the conference mode can be understood as a mode for scanning documents in various office meetings, open discussions, reports, classes and other scenes. The conference mode can process the collected image data based on the characteristics of the image collected in the conference shooting scene and the characteristics of the target image required by the user, such as automatic scaling, head shadow removal, moiré removal, image correction and other image processing.

[0062] The method for switching the photographing mode provided in the embodiment of the present application enables the electronic device to determine whether the electronic device is in a conference shooting scene based on the acquired real-time image data, and when it is determined that the electronic device is in a conference shooting scene, the shooting mode can be intelligently switched to the conference mode. The user does not need to determine the current shooting scene by himself, nor does the user need to manually switch the shooting mode. The operation is simple and the user experience is better.

[0063] It can be understood that the conference mode is a naming example of a shooting mode for scanning documents in various office meetings, open discussions, reports, classes, etc. In other embodiments, the conference mode can also be named as other shooting modes, and this application does not limit this.

[0064] It is understood that the real-time image data is the image corresponding to the current viewing range of the camera of the electronic device 100. The real-time image data can be displayed on the display screen of the electronic device to facilitate the user to adjust the shooting parameters. The real-time image data is not permanently stored in the electronic device, but is temporarily stored.

[0065] It can be understood that by obtaining real-time image data, determining whether the electronic device is in a conference shooting scene specifically includes: determining whether the document in the real-time image data corresponds to the conference shooting scene, that is, whether the document is scanned from a document demonstrating the conference scene.

[0066] In some embodiments, determining that a document is a document presenting a conference scene may specifically include: determining that the detected document is located in a target area of real-time image data of the electronic device. Furthermore, determining that the text content of the document matches a document presenting a conference scene may include, for example, detecting that the document includes four boundaries, detecting that the text content of the document includes words such as "ppt," "summary," and "meeting" indicating that the document is in a conference scene, or detecting that the document includes charts commonly used in conference scenes, such as a bar chart or a line chart.

[0067] In some embodiments, judging whether the electronic device is in a conference shooting scene based on the acquired real-time image data can be achieved through a pre-trained neural network model. The input of the neural network model can be real-time image data, and the output can be whether the scene corresponding to the real-time image data is a conference shooting scene, or the confidence that the corresponding scene is a conference shooting scene. Specifically, the neural network model can extract the image features of the real-time image data through the attention mechanism, and then judge the confidence that the scene of the real-time image data is a conference shooting scene through data processing of multiple neural network layers, and when it is judged that the output confidence exceeds a preset confidence threshold, it determines that the electronic device is for a conference shooting scene.

[0068] In some embodiments, the neural network model can be obtained by training the initial neural network model with a large amount of image data with scene labels and optimizing the parameters of the neural network model.

[0069] In some embodiments, based on the acquired real-time image data, it is determined whether the electronic device is in a conference shooting scene. The image processing can be performed on the acquired real-time image data, and the judgment can be made based on the result of the image processing. Specifically, the image features of the real-time image data can be extracted for judgment. For example, it is determined whether the brightness of the real-time image data matches the brightness threshold of the document presented in the conference scene, whether the real-time image data includes moiré patterns, whether the texture material shown in the image of the real-time image data matches the texture material of the device or object presenting the document in the conference scene, whether the text content of the document includes "ppt", "summary", "meeting" and other content that indicates that the document is in a conference scene, and whether it includes charts commonly used in conference scenes, such as bar charts, line charts, etc. If the above judgment result is yes, it can be determined that the electronic device is in a conference shooting scene.

[0070] In some embodiments, when determining whether the electronic device is in a conference shooting scene, the electronic device may also make a determination based on the electronic device's real-time device status data and user schedule data.

[0071] It can be understood that the real-time device status data of the electronic device may include the real-time device status of the electronic device, for example, it may include the location data of the electronic device, the inclination data of the electronic device, the real-time audio data collected by the electronic device, etc. Among them, the location is the geographical location, the location data can be used to determine the current location of the user, and the inclination data can be used to determine the current usage angle of the electronic device. The user schedule data can be the schedule-related data recorded by the user on the electronic device, or generated by the electronic device based on the user data in some applications, such as the schedule data recorded by the user in the calendar or schedule, the memo data recorded by the user in the memo application, etc. The real-time audio data can be the audio data collected by the microphone of the electronic device in the current scene.

[0072] It is understood that combining the electronic device's real-time device status data and user schedule data to determine whether the electronic device is in a conference scene can specifically include: determining, based on the real-time device status data, whether the electronic device's tilt angle matches a target tilt angle or target tilt angle range; whether the current location of the electronic device is in a preset office area, such as an office; and whether the voice in the real-time audio data matches the voice in the conference scene; and determining, based on the user schedule data, whether the current time is within a user-recorded meeting time period. If all of the above determinations are positive, the electronic device is determined to be in a conference scene. The preset office area can be point of interest (POI) location data matching the office area in a geolocation image, or it can include geolocation data of an office or company preset by the user in the electronic device. In some embodiments, the electronic device can determine whether it is in a conference scene based on real-time image data. In other embodiments, the electronic device can determine whether it is in a conference scene based on real-time image data and at least one of the electronic device's real-time device status data and user schedule data. In other embodiments, the electronic device can also determine whether it is in a conference scene based on real-time image data and other data.

[0073] In some embodiments, determining the scene corresponding to the real-time audio data can be achieved using a scene speech recognition model. The scene speech recognition model can be a pre-trained model that takes the audio data as input and outputs the scene corresponding to the audio data, or outputs whether the audio data corresponds to a conference recording scene.

[0074] It can be understood that the judgment of the above-mentioned multiple data can make the electronic device more accurate in judging the conference shooting scene, but this application does not limit the type and quantity of the above-mentioned data used to judge and perceive the conference shooting scene.

[0075] In some embodiments, when the electronic device determines that it is in a conference shooting scene, it can display a prompt window on the display screen of the electronic device 100 to remind the user to enter the conference mode, and when it detects the user's operation of confirming to enter the conference mode in the prompt window, the shooting mode is switched to the conference mode.

[0076] Specifically, the electronic device prompts the user to enter conference mode in the form of a pop-up window. For example, a pop-up window with the prompt "Enter conference mode?" may be displayed on the current display interface of the electronic device. The pop-up window may also include a "Yes" button and a "No" button, and the user can choose whether to enter conference mode by clicking the "Yes" button or the "No" button. Furthermore, the user's operation of confirming the entry into conference mode may be the user clicking the "Yes" control in the pop-up window.

[0077] In some embodiments, when the electronic device 100 determines that it is no longer in a conference shooting scene, it can switch the conference mode to a general photo taking mode, or it can determine the current shooting scene of the electronic device based on the real-time device status data of the electronic device, the user schedule data and the real-time image data collected by the electronic device, and switch the conference mode to the shooting mode corresponding to the current shooting scene.

[0078] The electronic device determines whether it is no longer in the conference shooting scene, which may include the following situations:

[0079] By determining whether the real-time image data does not include the document, it can be determined whether the electronic device is no longer in the conference shooting scene; specifically, when it is determined that the real-time image data does not include the document, it can be determined that the electronic device is no longer in the conference shooting scene;

[0080] By determining whether the scene corresponding to the document in the real-time image data does not match the conference shooting scene, it can be determined whether the electronic device is no longer in the conference shooting scene; specifically, when it is determined that the scene corresponding to the real-time image data does not match the conference shooting scene, it can be determined that the electronic device is no longer in the conference shooting scene;

[0081] When it is determined that the real-time image data includes both a document or documents presented in a conference scene and other photographed objects, it can be determined whether the electronic device is no longer in the conference shooting scene based on the document or documents presented in the conference scene and the image data of the other photographed objects. In some embodiments, the positional relationship between the document or documents presented in the conference scene and the other photographed objects can be determined based on the depth of field data of the document or documents presented in the conference scene and the other photographed objects. When it is determined that the other photographed objects are closer to the camera of the electronic device, it is determined that the electronic device is no longer in the conference shooting scene. In other embodiments, the ratio of the area occupied by the document or documents presented in the conference scene to the area occupied by the document or documents presented in the conference scene in the real-time image data can be determined based on the proportion of the document or documents presented in the conference scene and the other photographed objects in the real-time image data. When it is determined that the ratio of the area occupied by the document or documents presented in the conference scene to the area occupied by the other photographed objects in the real-time image data meets a preset ratio threshold, it is determined that the electronic device is no longer in the conference shooting scene. In other embodiments, it can be determined that the electronic device is no longer in the conference shooting scene when the number of other photographed objects meets a preset number threshold, for example, when the number of people in the real-time image data meets a preset number threshold.

[0082] It can be understood that the embodiment of the present application can also exit the conference mode when it is determined that the electronic device is no longer in the conference mode. The user does not need to pay attention to the changes in the current shooting mode and switch manually. The operation is simple and the user experience is high.

[0083] The following takes the electronic device 100 as a mobile phone and the application executing the process as a camera application as an example. Figures 3a to 3h The switching process of the shooting mode in the embodiment of the present application is introduced.

[0084] Figures 3a to 3h According to an embodiment of the present application, some other interface schematic diagrams of the switching process of the shooting mode of some electronic devices are shown.

[0085] It can be understood that the application that performs the switching process of the shooting mode can also be other applications that can realize the document scanning function through the camera of the mobile phone 100, such as memos, document scanning applications, etc., and this application does not limit this.

[0086] For example, the process of switching the shooting mode of the mobile phone 100 to the conference mode can refer to Figure 3a to Figure 3b shown.

[0087] When the mobile phone 100 receives the user's operation to open the camera application, and the lens of the mobile phone 100 is aimed at the document screen 200 to be photographed, the mobile phone 100 can display the following Figure 3aThe interface 301 shown in FIG. 301 may include a mode menu bar 302 of the camera application, and the mode menu bar 302 may include some shooting mode options of the camera application, such as a photo option 303, a video option, a professional option, more options, a portrait option, a night scene option, an aperture option, etc. When the mobile phone 100 detects that the user has turned on the camera application, the camera application will select the photo option 303 by default. The interface 301 may include a document preview image 304 of the document screen 200 to be photographed under the lens viewfinder of the mobile phone 100. Figure 3a As shown, the document corresponding to the document preview image 304 is a slideshow.

[0088] It can be understood that the document preview image 304 is an image corresponding to the current viewing range of the camera of the mobile phone 100. Real-time image data can be displayed on the display screen of the electronic device to facilitate the user to adjust the shooting parameters.

[0089] When the mobile phone 100 captures the document preview image 304 via its camera, it can obtain real-time device status data of the mobile phone 100 and user schedule data, such as the tilt status data of the mobile phone 100, the location data of the mobile phone 100, and the meeting schedule data stored on the mobile phone 100. The mobile phone 100 can determine whether the mobile phone 100 is currently in a meeting shooting scene based on the document preview image 304, the tilt status data of the mobile phone 100, the location data of the mobile phone 100, the meeting schedule data stored on the mobile phone 100, and the real-time audio data collected by the mobile phone 100. For example, if it is determined that the tilt angle of the mobile phone 100 matches the target tilt angle or target tilt angle range, the location data of the mobile phone 100 indicates an office, the current time displayed by the mobile phone 100 matches the meeting time period recorded in the meeting schedule data of the mobile phone 100, the real-time audio data collected by the mobile phone 100 matches the audio data of the meeting scene, and the scene corresponding to the document preview image 304 is a meeting shooting scene, it can be determined that the mobile phone 100 is in a meeting shooting scene.

[0090] It can be understood that in some embodiments, when the mobile phone 100 determines whether it is in a conference shooting scene, it can make a judgment based on the document preview image 304 collected above; in other embodiments, the mobile phone 100 can also combine status data and one or more of the user schedule data to determine whether it is in a conference shooting scene, and this application does not impose any restrictions on this.

[0091] For example, when the mobile phone 100 determines that it is in a conference shooting scene, the display interface of the mobile phone 100 can be changed from Figure 3a Transformed into Figure 3b The interface 310 shown. Figure 3bAs shown, the interface 310 may include a document preview image 304, a photo button 311, a control 312 for opening the gallery, an exit button 313 for exiting the conference mode, etc. The interface 310 may also include a flash control for turning the flash on or off, a setting control for setting the camera application, a control for switching the camera of the mobile phone 100, or a control for adjusting the shooting magnification, etc.

[0092] Users can Figure 3b Click the photo button 311 on the interface shown in the figure to process and store the document preview image 304 captured by the camera of the mobile phone 100. Figure 3b In the interface shown, click the exit button 313 to exit the conference mode.

[0093] In some embodiments, when the mobile phone 100 determines that it is in a conference shooting scene, the mobile phone 100 can display a prompt window on the display screen to remind the user to enter the conference mode, and when it detects the user's operation to confirm entering the conference mode in the prompt window, the shooting mode is switched to the conference mode.

[0094] For example, the mobile phone 100 may display a prompt window on the display screen to remind the user to enter the conference mode. Figure 3c shown.

[0095] like Figure 3c As shown, when the mobile phone 100 determines that it is in a conference shooting scene, the mobile phone 100 can pop up a pop-up window on the interface 301 to prompt the user to enter the conference mode, such as Figure 3c When the mobile phone 100 determines that it is in a conference shooting scene, it can display a pop-up window prompt on the display screen of the mobile phone 100, the prompt content is, for example, "Enter conference mode?", refer to Figure 3c At this point, the user can click the "Yes" button 321 to enter the conference mode for shooting. Figure 3c As shown in the operation ②. It can be understood that Figure 3c In the pop-up window 320 shown, the user can also click the “No” button 322 or the close button 323 in the upper right corner of the pop-up window 320 to close the pop-up window and continue to shoot the document in the current shooting mode.

[0096] When the mobile phone 100 detects that the user is Figure 3c When the "Yes" button 321 is clicked in the pop-up window 320 of the interface shown in FIG. 2, that is, operation ②, the display interface of the mobile phone 100 can be changed from Figure 3c Transformed into Figure 3b Interface 310 is shown.

[0097] In other embodiments, the mobile phone 100 may display a prompt window on the display screen to remind the user to enter the conference mode. Figure 3d shown.

[0098] like Figure 3d As shown, when the mobile phone 100 determines that it is in a conference shooting scene, the mobile phone 100 can pop up a pop-up window on the interface 301 to prompt the user to enter the conference mode, such as Figure 3d When the mobile phone 100 determines that it is in a conference shooting scene, it can display a pop-up window prompt on the display screen of the mobile phone 100, and the prompt content is, for example, "Enter conference mode?" Figure 3d At this point, the user can click anywhere in the pop-up window 330 to enter the conference mode for shooting. Figure 3d Operation ③ shown.

[0099] It is understood that the pop-up window on the display screen of the mobile phone 100 can be Figure 3c The pop-up window 320 shown can also be Figure 3d The pop-up window 330 shown may also be other prompt windows, and this application does not limit this.

[0100] In some embodiments, the process of making the mobile phone 100 exit the conference mode from the shooting mode can refer to Figures 3e to 3f shown.

[0101] It is understood that when the current shooting mode of the mobile phone 100 is the conference mode and the image pointed at by the camera of the mobile phone 100 is a face, the mobile phone 100 can display the following Figure 3e Interface 340 is shown. Interface 340 may include a photo button 311, a control 312 for opening the gallery, and an exit button 313 for exiting conference mode. Interface 310 may also include a flash control for turning the flash on or off, a settings control for configuring the camera application, a control for switching the camera of mobile phone 100, or a control for adjusting the shooting magnification. Interface 340 may also include a face preview image 341 of a person's face framed by the lens of mobile phone 100.

[0102] I understand. Figure 3b The interface 310 shown is Figure 3e The difference between interface 340 and the preview image captured by the camera of mobile phone 100 is that the preview image captured by the camera is different. When mobile phone 100 detects a change in the preview image captured by the camera, it can determine whether mobile phone 100 is no longer in the conference shooting scene. Specifically, when mobile phone 100 captures real-time image data including face preview image 341, it can perform image analysis processing on the real-time image data to determine whether the real-time image data includes a document or a document demonstrating the conference scene.

[0103] For example, the real-time image data of the mobile phone 100 is as follows: Figure 3e As shown, the mobile phone 100 can determine that the real-time image data includes the face preview image 341, but does not include documents or slides, and can determine that the mobile phone 100 is no longer in the conference shooting scene. At this time, the mobile phone 100 can exit the conference mode and switch the shooting mode to the general shooting mode. The interface displayed on the display screen of the mobile phone 100 can be changed by Figure 3e Transformed into Figure 3f shown.

[0104] like Figure 3f As shown, when the mobile phone 100 determines that it is no longer in the meeting scene, the mobile phone 100 can display the following Figure 3f Interface 350 is shown. Interface 350 may include a face preview image 341. In some embodiments, interface 350 may also include a mode menu bar 302 for the camera application. Mode menu bar 302 may include some shooting mode options of the camera application, such as a photo option 303, a video option, a professional option, more options, a portrait option, a night scene option, an aperture option, etc. Interface 350 may also include a photo button 311, a control 312 for opening the gallery, a flash control for turning the flash on or off, a settings control for configuring the camera application, a control for switching the camera of mobile phone 100, or a control for adjusting the shooting magnification.

[0105] It is also understood that in other embodiments, Figure 3e The real-time image data in the interface 340 shown may also include a document preview image, that is, the image captured by the camera of the mobile phone 100 includes both a face image and a document image. At this time, the mobile phone 100 can determine whether the mobile phone 100 is no longer in the conference shooting scene in the following ways:

[0106] It is possible to determine whether the mobile phone 100 is no longer in the conference shooting scene by determining the depth of field data of the document image and the face image; specifically, it is possible to determine that the mobile phone 100 is no longer in the conference shooting scene when it is determined that the face is closer to the camera of the mobile phone 100;

[0107] Whether the mobile phone 100 is no longer in the conference shooting scene can be determined by determining the area ratio of the document image and the face image in the real-time image data; specifically, when it is determined that the ratio of the area ratio of the document image and the face image in the real-time image data meets a preset ratio threshold, it can be determined that the mobile phone 100 is no longer in the conference shooting scene;

[0108] Whether the mobile phone 100 is no longer in the conference shooting scene can be determined by judging the number of faces corresponding to the facial image; specifically, when it is determined that the number of other shooting objects meets the quantity threshold, for example, the real-time image data includes 3 facial images, and the quantity threshold is 2, the mobile phone 100 can assume that the user's intention is to capture facial images, and the mobile phone 100 is no longer in the conference shooting scene.

[0109] like Figure 3f As shown, after the mobile phone 100 exits the conference mode, it can use the general photo shooting mode to shoot, that is, the photo shooting option 303 in the mode menu bar 302 is selected. In other embodiments, the mobile phone 100 can also determine the corresponding shooting scene based on the image data in the real-time image data, and then switch the conference mode to the corresponding shooting mode. For example, due to Figure 3e In the interface shown, the real-time image data includes a face image 341 , and the mobile phone 100 can switch the conference mode to a portrait shooting mode.

[0110] In some embodiments, when the mobile phone 100 determines that it is no longer in a conference shooting scene, the mobile phone 100 can display a prompt window on the display screen to remind the user to exit the conference mode, and when it detects the user's operation to confirm the exit of the conference mode in the prompt window, the shooting mode is switched to the general photo mode or other shooting mode.

[0111] For example, the mobile phone 100 may display a prompt window on the display screen to remind the user to exit the conference mode. Figure 3g shown.

[0112] like Figure 3g As shown, when the mobile phone 100 determines that it is no longer in the conference shooting scene, the mobile phone 100 can pop up a pop-up window on the interface 340 to prompt the user to exit the conference mode, such as Figure 3g When the mobile phone 100 determines that it is in a conference shooting scene, it can display a pop-up window prompt on the display screen of the mobile phone 100, the prompt content is, for example, "Exit conference mode?", refer to Figure 3g At this point, the user can click the "Yes" button 361 to exit the conference mode. Figure 3g Operation ④ is shown. It can be understood that Figure 3g In the pop-up window 360 shown, the user can also click the "No" button 362 or the close button 363 in the upper right corner of the pop-up window 360 to close the pop-up window and continue shooting in the current conference mode.

[0113] When the mobile phone 100 detects that the user is Figure 3g When the "Yes" button 361 is clicked in the pop-up window 360 of the interface shown in FIG. 4, the display interface of the mobile phone 100 can be changed from Figure 3gTransformed into Figure 3f Interface 350 is shown.

[0114] In other embodiments, the mobile phone 100 may display a prompt window on the display screen to remind the user to exit the conference mode. Figure 3h shown.

[0115] like Figure 3h As shown, when the mobile phone 100 determines that it is no longer in the conference shooting scene, the mobile phone 100 can pop up a pop-up window on the interface 340 to prompt the user to exit the conference mode, such as Figure 3h When the mobile phone 100 determines that it is in a conference shooting scene, it can display a pop-up window prompt on the display screen of the mobile phone 100, and the prompt content is, for example, "Exit conference mode?" Figure 3h At this point, the user can click anywhere in the pop-up window 370 to exit the conference mode. Figure 3h Operation ⑤ shown.

[0116] It is understood that the pop-up window on the display screen of the mobile phone 100 can be Figure 3g The pop-up window 360 shown can also be Figure 3h The pop-up window 370 shown in d can also be other prompt windows, and this application does not limit this.

[0117] Before introducing the method for switching shooting modes provided in the embodiment of the present application, Figure 4 , the hardware structure of the electronic device 100 in the embodiment of the present application is introduced.

[0118] Figure 4 A schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application.

[0119] like Figure 4As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an optical image stabilization module 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an acceleration sensor 180C, a distance sensor 180D, a touch sensor 180E, an ambient light sensor 180F, and the like.

[0120] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0121] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors. The controller may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0122] In some embodiments of the present application, the processor 110 can control the scene judgment of the collected real-time image data through the controller, and judge whether it is in a conference shooting scene or no longer in a conference shooting scene, etc., and switch the camera and other applications to enter the conference mode when in the conference shooting scene, so as to process the collected image data based on the characteristics of the image collected in the conference shooting scene and the characteristics of the target image required by the user, such as automatic scaling, head shadow removal, moiré removal, image correction and other image processing, to obtain a document image that meets the user's needs, or when it is no longer in the conference shooting scene, control the camera application and the like to exit the conference mode, thereby realizing intelligent switching of shooting modes without the need for manual selection by the user.

[0123] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that have just been used or are recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system. In some embodiments of the present application, the memory may store relevant judgment conditions, preset parameters, and various instruction data for implementing the shooting mode switching method provided by the present application, which are not limited here.

[0124] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0125] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, processor 110 may include multiple I2C busses. Processor 110 may be coupled to touch sensor 180E, a charger, a flash, camera 193, and the like via different I2C bus interfaces. For example, processor 110 may be coupled to touch sensor 180E via an I2C interface, enabling communication between processor 110 and touch sensor 180K via the I2C bus interface, thereby enabling touch functionality in electronic device 100.

[0126] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0127] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0128] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, implementing the function of playing music through a Bluetooth headset.

[0129] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to enable the display function of the electronic device 100.

[0130] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0131] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0132] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0133] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also power the electronic device through the power management module 141. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and powers the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160.

[0134] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0135] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.

[0136] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low-noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be located in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be located in the same device as at least some of the modules of the processor 110.

[0137] The wireless communication module 160 can provide wireless communication solutions for the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), and other wireless communication solutions. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation via the antenna 2.

[0138] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite-based augmentation system (SBAS).

[0139] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0140] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0141] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0142] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0143] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1. In an embodiment of the present application, the camera 193 can collect image data during the process of capturing an image. In other embodiments, the image data collected by the camera 193 can also be used to determine the scene in which the electronic device 100 is located at this time. It can be understood that several scenes can be preset on the electronic device 100, such as the above-mentioned scenes. Figure 3a The conference shooting scene shown, Figure 3e For example, the processor 110 can switch the corresponding shooting mode based on the perceived scene, such as the portrait scene shown.

[0144] A digital signal processor processes digital signals, not only digital image signals but also other digital signals. A video codec compresses or decompresses digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or capture videos encoded in various formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0145] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, voice recognition, and text comprehension.

[0146] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored on the external memory card. In an embodiment of the present application, slide images scanned or captured in conference mode can be stored on the external memory card connected to the external memory interface.

[0147] The internal memory 121 can be used to store computer-executable program code, including instructions. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as a sound playback function or an image playback function). The data storage area may store data generated during the use of the electronic device 100 (such as audio data, a phone book, etc.). Furthermore, the internal memory 121 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, a flash memory device, or a universal flash storage (UFS). The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and / or instructions stored in a memory provided within the processor. In embodiments of the present application, the internal memory 121 may store executable program code, instructions, etc., for the electronic device 100 to execute the shooting mode switching method of the present application.

[0148] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0149] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0150] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0151] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0152] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0153] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D may be the USB interface 130 or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface or a Cellular Telecommunications Industry Association of the USA (CTIA) standard interface.

[0154] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates made of conductive material. When force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. In an embodiment of the present application, during document scanning, the electronic device 100 can use the pressure sensor 180A to detect the touch position and focus to select the target focus located at the touch position, such as a document or a portrait.

[0155] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the gyroscope sensor 180B can be used to determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter button is pressed, the gyroscope sensor 180B detects the angle of vibration of the electronic device 100. The processor 110 calculates the distance that the optical image stabilization module 192 needs to compensate based on the angle. The optical image stabilization module 192 then controls the lens to move in the opposite direction to offset the vibration of the electronic device 100, thereby achieving image stabilization.

[0156] Accelerometer 180C can detect the magnitude of the electronic device 100's acceleration in all directions (generally three axes). When the electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device 100's posture, enabling applications such as landscape / portrait switching and pedometers. In this embodiment of the present application, accelerometer 180C can be used to identify whether the electronic device 100 is in portrait or landscape orientation when shooting video, thereby adaptively adjusting the camera capture interface display.

[0157] Distance sensor 180D is used to measure distance. Electronic device 100 can measure distance using infrared or laser technology. In an embodiment of the present application, in a document scanning scenario, electronic device 100 can use distance sensor 180D to measure distance and determine the depth of field data of at least one captured object in real-time image data, such as the depth of field data of a document or a human face.

[0158] Touch sensor 180E, also known as a "touch device," can be disposed on display screen 194. Touch sensor 180E and display screen 194 form a touch screen, also known as a "touch screen." Touch sensor 180E is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, at a location different from that of display screen 194.

[0159] Ambient light sensor 180F is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light brightness. Ambient light sensor 180F can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180F can also work in conjunction with a proximity light sensor to detect whether electronic device 100 is in a pocket to prevent accidental touches.

[0160] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0161] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. The motors 191 commonly used in electronic devices 100 include linear motors and rotor motors. The linear motor can support precise control of vibration intensity, vibration frequency, etc., and the start-stop delay performance is also strong.

[0162] To simplify the description, the following text takes the electronic device 100 as a mobile phone, and switches the shooting mode in the camera application to illustrate the technical solution of the present application.

[0163] The following will be combined Figure 1 The scene graph shown, Figure 4 The system structure diagram shown in the figure further describes in detail a method for switching shooting modes of the present application. Example

[0164] The following describes in detail the specific process of the method for switching the shooting mode of the embodiment of the present application implemented by the mobile phone 100 in combination with the flow chart and related interface diagrams. It can be understood that this embodiment is a method for switching the camera's shooting mode to the conference mode.

[0165] Figure 5 According to an embodiment of the present application, a flow chart of a method for switching shooting modes is shown. In the embodiment of the present application, Figure 5 The execution subject of each step shown is the mobile phone 100. In order to avoid repeated description, the execution subject of each step will not be described again when describing the execution content of each step below.

[0166] like Figure 5 As shown, the process includes the following steps:

[0167] 501: In response to a user operation, start a camera to capture an image.

[0168] Specifically, the user can operate the mobile phone 100, find the camera application icon in the desktop application icon of the mobile phone 100 and click the icon. After starting the camera, the default shooting mode will be selected to shoot an image. The user interface after the mobile phone 100 starts the camera can refer to Figure 3a shown.

[0169] 502: Acquire real-time image data.

[0170] It can be understood that the real-time image data is the image data of the current viewing range collected by the mobile phone 100 through the camera. The mobile phone 100 can display the collected real-time image data to the user through the display screen, for example Figure 3a The document preview image 304 in FIG. It can be understood that the position, outline size, and degree of clarity or blurriness of the object in the real-time image data collected at different times may change.

[0171] 503: Based on the real-time image data, determine whether it is in a conference shooting scene. If the mobile phone 100 determines that it is in a conference shooting scene, indicating that the user needs to shoot or scan slides, the mobile phone 100 executes step 504, otherwise it executes step 502 and continues to the next judgment.

[0172] It can be understood that it can be various office meetings, open discussions, reports, classes and other scenes. The conference shooting scene can be a shooting scene in which the user scans the document presented in the conference scene. Generally, in a conference scene, documents can be presented through devices such as smart screens and projectors, or written text can be displayed through handwriting boards. Users can use the mobile phone 100 to shoot or scan documents in the current conference scene to record important information.

[0173] It is understood that determining whether the mobile phone 100 is in a conference capture scene based on real-time image data may include: It is understood that determining whether the electronic device is in a conference capture scene based on the acquired real-time image data. Specifically, this includes determining whether a document in the real-time image data corresponds to a conference capture scene, that is, whether the document is a document depicting a conference scene. Furthermore, if it is determined that the real-time image data includes image data of a document depicting a conference scene, then the mobile phone 100 is determined to be in a conference capture scene.

[0174] It can be understood that the documents for conference scene presentation include but are not limited to documents output and displayed through projectors, display screens, etc., and the documents can be, for example, presentations, presentation spreadsheets, etc. It can also include documents corresponding to handwritten blackboards produced by electronic brushes (such as handwriting and marking brushes of electronic devices) or physical brushes (such as chalk, markers, styluses, etc.). In some embodiments, determining that a document is a document for conference scene presentation can specifically be: determining that the detected document is located in the target area of the real-time image data of the electronic device. And determining that the text content of the document matches the document for conference scene presentation, for example, it can be detected that the document includes four boundaries, that the text content of the document includes "ppt", "summary", "meeting", etc., which indicates that the document is in the content of the conference scene, or that the document includes charts commonly used in conference scenes, such as bar charts, line charts, etc.

[0175] In some embodiments, judging whether the electronic device is in a conference shooting scene based on the acquired real-time image data can be achieved through a pre-trained neural network model. The input of the neural network model can be real-time image data, and the output can be whether the scene corresponding to the real-time image data is a conference shooting scene, or the confidence that the corresponding scene is a conference shooting scene. Specifically, the neural network model can extract the image features of the real-time image data through the attention mechanism, and then judge the confidence that the scene of the real-time image data is a conference shooting scene through data processing of multiple neural network layers, and when it is judged that the output confidence exceeds a preset confidence threshold, it determines that the electronic device is for a conference shooting scene.

[0176] In some embodiments, the neural network model can be obtained by training the initial neural network model with a large amount of image data with scene labels and optimizing the parameters of the neural network model.

[0177] In some embodiments, based on the acquired real-time image data, it is determined whether the electronic device is in a conference shooting scene. The image processing can be performed on the acquired real-time image data, and the judgment can be made based on the result of the image processing. Specifically, the image features of the real-time image data can be extracted for judgment. For example, it is determined whether the brightness of the real-time image data matches the brightness threshold of the document presented in the conference scene, whether the real-time image data includes moiré patterns, whether the texture material shown in the image of the real-time image data matches the texture material of the device or object of the document commonly used for presentation in the conference scene, whether the text content of the document includes "ppt", "summary", "meeting" and other characters that indicate that the document is in a conference scene, and whether it includes charts commonly used in conference scenes, such as bar charts, line charts, etc. If the above judgment result is yes, it can be determined that the electronic device is in a conference shooting scene.

[0178] For example, the preview image corresponding to the real-time image data acquired by the mobile phone 100 can be Figure 3a The mobile phone 100 can determine that the real-time preview image in the interface 301 includes a real-time text preview image 304. Furthermore, the mobile phone 100 can input the text preview image 304 into a neural network model for determining the scene in which the image is located. The neural network model can output that the scene corresponding to the text preview image 304 is a conference shooting scene, and then it can be determined that the mobile phone 100 is in a conference shooting scene.

[0179] 504: The shooting mode of the running camera application is switched to the conference mode.

[0180] It is understood that when the mobile phone 100 determines that it is in a conference shooting scene, it can enter the conference mode to shoot or scan. The conference mode can be understood as a mode for scanning documents in various office meetings, open discussions, reports, classes, etc. The conference mode can process the collected image data based on the characteristics of the image collected in the conference shooting scene and the characteristics of the target image required by the user, such as automatic scaling, head shadow removal, moiré removal, image correction, and other image processing conference shooting scenes.

[0181] For example, when the mobile phone 100 determines that it is in a conference shooting scene, it can render the relevant parameters of the camera user interface corresponding to the conference mode preset in the mobile phone 100 to generate the following image: Figure 3b The interface 310 shown. When the mobile phone 100 detects that the user clicks the photo button 311 in the interface 310, it can obtain the image data within the camera's field of view. Then, the image processor of the mobile phone 100 can perform image processing on the real-time image data based on the image processing algorithms preset in the conference mode, such as automatic zooming, head shadow removal, moiré removal, image correction and other algorithms, and store the document scan results obtained by image processing in the memory of the mobile phone 100 (for example, an external memory connected via the external memory interface 120 or an internal memory 121). At this time, the document scan results in conference mode can also be displayed as thumbnails in the circular area of the control 312 for opening the gallery. When the mobile phone 100 detects that the user clicks the control 312, the document scan results can be displayed on the display screen. In addition, the mobile phone 100 can also switch from conference mode to conference mode when it detects that the user clicks the exit button 313 for exiting conference mode. Figure 3a The photo mode shown.

[0182] In some embodiments, after the mobile phone 100 executes step 503, when it is determined that the mobile phone 100 is in a conference shooting scene, Figure 3a The interface shown displays a prompt window reminding the user to enter conference mode. Figure 3cAs shown, when the mobile phone 100 detects that the mobile phone 100 is in a conference shooting scene, a pop-up window 320 with prompt content such as "Enter conference mode?" can be displayed on the interface 301. The user can click the "Yes" button 321 to choose to enter the conference mode. Figure 3c In addition, the user can also click the "No" button 322 or the close button 323 in the upper right corner of the pop-up window 320 to close the pop-up window and continue to use the current shooting mode to shoot the document. In other embodiments, the prompt window can also be used, for example Figure 3d The pop-up window 330 shown has been introduced above and will not be described here in detail. When the mobile phone 100 detects that the user clicks the "Yes" button 321, the mobile phone 100 can execute the above step 504 and display the following information: Figure 3b The interface shown.

[0183] It can be understood that the shooting mode switching method provided in this embodiment 1 does not require the user to identify the current shooting scene by himself, nor does it require the user to find and switch the shooting mode by himself. When the mobile phone 100 senses that the mobile phone 100 is in a conference shooting scene based on real-time image data, it can intelligently switch the camera of the mobile phone 100 into conference mode to shoot or scan documents presented in the conference scene. The user operation is simple and the user experience is better.

[0184] In some embodiments, the mobile phone 100 can determine that the mobile phone 100 is in a conference shooting scene based on the real-time image data obtained by the mobile phone 100 in other document scanning modes, such as form recognition mode, document recognition mode, and other document scanning modes, and can switch the shooting mode of the mobile phone 100 to the conference mode. In other embodiments, the mobile phone 100 can switch the shooting mode of the mobile phone 100 to the conference mode after the user operates the mode menu bar of the camera and selects any shooting mode, or when the mobile phone 100 is in any shooting mode and determines that the mobile phone 100 is in a conference shooting scene. This application does not limit this. For example, the current shooting mode of the mobile phone 100 is portrait mode, and the mobile phone 100 perceives that the mobile phone 100 is in a conference shooting scene based on the real-time image data obtained, then the mobile phone 100 can intelligently switch from portrait mode to conference mode, or the mobile phone 100 displays a prompt window on the display screen to prompt the user to enter conference mode.

[0185] In some embodiments, after executing step 502, the mobile phone 100 may first determine whether the mobile phone 100 is currently in a document scanning scenario based on real-time image data, and directly switch to general document scanning mode when it is determined that the mobile phone 100 is in a document scanning scenario. Alternatively, when the mobile phone 100 determines that it is in a document scanning scenario, a pop-up window prompting the user to enter general document scanning mode is displayed on the display interface of the display screen, and when the user confirms the operation of entering general document scanning mode, the mobile phone 100 enters general document scanning mode. Furthermore, after the mobile phone 100 enters document scanning mode, the mobile phone 100 can further determine whether the mobile phone 100 is in a conference shooting scenario based on real-time image data, that is, execute step 503.

[0186] It is understood that in some embodiments, the mobile phone 100 may perform image processing on the acquired real-time image data, extract image features, and determine whether the real-time image data includes a document based on the extracted image features, thereby determining whether the mobile phone 100 is in a document scanning scenario. Documents may include paper documents, brochures, business cards, slides, test papers, invoices, and cards and certificates. Cards and certificates may include, for example, identity cards, bank cards, household registration books, driver's licenses, property ownership certificates, business licenses, graduation certificates, degree certificates, marriage certificates, and the like.

[0187] For example, it can be determined whether the image corresponding to the real-time image data includes text content, such as whether it includes words; another example can be determined whether the area corresponding to the text content includes a boundary that matches the edge of the document. If the above determination result is yes, it indicates that the real-time image data includes a document and the mobile phone 100 is in a document scanning scenario.

[0188] It can be understood that the conference scene is a further refinement of the document scanning scene. The image data of documents collected in different document scanning scenes have different image characteristics, and thus the requirements for image processing are also different. Using different shooting modes based on different document scanning scenes can make the shooting or scanning results more in line with the user's usage needs.

[0189] For example, the method of making the mobile phone enter the general document scanning mode can refer to Figures 6a to 6b shown.

[0190] Figures 6a to 6b Shown are some schematic diagrams of interface changes for switching to a general document scanning mode provided in an embodiment of the present application.

[0191] like Figure 6a As shown, the mobile phone 100 obtains Figure 6aAfter the real-time image data shown in the interface 601 is displayed, it can be determined that the real-time image data shown in the interface 601 includes a document image, that is, includes a document preview image 602, which is suitable for shooting in the document scanning mode. Then, a pop-up prompt can be displayed on the display screen of the mobile phone 100, and the prompt content is, for example, "Enter document scanning mode?", referring to Figure 6a The pop-up window 610 is shown. The user can click the "Yes" button 611 to enter the document scanning mode. Figure 6a As shown in the operation ⑥. It can be understood that Figure 6a In the pop-up window 610 shown, the user can also click the "No" button 612 or the close button 613 in the upper right corner of the pop-up window 610 to close the pop-up window and continue capturing images using the current capture mode. It can be understood that the document scanning mode here is a universal document scanning mode, that is, the same image processing algorithm is used to process the captured document images.

[0192] When the mobile phone 100 detects that the user clicks the "Yes" button 611 in the pop-up window 610, that is, detects the user's operation ⑥, the mobile phone 100 responds to the user's operation ⑥ and the display interface of the mobile phone 100 is changed from Figure 6a The interface shown is transformed into the interface 620 shown in Figure 6b. The interface 620 may include a document scanning mode shooting control 621, a control 622 for opening a gallery, an exit space 623 for exiting the document scanning mode, and the like.

[0193] Furthermore, the mobile phone 100 displays Figure 6b When the interface shown is displayed, the mobile phone 100 can also obtain real-time image data, and then continue to determine the scanning scene corresponding to the document in the real-time image data. When it is determined that the scanning scene corresponding to the document is a conference shooting scene, that is, when the mobile phone 100 is determined to be in a conference shooting scene, the mobile phone 100 can be Figure 6b The document scanning mode shown is switched to the conference mode intelligently, i.e. the mobile phone 100 displays Figure 3b The interface shown.

[0194] In some embodiments, the mobile phone 100 displays Figure 6a After the interface 601 is displayed, and it is determined that the mobile phone 100 is in the document scanning scene, the mobile phone 100 may not display Figure 6a As shown in the pop-up window 610, the mobile phone 100 can directly switch from the camera mode to Figure 6b The document scanning mode shown is not limited in this application.

[0195] I understand. Figure 6b The interface 620 shown is similar to Figure 3b The interfaces 310 shown are similar and include similar content, but Figure 3bIn the interface shown, the camera is in conference mode. Figure 6b In the interface shown, the camera is in document scanning mode. Figure 3b In the interface shown, after clicking the photo control, the image processor of the mobile phone 100 can process the image data based on the image processing flow corresponding to the conference mode. Figure 6b After clicking the photo control in the interface shown, the image processor of the mobile phone 100 can process the image data based on the preset image processing process of general documents. That is, the processing processes of the image data and the processed image data are different between the two.

[0196] The following will be combined Figure 1 The scene graph shown, Figure 4 The system structure diagram shown in FIG. 1 further describes in detail another method for switching shooting modes of the present application. Example

[0197] The following describes in detail the specific process of the method for switching the shooting mode of the embodiment of the present application implemented by the mobile phone 100 in combination with the flow chart and related interface diagrams. It can be understood that this embodiment is a method for switching the camera's shooting mode to the conference mode.

[0198] Figure 7 According to an embodiment of the present application, a flow chart of a method for switching shooting modes is shown. In the embodiment of the present application, Figure 7 The execution subject of each step shown is the mobile phone 100. In order to avoid repeated description, the execution subject of each step will not be described again when describing the execution content of each step below.

[0199] like Figure 7 As shown, the process includes the following steps:

[0200] 701: In response to the user operation, start the camera to capture the image. Figure 5 The same as step 501 in , which will not be described here.

[0201] 702: Acquire real-time image data. Figure 5 The process is the same as step 502 in , and will not be described in detail here.

[0202] 703: Obtain real-time device status data and user schedule data.

[0203] Specifically, the real-time device status data may include the location data of the mobile phone 100 obtained by locating the mobile phone 100 through the antenna and wireless communication module or the mobile communication module; the real-time device status data may also include the tilt data of the mobile phone 100 when shooting an image, which is identified by the accelerometer 180C of the mobile phone 100; the real-time device status data may also include the real-time audio data collected by the mobile phone 100 through the microphone 170C. Among them, the location data can be used to determine the user's current location, the tilt data can be used to determine the tilt posture (i.e., the usage angle) of the mobile phone 100 when the user uses the mobile phone 100 to shoot, and the real-time audio data can be used to determine whether the mobile phone 100 is currently in a conference shooting scene.

[0204] Specifically, user schedule data may include data about work or life arrangements recorded by the user in applications on the mobile phone 100, such as schedule calendar data recorded by the user in a schedule / calendar application, or memo data recorded by the user in a memo application. User schedule data may also include schedule-related data generated by the mobile phone 100 based on user data in some applications. For example, if the mobile phone 100 detects that a notification about a meeting has been received in the user's SMS application, the mobile phone 100 may generate user schedule data matching the notification in applications such as schedule / calendar or memos based on the notification. In some embodiments, user schedule data may also be data obtained from other applications, which is not limited in this application.

[0205] 704: Based on the real-time image data, device status data, and user schedule data, determine whether the user is in a conference shooting scene. If the mobile phone 100 determines that the user is in a conference shooting scene, indicating that the user needs to shoot or scan slides, the mobile phone 100 executes step 705. Otherwise, it executes step 702 and continues to the next determination.

[0206] It can be understood that the method for the mobile phone 100 to determine whether it is in a conference shooting scene based on the real-time image data obtained is the same as Figure 5 The method in step 503 is the same as that in FIG, and will not be repeated here.

[0207] In some embodiments, the mobile phone determines whether the mobile phone 100 is in a conference shooting scene based on real-time device status data, which may include at least one of the following:

[0208] Determine whether the mobile phone 100 is currently in an office area based on the acquired real-time location information of the mobile phone 100; specifically, the user may set the user's office or company location in the mobile phone 100, and the mobile phone 100 determines whether the real-time location information matches the office or company location set by the user, or after acquiring the real-time location data, determine whether the mobile phone is currently located in an office area such as an office building or a company;

[0209] Based on the acquired tilt angle data of the mobile phone 100, it is determined whether the tilt angle of the mobile phone 100 matches the target tilt angle or the target tilt angle range. Specifically, since in a conference shooting scene, the user generally holds the mobile phone in a landscape or portrait orientation perpendicular to a horizontal plane when shooting, the target tilt angle may be 90 degrees perpendicular to the horizontal plane, or an angle range set based on 90 degrees perpendicular to the horizontal plane.

[0210] Based on the real-time audio data acquired from the mobile phone 100, it is determined whether the scene corresponding to the real-time audio data of the mobile phone 100 matches the conference scene. An initialized speech recognition model can be trained using a large amount of scene-labeled speech data to obtain a scene speech recognition model that can output the scene corresponding to the audio data or whether the audio data corresponds to a conference scene. The scene speech recognition model can be a pre-trained model that takes audio data as input and outputs the scene corresponding to the audio data, or outputs whether the audio data corresponds to a conference scene.

[0211] In some embodiments, the device status data may also include other types of data used to determine whether the user is in a meeting scene, and this application does not limit this.

[0212] In some embodiments, the mobile phone determines whether the mobile phone 100 is in a conference shooting scene based on real-time user schedule data, which may include: the mobile phone 100 extracts meeting schedule data related to the meeting schedule from the user schedule data, and determines whether the current time matches any one of the meeting time periods in the extracted meeting schedule data.

[0213] For example, the mobile phone 100 may extract meeting-related schedule / calendar data from a schedule / calendar application, and then determine whether the current time matches any meeting time period in the extracted meeting-related schedule / calendar data. For another example, the mobile phone 100 may extract meeting-related memo data from a memo application, and then determine whether the current time matches any meeting time period in the extracted meeting-related memo data.

[0214] It is understood that in some embodiments, the mobile phone 100 can determine whether the mobile phone 100 is in a conference shooting scene based on real-time image data and device status data. In other embodiments, the mobile phone 100 can determine whether the mobile phone 100 is in a conference shooting scene based on real-time image data and user schedule data. This application is not limited to this.

[0215] It can be understood that when the judgment result of the mobile phone 100 for the judgment conditions of the above-mentioned device status data and / or user schedule data is yes, it can be determined that the mobile phone 100 is in a conference shooting scene, and the mobile phone 100 can execute step 705.

[0216] 705: The shooting mode of the running camera application is switched to the conference mode. Figure 5 The process is the same as step 504 in , and will not be described in detail here.

[0217] It can be understood that in this embodiment 2, the mobile phone 100 can determine whether the mobile phone 100 is in a conference shooting scene based on real-time image data, device status data, and user schedule data. Compared with the judgment based on real-time image data in the aforementioned embodiment 1, the judgment result can be more accurate.

[0218] The following will be combined Figure 1 The scene graph shown, Figure 4 The system structure diagram shown in FIG. 1 further describes in detail another method for switching shooting modes of the present application. Example

[0219] The following describes in detail the specific process of the method for switching the shooting mode of the embodiment of the present application implemented by the mobile phone 100 in conjunction with the flow chart and related interface diagrams. It can be understood that this embodiment is a method for switching the camera out of the conference mode.

[0220] Figure 8 According to an embodiment of the present application, a flow chart of a method for switching shooting modes is shown. In the embodiment of the present application, Figure 8 The execution subject of each step shown is the mobile phone 100. In order to avoid repeated description, the execution subject of each step will not be described again when describing the execution content of each step below.

[0221] like Figure 8 As shown, the process includes the following steps:

[0222] 801: When the shooting mode of the running camera application is in conference mode, real-time image data is acquired.

[0223] It is understood that when acquiring real-time image data, the camera running in the mobile phone 100 is currently in conference mode. At this time, the interface displayed on the display screen of the mobile phone 100 may be, for example, Figure 3e At this time, the controls / buttons included in the display interface of the mobile phone 100 can be Figure 3b The controls / buttons included in the middle interface are the same, for example, they may include a photo button 311, a control 312 for opening the gallery, an exit button 313 for exiting the conference mode, a flash control for setting the flash on or off, a setting control for setting the camera application, a control for switching the camera of the mobile phone 100, or a control for adjusting the shooting magnification, etc.

[0224] It can be understood that the real-time image data collected is the same as the method in step 502, which is the image information within the field of view of the camera collected by the camera of the mobile phone 100 at the current moment. When the shooting object aimed at the camera of the mobile phone 100 changes, the real-time image data collected by the camera is different.

[0225] 802: Based on the real-time image data, determine whether the camera is no longer in a conference shooting scene. If the mobile phone 100 determines that the camera is still in a conference shooting scene, indicating that the user needs to continue shooting or scanning documents for the conference scene presentation, the mobile phone 100 maintains the conference mode and continues to acquire real-time image data during this period. Then, the next conference shooting scene determination is performed. Otherwise, the process proceeds to step 803.

[0226] It can be understood that documents presented in conference scenarios may include documents presented in various office meetings, open discussions, reports, classes, etc., and may include but are not limited to documents displayed on electronic screens, documents projected by projectors, handwritten blackboards on handwriting boards, etc.

[0227] It is understood that the mobile phone 100 determines whether it is no longer in the conference shooting scene based on the real-time image data. It can determine whether the mobile phone 100 is no longer in the conference shooting scene by determining whether the real-time image data obtained by the mobile phone 100 includes a document demonstrating the conference scene. Specifically, the judgment result may include the following situations:

[0228] First, the real-time image data does not include documents for conference scene presentations. In some embodiments, a neural network model can be used to determine whether the real-time image data includes documents for conference scene presentations. In other embodiments, the collected real-time image data can be processed to extract image features of the real-time image data for judgment. For example, it can be determined whether the brightness of the real-time image data matches the brightness threshold of the document for conference scene presentations, whether the real-time image data includes moiré patterns, whether the texture material shown in the image of the real-time image data matches the texture material of the equipment or objects commonly used for presentation documents in conference scenes, whether the text content of the document includes "ppt", "summary", "meeting" and other characters that indicate that the document is in a conference scene, and whether it includes charts commonly used in conference scenes, such as bar charts, line charts, etc. If the above judgment result is no, it can be determined that the electronic device is no longer in the conference shooting scene.

[0229] Secondly, when the real-time image data only includes documents demonstrating the conference scene, and it is determined that the position of the document matches the target area of the real-time image data of the electronic device, it can be determined that the mobile phone 100 is still in the conference shooting scene, and the user still needs to shoot or scan the document demonstrating the conference scene.

[0230] Third, the real-time image data includes both the document demonstrating the conference scene and other photographed objects. It is understandable that when the real-time image data includes other photographed objects in addition to the document demonstrating the conference scene, further analysis of the images of the multiple objects is required to determine whether the mobile phone 100 is no longer in the conference shooting scene.

[0231] In some embodiments, it is possible to determine whether the mobile phone 100 is no longer in the conference shooting scene by obtaining depth of field information of the document and other photographed objects in the conference scene presentation. Specifically, the distance between the document and the mobile phone 100, as well as the distance between the other photographed objects and the mobile phone 100, can be obtained through the distance sensor of the mobile phone 100. Then, based on the obtained distance information, the positional relationship between the document and other photographed objects in the conference scene presentation and the mobile phone 100 can be determined. If it is determined that the other photographed objects are closer to the mobile phone 100, it is determined that the mobile phone 100 is no longer in the conference shooting scene.

[0232] In other embodiments, the area ratio of the image data corresponding to the documents and other photographed objects presented in the conference scene in the real-time image data can be calculated to determine whether the mobile phone 100 is no longer in the conference shooting scene. Specifically, the mobile phone 100 can extract the images of the documents and other photographed objects presented in the conference scene based on the real-time image data, and then calculate their image areas or the area ratios in the real-time image data respectively, compare the calculation results, and determine whether the calculated ratio matches the preset ratio threshold. When it is determined that the calculated ratio matches the preset ratio threshold, it is determined that the mobile phone 100 is no longer in the conference shooting scene. For example, the mobile phone 100 determines that the real-time image data includes slide images and face images, and can calculate the area occupied by the slide image and the area occupied by the face image, and then compare the two areas to calculate the area ratio of the slide image to the face image, and determine whether the area ratio matches the preset ratio threshold.

[0233] In other embodiments, it is also possible to determine whether the mobile phone 100 is no longer in the conference shooting scene by determining the number of other objects. Specifically, it can be determined that the mobile phone 100 is no longer in the conference shooting scene when it is determined that the number of other shooting objects in the real-time image data meets a preset number threshold. For example, if the real-time image data includes three facial images and the preset number threshold is 2, it can be determined that the mobile phone 100 is no longer in the conference shooting scene.

[0234] In some embodiments, the above steps 801 and 802 may be performed by the mobile phone 100. Figure 5 Step 504, Figure 7 In step 705 or after the user manually switches the shooting mode to the conference mode, the mobile phone 100 executes according to the preset frequency. In other embodiments, the above steps 801 and 802 can be performed by the mobile phone 100. Figure 5 Step 504, Figure 7 Step 705 in the above example or the user manually switches the shooting mode to the conference mode, and the user switches the mobile phone 100 to the desktop or other applications, and then switches back to the camera application. This application does not limit this.

[0235] 803: Based on the real-time image data, determine whether the scene is a document scanning scene other than the conference shooting scene. If the mobile phone 100 determines that it is in the document scanning scene, indicating that the user needs to shoot or scan a document, the mobile phone 100 executes step 804, otherwise executes step 805.

[0236] It can be understood that when the mobile phone 100 determines that it is no longer in the conference shooting scene, that is, the current scene is no longer shooting or scanning the document presented in the conference scene, the mobile phone 100 can further determine whether the mobile phone 100 is in other document scanning scenes other than the conference shooting scene. When the mobile phone 100 determines that it is in other document scanning scenes, it can directly switch to the corresponding document scanning mode. When the mobile phone 100 determines that it is not in the document scanning mode, it can switch the shooting mode to the general shooting mode. Among them, the general shooting mode can be the default shooting mode when the camera is running after the user clicks the icon of the camera application on the desktop of the mobile phone 100, for example, Figure 3a Photo mode in .

[0237] Specifically, the mobile phone 100 determines whether it is in other document scanning scenarios outside of the conference shooting scenario, which may include: performing image processing on the real-time image data, performing text recognition, such as determining whether the real-time image data includes text content, whether it includes the boundaries corresponding to the document, etc., and determining whether the real-time image data includes a document. Furthermore, when determining that the real-time image data includes a document, the text content, typesetting information, document boundary information, etc. in the real-time image data can be extracted, and based on the extracted information, it can be determined whether the document in the real-time image data matches any one of the preset multiple document types. If a match is found, the mobile phone 100 can determine the document scanning mode corresponding to the matched document type, and switch the shooting mode of the camera application from the conference mode to the determined document scanning mode, that is, execute step 804.

[0238] In some embodiments, when it is determined that the real-time image data includes a document image, the shooting mode of the camera application can be switched from the conference mode to the general document scanning mode, that is, there is no need to further analyze the document to determine the corresponding document type, and the general document scanning mode can be directly used to shoot or scan the image.

[0239] In some embodiments, after the mobile phone 100 determines that it is no longer in conference mode, the mobile phone 100 may display a prompt window on the display screen to prompt the user to exit the conference mode, and after receiving the user's operation to confirm exiting the conference mode, the mobile phone 100 executes step 803.

[0240] For example, Figure 3e As shown, the camera application running on the mobile phone 100 is currently in conference mode. After the mobile phone 100 obtains real-time image data, it determines that the real-time image data includes a face preview image 341, then the mobile phone 100 is no longer in conference mode. The mobile phone 100 can display a prompt window on the interface 340, and the prompt content can be, for example, "Exit conference mode?", refer to Figure 3g The user can click the "Yes" button 361 to exit the conference mode. Figure 3gOperation ④ shown.

[0241] In other embodiments, before the mobile phone 100 executes the above step 803, it may also be possible to, for example, Figure 3e The prompt window is displayed on the interface 340, and the prompt content may be, for example, "Exit conference mode?". Figure 3h At this point, the user can click anywhere in the pop-up window 370 to exit the conference mode. Figure 3h Operation ⑤ shown.

[0242] 804: The shooting mode of the running camera application is switched to the corresponding document scanning mode.

[0243] It can be understood that the corresponding document scanning mode is a document scanning mode that is determined to match the document type according to the document type in the real-time image data.

[0244] 805: The shooting mode of the running camera application is switched to the general photo shooting mode.

[0245] It can be understood that in some embodiments, after the mobile phone 100 executes the above step 804, it determines that the mobile phone 100 is not in other document scanning scenarios. At this time, the mobile phone 100 can further judge the current shooting scene based on real-time image data, such as whether the mobile phone 100 is in a portrait shooting scene, a night scene shooting scene, etc., and then the mobile phone 100 can switch the conference mode to the corresponding shooting mode according to the determined shooting scene, rather than directly switching to the general photo mode.

[0246] It can be understood that the shooting mode switching method provided in this embodiment 3 can intelligently switch the camera of the mobile phone 100 to exit the conference mode when it senses that the mobile phone 100 is no longer in the conference shooting scene based on real-time image data. The user does not need to set the shooting scene by himself, the user operation is simple, and the user experience is better.

[0247] In some embodiments, after executing the above step 801, the mobile phone 100 can directly determine whether the mobile phone 100 is in a document scanning scene, and when it is determined that the mobile phone 100 is not in a document scanning scene, the shooting mode of the mobile phone 100 is switched from the conference mode to the general photo mode, that is, the above step 805 can be executed.

[0248] It is understood that the conference shooting scenario is a type of document scanning scenario. If the mobile phone 100 determines that the user still needs to scan a document, it can continue to maintain the conference mode, regardless of whether the current document type is a document for conference presentation. If the mobile phone 100 determines that the user does not need to scan a document, it can intelligently exit the conference mode.

[0249] The following will be combined Figure 1The scene graph shown, Figure 4 The system structure diagram shown in FIG. 1 further describes in detail another method for switching shooting modes of the present application. Example

[0250] The following describes in detail the specific process of the method for switching the shooting mode of the embodiment of the present application implemented by the mobile phone 100 in conjunction with the flow chart and related interface diagrams. It can be understood that this embodiment is the process of the camera entering and exiting the conference mode.

[0251] Figure 9 According to an embodiment of the present application, a flow chart of a method for switching shooting modes is shown. In the embodiment of the present application, Figure 9 The execution subject of each step shown is the mobile phone 100. In order to avoid repeated description, the execution subject of each step will not be described again when describing the execution content of each step below.

[0252] like Figure 9 As shown, the process includes the following steps:

[0253] 901: In response to the user's operation, start the camera to capture an image. Figure 5 The same as step 501 in , which will not be described here.

[0254] 902: Sense that the phone is in a document scanning scene and enter the general document scanning mode. It is understood that before the phone 100 senses the conference mode, it can first determine whether the phone 100 is in a document scanning scene, and when it is determined that the phone 100 is in a document scanning scene, it can display the following information: Figure 6a The pop-up window 610 shown prompts the user to enter the general scanning mode. Figure 6a The mobile phone 100 detects the user's operation of determining to enter the general document scanning mode, for example Figure 6a When performing operation ⑥ in the above procedure, the mobile phone 100 can enter the general document scanning mode. Figure 6b shown.

[0255] 903: Determine whether the user is scanning a document for conference scene presentation. Figure 5 Step 502 and step 503 are the same and are not described here in detail.

[0256] It can be understood that if the mobile phone 100 senses that the user is scanning a document presented in a conference scene, step 905 is executed, otherwise step 904 is executed.

[0257] 904: Do not prompt the user to enter the conference mode. It can be understood that not prompting the user to enter the conference mode means that the mobile phone 100 continues to maintain the current shooting mode.

[0258] 905: Prompt the user to enter the conference mode. It is understood that prompting the user to enter the conference mode can be to display a prompt window on the display screen of the mobile phone 100. The prompt window can be, for example, Figure 3c or Figure 3d shown.

[0259] 906: In response to the user's operation of determining to enter the conference mode, enter the conference mode.

[0260] It can be understood that the user's operation of determining to enter the conference mode can be, for example, Figure 3c Operation ② or Figure 3d After the mobile phone 100 enters the conference mode, the Figure 3b The interface shown.

[0261] In some embodiments, if the result of the mobile phone 100's judgment after executing step 903 is yes, it can directly enter the conference mode, that is, it can enter the conference mode without prompting the user or obtaining the user's confirmation to enter the conference mode. Furthermore, in some embodiments, after the mobile phone 100 enters the conference mode, a pop-up window can be displayed on the display screen to remind the user that the current shooting mode is the conference mode.

[0262] 907: Determine whether there is no document for conference scene demonstration. Figure 8 The same as step 802 in , there is currently no document demonstrating the conference scene, that is, the mobile phone 100 is no longer in the conference shooting scene, which will not be described in detail here.

[0263] If the mobile phone 100 determines that there is no document currently demonstrating a conference scene, it indicates that the mobile phone 100 can exit the conference mode and further determine the current shooting scene to determine which shooting mode the mobile phone 100 switches to. If the mobile phone 100 determines that there is a document currently demonstrating a conference scene, it indicates that the mobile phone 100 is still in the scene of scanning the document for the conference scene demonstration and needs to continue to use the conference mode to scan the document, that is, execute step 908.

[0264] 908: Conference mode maintained. It can be understood that step 908 means that the mobile phone 100 continues to use the current conference mode for shooting.

[0265] 909: Determine whether other documents are detected. Figure 8 The same as step 803 in , detecting other documents means determining that the scanning scene is other than the conference shooting scene, which will not be described in detail here.

[0266] 910: Prompt the user to exit to the general document scanning mode. Figure 8 The process is the same as step 804 in , and will not be described in detail here.

[0267] 911: Prompt the user to exit to the general shooting mode. Figure 8 The process is the same as step 805 in , and will not be described in detail here.

[0268] The shooting mode switching method in this embodiment can sense the user's shooting or scanning scene, and intelligently switch the camera's shooting mode to enter and exit the conference mode. The user does not need to identify and switch the conference mode by himself. The user operation is simple and the user experience is better.

[0269] Figure 10 According to an embodiment of the present application, a software structure block diagram of an electronic device 100 is shown.

[0270] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0271] Figure 10 According to an embodiment of the present application, a software structure block diagram of an electronic device 100 is shown.

[0272] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers: from top to bottom: the application layer, the application framework layer, the algorithm engine layer, the Android runtime and system libraries layer, and the kernel layer.

[0273] The application layer can include a series of application packages.

[0274] like Figure 10 As shown, the application package may include applications such as memo, gallery, camera, WLAN, video, short message, short message, etc. In the embodiment of the present application, the display interface of the camera application can display rendered real-time image data.

[0275] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0276] like Figure 9 As shown, the application framework layer may include a window manager, a task manager, an activity manager, a resource manager, a notification manager, a view system, and the like.

[0277] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether a status bar is present, lock the screen, capture screenshots, and more. In an embodiment of the present application, the window manager can obtain a touch event indicating a user click to enter or exit conference mode, match the corresponding display task, and display the corresponding interface, such as the conference mode user interface described in step 504 or the document scanning mode interface described in step 804. For details, please refer to the relevant descriptions of steps 504 and 804 above and will not be repeated here.

[0278] The task manager is used to cooperate with the window manager to call the task content corresponding to the user's sliding operation, such as the display task that needs to be controlled and executed by the window manager. The task manager calls the content of the corresponding display task and sends it to the window manager for execution, thereby realizing the process of the electronic device 100 displaying the corresponding interface.

[0279] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0280] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0281] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0282] The algorithm engine layer may include an image and text understanding algorithm engine, a document scanning algorithm engine, etc. In an embodiment of the present application, the document scanning algorithm engine may be used to process images captured in the conference mode to obtain document scan images that meet user expectations.

[0283] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0284] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0285] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0286] The system library can include multiple functional modules, such as the surface manager, media libraries, and graphics processing libraries (such as OpenGL ES).

[0287] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0288] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0289] The graphics processing library is used to implement graphics drawing, image rendering, compositing, and layer processing.

[0290] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, touch driver, and sensor driver.

[0291] References in the specification to "one embodiment" or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one exemplary implementation or technique disclosed herein. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment.

[0292] The present disclosure also relates to a device for performing the operations described herein. The device may be specially constructed for the desired purpose or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored on a computer-readable medium, such as, but not limited to, any type of disk, including a floppy disk, an optical disk, a CD-ROM, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM, a magnetic or optical card, an application-specific integrated circuit (ASIC), or any type of medium suitable for storing electronic instructions, and each may be coupled to a computer system bus. In addition, the computer referred to in the specification may comprise a single processor or may be an architecture employing multiple processors for increased computing power.

[0293] Additionally, the language used in this specification has been primarily selected for readability and instructional purposes and may not have been selected to delineate or limit the disclosed subject matter. Accordingly, this disclosure is intended to illustrate, not limit, the areas of the concepts discussed herein.

Claims

1. A method for switching shooting modes, applied to an electronic device, characterized in that: include: The electronic device displays a first shooting interface of a first application, the first shooting interface includes a first preview image, and the electronic device is in a first shooting mode when displaying the first shooting interface; Based on the first preview image, determining that the electronic device is in a first shooting scene, wherein the first shooting scene includes a scene in which a user scans a document for a presentation in a conference scene; The electronic device displays a second shooting interface, the second shooting interface includes a second preview image, and the electronic device is in a second shooting mode corresponding to the first shooting scene when displaying the second shooting interface, and the second preview image includes a document image of a document presented in the conference scene; The method further comprises: The electronic device acquires device status data and user schedule data; The determining, based on the first preview image, that the electronic device is in a first shooting scene includes: The electronic device determines that the scene corresponding to the first preview image is the first shooting scene; The electronic device determines that the device status data satisfies a second preset condition, and / or determines that the user schedule data satisfies a third preset condition; Determine that the electronic device is in the first shooting scene.

2. The method for switching shooting modes according to claim 1, wherein: The conference scenario includes at least one of the following: Office meeting scenes, open discussion scenes, report scenes, classroom scenes; The document demonstrating the conference scenario includes at least one of the following: The document projected and displayed by the projector in the conference scene, the document displayed on the electronic screen in the conference scene, and the document displayed on the handwriting blackboard.

3. The method for switching shooting modes according to claim 1, wherein: The device status data includes at least one of the following: location data of the electronic device; Tilt data of the electronic device; Real-time audio data of the electronic device; Determining that the device status data satisfies a second preset condition includes at least one of the following: Determining that the location data matches a preset office area; determining that the inclination data matches a target inclination or a target inclination range; It is determined that the scene corresponding to the real-time audio data is a conference shooting scene.

4. The method for switching shooting modes according to claim 1, wherein: The determining that the user schedule data satisfies a third preset condition includes: Based on the meeting time period in the user schedule data, it is determined whether the current time matches the meeting time period.

5. The method for switching shooting modes according to claim 1, wherein: Also includes: The electronic device displays a first prompt pop-up window on the first shooting interface, where the first prompt pop-up window includes a first control for entering the second shooting mode; In response to a first operation of the user on the first control, the electronic device displays the second shooting interface.

6. The method for switching shooting modes according to claim 1, wherein: Also includes: The electronic device displays a third shooting interface of the first application, the third shooting interface includes a third preview image, and the electronic device is in the second shooting mode when displaying the third shooting interface; Based on the third preview image, determining that the electronic device is in a second shooting scene, where the second shooting scene includes a shooting scene of a target shooting object outside a document presented by a user in a conference scene; The electronic device displays a fourth shooting interface, the fourth shooting interface includes a fourth preview image, and the electronic device is in a third shooting mode corresponding to the second shooting scene when displaying the fourth shooting interface, and the fourth preview image includes a first shot image of the first shooting object.

7. The method for switching shooting modes according to claim 6, wherein: The determining, based on the third preview image, that the electronic device is in a second shooting scene includes: When the electronic device determines, using a neural network model, that the scene corresponding to the first preview image is the second shooting scene, it is determined that the electronic device is in the second shooting scene, wherein the input of the neural network model is image data, and the output of the neural network model is the shooting scene corresponding to the image data.

8. The method for switching shooting modes according to claim 6, wherein: The determining, based on the third preview image, that the electronic device is in a second shooting scene includes: If the third preview image meets a fourth preset condition, it is determined that the electronic device is in the second shooting scene.

9. The method for switching shooting modes according to claim 8, wherein: The third preview image satisfies the fourth preset condition, which includes at least one of the following: The third preview image does not include the document; The third preview image does not include the document of the conference scene demonstration; The third preview image includes the first captured image and a second captured image of the document presented in the conference scene, and an area ratio of the first captured image to the second captured image satisfies a preset ratio threshold; The third preview image includes the first captured image and the second captured image, and determines that a first position of the first captured object and a second position of the document of the conference scene presentation satisfy a preset positional relationship; The third preview image includes the first photographed image and the second photographed image, and the number of the first photographed objects meets a preset number threshold.

10. The method for switching shooting modes according to claim 9, wherein: The determining that the first position of the first photographed object and the second position of the document of the conference scene presentation satisfy a preset position relationship includes: The electronic device acquires first depth of field data of the first photographed object and second depth of field data of the document presented in the conference scene; The electronic device determines that the first depth of field data is smaller than the second depth of field data.

11. The method for switching shooting modes according to claim 8, wherein: The step of determining that the electronic device is in the second shooting scene when the third preview image satisfies a fourth preset condition includes: Determining that the third preview image meets the fourth preset condition; Determine that the shooting scene corresponding to the third preview image is the second shooting scene.

12. The method for switching shooting modes according to claim 6, wherein: The first shooting mode or the third shooting mode includes at least one of the following: General document scanning mode, general shooting mode, video recording mode, portrait mode.

13. The method for switching shooting modes according to claim 6, wherein: Also includes: The electronic device displays a second prompt pop-up window on the third shooting interface, where the second prompt pop-up window includes a second control for exiting the second shooting mode; In response to the user's second operation on the second control, the electronic device displays the fourth shooting interface.

14. An electronic device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device executes the shooting mode switching method described in any one of claims 1 to 13.

15. A computer-readable storage medium, characterized in that The storage medium stores instructions that, when executed on a computer, cause the computer to execute the method for switching the shooting mode according to any one of claims 1 to 13.

16. A computer program product, characterized in that The computer program product includes instructions for implementing the method for switching the shooting mode according to any one of claims 1 to 13.

Images