Information providing method and device of electronic equipment

Abstract

The invention provides an information providing method and device of electronic equipment. The information providing method of the electronic equipment comprises the following steps: based on a preset operation of a user, starting an intelligent tracking function of the electronic equipment and establishing connection between the electronic equipment and pan-tilt equipment; under the condition that the intelligent tracking function is started and connection is established between the electronic equipment and the pan-tilt equipment, in response to the fact that a camera of the electronic equipment is called by an application program of the electronic equipment, determining the category and the number of candidate tracking objects in a preview interface; determining a target tracking object from the candidate tracking objects through a preset mode based on the category and the number of the candidate tracking objects, the preset mode comprising an intelligent selection mode and / or a manual selection mode; and enabling the holder equipment to track the target tracking object.

Description

Technical Field

[0001] The present disclosure generally relates to the field of electronic technology, and more specifically, to a method and device for providing information of an electronic device. Background Art

[0002] With the rapid popularization of smart terminals and the continuous improvement of camera configurations on terminals, more and more self-media and video creators are recording and creating videos directly through smart terminals. The emergence of gimbal devices undoubtedly provides users with a better shooting experience. Using gimbal devices to assist smart terminal shooting can provide users with more stable and smooth shooting effects, even when the smart terminal moves quickly. However, gimbal devices still have some shortcomings in tracking shooting objects. Summary of the invention

[0003] An exemplary embodiment of the present disclosure is to provide an information providing method and device for an electronic device, which supports intelligent selection of a subject to be tracked in the current shooting scene, supports manual selection of a subject to be tracked by a user, and enables a gimbal device to track the selected subject.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an information providing method of an electronic device, comprising: based on a preset operation of a user, turning on an intelligent tracking function of the electronic device and establishing a connection between the electronic device and a gimbal device; when the intelligent tracking function is turned on and a connection is established between the electronic device and the gimbal device, in response to a camera of the electronic device being called by an application of the electronic device, determining categories and quantities of candidate tracking objects in a preview interface; based on the categories and quantities of the candidate tracking objects, determining a target tracking object from the candidate tracking objects in a preset manner, wherein the preset manner includes: an intelligent selection manner, and / or a manual selection manner; and enabling the gimbal device to track the target tracking object.

[0005] Optionally, the step of determining the target tracking object from the candidate tracking objects by an intelligent selection method based on the category and number of the candidate tracking objects includes: determining the target tracking object from the candidate tracking objects by the intelligent selection method based on the number of candidate tracking objects belonging to a specified category among the candidate tracking objects.

[0006] Optionally, the step of determining the target tracking object from the candidate tracking objects by the intelligent selection method based on the number of candidate tracking objects belonging to the specified category among the candidate tracking objects includes: in response to the number of candidate tracking objects belonging to the specified category being single, determining the candidate tracking object belonging to the specified category as the target tracking object; in response to the number of candidate tracking objects belonging to the specified category being multiple, automatically determining the target tracking object from the candidate tracking objects belonging to the specified category based on identification information of the candidate tracking objects belonging to the specified category; wherein the identification information includes: credibility of belonging to the specified category, location information and area information indicating the size of the occupied area.

[0007] Optionally, the step of determining the target tracking object from the candidate tracking objects belonging to the specified category based on the identification information of the candidate tracking objects belonging to the specified category includes: screening out the candidate tracking objects whose credibility exceeds a preset threshold from the candidate tracking objects belonging to the specified category; in response to the number of screened candidate tracking objects being multiple, taking the candidate tracking object with the largest area among the screened candidate tracking objects as the target tracking object; in response to the number of screened candidate tracking objects being single, taking the screened candidate tracking object as the target tracking object; in response to the number of screened candidate tracking objects being zero, taking the candidate tracking object that is closest to the center of the preview interface among the candidate tracking objects belonging to the specified category as the target tracking object.

[0008] Optionally, the step of determining the target tracking object from the candidate tracking objects by manual selection based on the categories and number of the candidate tracking objects includes: in response to the number of the candidate tracking objects being multiple, displaying tracking object selection items corresponding to each candidate tracking object on the preview interface; and determining the target tracking object in response to the user's selection operation on the tracking object selection item.

[0009] Optionally, the step of determining the category and number of candidate tracking objects in the preview interface includes: obtaining, from a camera hardware abstraction layer, a recognition result of a preview image shot by the camera, to determine the category and number of candidate tracking objects in the preview interface.

[0010] Optionally, the step of determining the category and number of candidate tracking objects in the preview interface includes: identifying a preview image captured by the camera obtained from the camera hardware abstraction layer to determine the category and number of candidate tracking objects in the preview interface.

[0011] Optionally, in response to the camera of the electronic device being called by the application of the electronic device, the step of determining the category and number of candidate tracking objects in the preview interface includes: in response to the camera of the electronic device being called by the application of the electronic device, determining in real time the category and number of current candidate tracking objects in the preview interface; wherein, based on the category and number of the candidate tracking objects, the step of determining the target tracking object from the candidate tracking objects in a preset manner includes: based on the category and number of the current candidate tracking objects, determining the latest target tracking object from the current candidate tracking objects in real time by an intelligent selection method; wherein, the step of enabling the gimbal device to track the target tracking object includes: based on the real-time position information of the latest target tracking object, enabling the gimbal device to track the latest target tracking object in real time.

[0012] Optionally, the step of enabling the gimbal device to track the target tracking object includes: updating the tracking information of the target tracking object in real time based on the real-time tracking information of each candidate tracking object in the preview interface; enabling the gimbal device to track the target tracking object in real time based on the updated position information of the target tracking object; wherein the tracking information includes: position information and feature information.

[0013] Optionally, the step of updating the tracking information of the target tracking object in real time based on the real-time tracking information of each candidate tracking object in the preview interface includes: based on the real-time tracking information of each candidate tracking object in the preview interface, determining the candidate tracking object whose real-time feature information is most similar to the target tracking object as a similar object of the target tracking object; and updating the tracking information of the target tracking object to the tracking information of the similar object.

[0014] According to a second aspect of an embodiment of the present disclosure, an information providing device of an electronic device is provided, comprising: an enabling unit, configured to enable an intelligent tracking function of the electronic device and establish a connection between the electronic device and a gimbal device based on a preset operation of a user; a determining unit, configured to determine the category and number of candidate tracking objects in a preview interface in response to a camera of the electronic device being called by an application of the electronic device when the intelligent tracking function is enabled and a connection is established between the electronic device and the gimbal device; a selecting unit, configured to determine a target tracking object from the candidate tracking objects in a preset manner based on the category and number of the candidate tracking objects, wherein the preset manner includes: an intelligent selection manner and / or a manual selection manner; and a tracking unit, configured to enable the gimbal device to track the target tracking object.

[0015] According to a third aspect of an embodiment of the present disclosure, a computer-readable storage medium storing a computer program is provided, and when the computer program is executed by a processor, the information providing method of the electronic device as described above is implemented.

[0016] According to a fourth aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory storing a computer program, wherein when the computer program is executed by the processor, the information providing method of the electronic device as described above is implemented.

[0017] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, comprising computer executable instructions, which, when executed by a processor, implement the information providing method of the electronic device as described above.

[0018] According to the information providing method and device of the electronic device of the exemplary embodiment of the present disclosure, it supports the intelligent selection of the shooting object that needs to be tracked in the current shooting scene, and also supports the user to manually select the shooting object that he wants to track, and enables the gimbal device to track the selected shooting object.

[0019] Additional aspects and / or advantages of the present general inventive concept will be set forth in part in the following description and in part will be apparent from the description or may be learned through practice of the present general inventive concept. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other objects and features of the exemplary embodiments of the present disclosure will become more apparent through the following description in conjunction with the accompanying drawings which exemplarily illustrate the embodiments, in which:

[0021] Figure 1 A flowchart showing an information providing method of an electronic device according to an exemplary embodiment of the present disclosure;

[0022] Figure 2 An example of turning on the intelligent tracking function and establishing a connection between the electronic device and the gimbal device according to an exemplary embodiment of the present disclosure is shown;

[0023] Figure 3 An example of determining the category and number of candidate tracking objects according to an exemplary embodiment of the present disclosure is shown;

[0024] Figure 4 Another example of determining the category and number of candidate tracking objects according to an exemplary embodiment of the present disclosure is shown;

[0025] Figure 5 A flowchart showing a method for determining a target tracking object from candidate tracking objects by intelligent selection according to an exemplary embodiment of the present disclosure;

[0026] Figure 6 A flowchart showing a method for determining a target tracking object from candidate tracking objects by manual selection according to an exemplary embodiment of the present disclosure;

[0027] Figure 7 An example of determining a target tracking object from candidate tracking objects by manual selection according to an exemplary embodiment of the present disclosure is shown;

[0028] Figure 8 Another example of determining a target tracking object from candidate tracking objects by manual selection according to an exemplary embodiment of the present disclosure is shown;

[0029] Fig. 9 A flowchart showing a method for enabling a pan-tilt device to track a target tracking object according to an exemplary embodiment of the present disclosure;

[0030] Fig.10 A flowchart showing a method for enabling a PTZ device to track a target tracking object according to another exemplary embodiment of the present disclosure is shown;

[0031] Fig.11 An example of a preview interface according to an exemplary embodiment of the present disclosure is shown;

[0032] Fig.12 shows an example of object position information according to an exemplary embodiment of the present disclosure;

[0033] Fig.13 A structural block diagram showing an information providing apparatus of an electronic device according to an exemplary embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0034] Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like parts throughout. The embodiments will be described below with reference to the drawings in order to explain the present disclosure.

[0035] Figure 1 A flowchart illustrating an information providing method of an electronic device according to an exemplary embodiment of the present disclosure.

[0036] The information providing method may be implemented by a computer program. As an example, the information providing method may be executed by an application program (eg, a smart tracking APP) installed in an electronic device, or by a function program implemented in an operating system of the electronic device.

[0037] As an example, the electronic device may be a mobile communication terminal (eg, a smart phone), a smart wearable device (eg, a smart watch), a game console, a digital multimedia player, or other electronic device.

[0038] Reference Figure 1 In step S100, based on the user's preset operation, the intelligent tracking function of the electronic device is turned on and a connection is established between the electronic device and the gimbal device.

[0039] As an exemplary embodiment, step S100 may include: in response to a user's operation to turn on the smart tracking function, turning on the smart tracking function of the electronic device; then, in response to a user's operation to establish a connection with the gimbal device, establishing a connection between the electronic device and the gimbal device. Figure 2 As shown, the user can turn on the intelligent tracking function through the "on / off" control of the gimbal target tracking function (i.e., the intelligent tracking function), and then the user can select the desired gimbal device to connect, for example, the connection method may include but is not limited to BT connection.

[0040] In addition, as another exemplary embodiment, step S100 may include: in response to the user's operation for establishing a connection with the gimbal device, establishing a connection between the electronic device and the gimbal device; then, in response to the user's operation to turn on the smart tracking function, turning on the smart tracking function of the electronic device.

[0041] In step S200, when the intelligent tracking function is turned on and a connection is established between the electronic device and the gimbal device, in response to the camera of the electronic device being called by an application of the electronic device, the category and number of candidate tracking objects in the preview interface are determined.

[0042] Specifically, when the intelligent tracking function is turned on and a connection is established between the electronic device and the gimbal device, the status of the camera is monitored; in response to the camera being called by an application of the electronic device, the category and number of candidate tracking objects in the preview interface are determined.

[0043] As an exemplary embodiment, the application that calls the camera may be a native application of the electronic device or a third-party application. As an example, the situation where the camera is called by the application may include but is not limited to at least one of the following items: the camera is called by a native camera application, the camera is called by a beauty application, the camera is called by a short video application, and the camera is called by a live broadcast application.

[0044] As an exemplary embodiment, the recognition result of the camera's shooting preview image can be obtained from the camera hardware abstraction layer Camera HAL to determine the category and number of candidate tracking objects in the preview interface.

[0045] As an example, Figure 3As shown, in response to the camera being called by an application of the electronic device, the smart tracking APP sends an object recognition request to the Camera HAL, so that the Camera HAL performs object recognition on the image frames captured by the camera (i.e., the preview images shot by the camera) and sends the recognition results to the smart tracking APP, so that the smart tracking APP determines the category and number of candidate tracking objects in the preview interface based on the recognition results.

[0046] As another exemplary embodiment, the camera shooting preview image obtained from the camera hardware abstraction layer may be recognized to determine the category and number of candidate tracking objects in the preview interface.

[0047] As an example, Figure 4 As shown, in response to the camera being called by an application of the electronic device, the smart tracking APP sends a request to obtain a preview image to the Camera HAL, so that the Camera HAL sends the image frame captured by the camera (i.e., the preview image of the camera) to the smart tracking APP, and the smart tracking APP performs object recognition on the preview image of the camera to obtain a recognition result, and determines the category and number of candidate tracking objects in the preview interface based on the recognition result.

[0048] As an example, the recognition result of the captured preview image may include, but is not limited to: the category and location information of the object (i.e., the candidate tracking object) in the captured preview image. As an example, the recognition result may further include: the credibility and feature information of the object belonging to the category to which it belongs. The location information of the object is the information used to describe the position of the object in the preview interface, and the feature information of the object is the information by which the object can be identified. For example, the credibility of belonging to a certain category can be a value between 0 and 100, and the larger the value, the more likely it is to belong to the category. For example, the location information can be saved in the form of Rect[(left, top, right, bottom)], where left, top, right, bottom are screen coordinates, and the coordinate origin is the upper left corner of the screen, such as Fig.12 For example, the characteristic information SubjectValue can be saved in the form of a byte array.

[0049] Compared with starting a Service in the background to record the screen to perform object recognition on the preview interface, according to the exemplary embodiments of the present disclosure, the processing complexity and energy consumption of the electronic device can be reduced, and it is more applicable and can be applied to the scenario of limiting the screen recording permission of the background service.

[0050] In step S300 , based on the categories and number of candidate tracking objects, a target tracking object is determined from the candidate tracking objects in a preset manner.

[0051] The preset method includes: an intelligent selection method and / or a manual selection method.

[0052] It should be understood that the number of target tracking objects can be one or more.

[0053] As an exemplary embodiment, the user can preselect the desired object selection method. As an example, the intelligent selection method or the manual selection method can be used as the default selection method, and the user can directly use the default selection method or manually select a non-default selection method as needed.

[0054] In addition, as an exemplary embodiment, the intelligent selection method may be used preferentially. If the target tracking object cannot be determined by the intelligent selection method, the manual selection method may be automatically switched to use.

[0055] As an exemplary embodiment, based on the category and number of candidate tracking objects, the step of determining the target tracking object from the candidate tracking objects by intelligent selection includes: based on the number of candidate tracking objects belonging to a specified category among the candidate tracking objects, determining the target tracking object from the candidate tracking objects by intelligent selection. As an example, the specified category may include but is not limited to a face, and it should be understood that the specified category is not limited thereto and can be set to other categories according to user needs. Figure 5 This exemplary embodiment is described in detail and will not be expanded here.

[0056] As an exemplary embodiment, based on the category and number of candidate tracking objects, the step of manually selecting a target tracking object from candidate tracking objects includes: based on the category and number of candidate tracking objects, displaying corresponding controls on the preview interface for the user to select the target tracking object from the candidate tracking objects. Figure 6 This exemplary embodiment is described in detail and will not be expanded here.

[0057] In step S400, the pan / tilt device is enabled to track the target tracking object.

[0058] Specifically, based on the position information of the target tracking object, the gimbal device tracks the target tracking object.

[0059] As an exemplary embodiment, the present disclosure proposes two tracking modes: a mode of changing a tracking object in real time and a mode of locking a tracking object.

[0060] The mode of changing the tracking object in real time means that the target tracking object does not always remain unchanged. The latest target tracking object will be determined in real time, and based on the real-time position information of the latest target tracking object, the PTZ device will track the latest target tracking object in real time. Fig. 9 This exemplary embodiment is described in detail and will not be expanded here.

[0061] The mode of locking the tracking object means that the target tracking object is always the same object, and the same object is locked, the tracking information of the object is updated in real time, and based on the updated position information of the object, the PTZ device tracks the object in real time. Fig.10 This exemplary embodiment is described in detail and will not be expanded here.

[0062] As an example, the smart selection method may be applicable to a mode of locking a tracked object and a mode of changing a tracked object in real time. As an example, the manual selection method may be applicable to a mode of locking a tracked object.

[0063] As an exemplary embodiment, the real-time position information of the target tracking object can be provided to the gimbal device APP in the electronic device, so that the application can control the gimbal device to track the target tracking object in real time based on the received real-time position information of the target tracking object. As an example, the gimbal device APP can control the posture of the gimbal device in real time through an API (e.g., Gimbal Control API) according to the received real-time position information of the target tracking object to achieve real-time tracking of the target tracking object.

[0064] As another exemplary embodiment, the real-time position information of the target tracking object may be provided to the gimbal device, so that the gimbal device can track the target tracking object in real time based on the received real-time position information of the target tracking object. That is, the control program in the gimbal device can control the posture of the gimbal device based on the received real-time position information of the target tracking object to achieve real-time tracking of the target tracking object. As an example, the real-time position information of the target tracking object may be provided to the gimbal device through an API (e.g., GimbalControl API).

[0065] As an example, the above API can transmit information with the gimbal device through communication methods such as BT.

[0066] As an example, the PTZ device APP in the electronic device (or the control program in the PTZ device) can realize the real-time tracking of the target tracking object by the PTZ device through machine vision technology and steering control. For example, after the PTZ device APP in the electronic device (or the control program in the PTZ device) obtains the real-time position information of the target tracking object, it can adjust the direction of the PTZ device by controlling the steering gear, so that the PTZ device can track the movement of the target tracking object in real time.

[0067] Figure 5 A flowchart is shown of a method for determining a target tracking object from candidate tracking objects by intelligent selection according to an exemplary embodiment of the present disclosure.

[0068] Reference Figure 5 In step S501, in response to the number of candidate tracking objects belonging to the specified category being single, the candidate tracking object belonging to the specified category is determined as a target tracking object.

[0069] In step S502 , in response to the number of candidate tracking objects belonging to the designated category being plural, a target tracking object is automatically determined from the candidate tracking objects belonging to the designated category according to identification information of the candidate tracking objects belonging to the designated category.

[0070] The identification information includes: the credibility of belonging to a specified category, the location information and the area information indicating the size of the occupied area. As an example, the area information of an object can be calculated based on the location information of the object.

[0071] As an exemplary embodiment, step S502 may include: screening out candidate tracking objects whose credibility exceeds a preset threshold from candidate tracking objects belonging to a specified category; in response to the number of screened out candidate tracking objects being multiple, taking the candidate tracking object with the largest area among the screened out candidate tracking objects as a target tracking object; in response to the number of screened out candidate tracking objects being single, taking the screened out candidate tracking object as a target tracking object; in response to the number of screened out candidate tracking objects being zero, taking the candidate tracking object that is closest to the center of the preview interface among the candidate tracking objects belonging to the specified category as the target tracking object.

[0072] In addition, as an exemplary embodiment, in response to the number of candidate tracking objects belonging to the specified category being zero, it is determined that the target tracking object cannot be determined through the intelligent selection method, and the target tracking object can be determined through manual selection later.

[0073] As an example, if the specified category is face, the Smart Tracking APP or Camera HAL may only perform face recognition without performing other category recognition. Then, the Smart Tracking APP determines the target tracking object based on the face recognition results. For example, if the credibility of multiple faces is greater than a preset threshold (for example, 80), the face with the largest face area (calculated based on the face coordinates) is selected as the target tracking object; if only one face has a credibility greater than 80, the face with a credibility greater than 80 is selected as the target tracking object; if the credibility of all faces is less than 80, the face closer to the center of the picture is selected as the target tracking object.

[0074] Figure 6 A flowchart is shown of a method for determining a target tracking object from candidate tracking objects by manual selection according to an exemplary embodiment of the present disclosure.

[0075] Reference Figure 6In step S601, in response to the number of candidate tracking objects being multiple, tracking object selection items corresponding to each candidate tracking object are superimposed and displayed on the preview interface.

[0076] In step S602 , in response to the user's selection operation on the tracking object selection item, a target tracking object is determined.

[0077] As an exemplary embodiment, a list including identification information of each candidate tracking object (i.e., tracking object selection items) may be superimposed on the preview interface, and the target tracking object may be determined in response to a selection operation on the identification information in the list. As an example, the identification information of the candidate tracking object may reflect the category of the candidate tracking object, for example, Figure 7 shown.

[0078] As another exemplary embodiment, a tracking frame (i.e., a tracking object selection item) corresponding to each candidate tracking object may be superimposed on the preview interface, and in response to a selection operation on the displayed tracking frame, a target tracking object is determined, for example, Figure 8 As shown. As an example, based on the real-time position information of each candidate tracking object, a tracking frame corresponding to each candidate tracking object may be drawn, and then the tracking frame corresponding to each candidate tracking object may be superimposed and displayed on the preview interface, so that the corresponding tracking frame is displayed on each candidate tracking object in the preview interface. In addition, as an example, in response to a selection operation on the displayed tracking frame, only the tracking frame corresponding to the target tracking object may be superimposed and displayed on the preview interface without superimposing and displaying other tracking frames. As another example, in response to a selection operation on the displayed tracking frame, the tracking frame corresponding to the target tracking object may be highlighted on the preview interface, so that the tracking frame corresponding to the target tracking object is distinguished from the tracking frames corresponding to other objects.

[0079] As an exemplary embodiment, the user's selection operation on the tracking object selection item may include, but is not limited to, at least one of the following items: a single-click operation, a double-click operation, a long-press operation, and a voice operation.

[0080] In addition, as an example, in response to the number of candidate tracking objects being only one, a control requesting the user to confirm whether to use the single candidate tracking object as a target tracking object may be displayed on the preview interface.

[0081] It should be understood that the content of the preview interface will be updated over time and is not fixed. On the one hand, the objects appearing in the preview interface (i.e., candidate tracking objects) may change, for example, new objects may be added; on the other hand, the specific positions of the objects in the preview interface may change. Therefore, the tracking object selection items corresponding to each candidate tracking object superimposed on the preview interface will be updated over time.

[0082] According to an exemplary embodiment of the present disclosure, it is convenient for a user to select a specific object that he or she desires to track.

[0083] Fig. 9 A flowchart of a method for enabling a pan-tilt device to track a target tracking object according to an exemplary embodiment of the present disclosure is shown.

[0084] Reference Fig. 9 In step S901, in response to the camera of the electronic device being called by the application of the electronic device, the category and number of the current candidate tracking objects in the preview interface are determined in real time.

[0085] In step S902 , based on the categories and number of the current candidate tracking objects, the latest target tracking object is determined from the current candidate tracking objects in real time by intelligent selection.

[0086] In step S903, based on the latest real-time position information of the target tracking object, the PTZ device is enabled to track the latest target tracking object in real time.

[0087] As an example, combining Fig.11 , assuming that Face1 and Face2 always appear in the preview interface, according to the mode of changing the tracking object in real time, the latest target tracking object will be continuously determined from Face1 and Face2 in real time through the intelligent selection method. For example, the target tracking object initially determined by the intelligent selection method is Face1, then based on the real-time position information of the target tracking object Face1, the gimbal device tracks the target tracking object Face1 in real time; since Face1 and Face2 are constantly moving, if Face2 runs in front of the camera, then after screening and judging through the intelligent selection method, Face2 replaces Face1 and becomes the latest target tracking object. At this time, based on the real-time position information of the latest target tracking object Face2, the gimbal device tracks the latest target tracking object Face2 in real time.

[0088] Fig.10 A flowchart of a method for enabling a gimbal device to track a target tracking object according to another exemplary embodiment of the present disclosure is shown.

[0089] Reference Fig.10 In step S1001, based on the real-time tracking information of each candidate tracking object in the preview interface, the tracking information of the target tracking object is updated in real time.

[0090] The tracking information includes: position information and feature information. The real-time tracking information of each candidate tracking object can be obtained according to the recognition result of the real-time shooting preview image.

[0091] As an exemplary embodiment, step S1001 may include: based on the real-time tracking information of each candidate tracking object in the preview interface, determining the candidate tracking object whose real-time feature information is most similar to the target tracking object as a similar object of the target tracking object, and updating the tracking information of the target tracking object to the tracking information of the similar object.

[0092] Specifically, the feature information of the target tracking object may be updated to: the feature information of the similar object; and the position information of the target tracking object may be updated to: the position information of the similar object.

[0093] As an example, the current feature information of each candidate tracking object in the preview interface can be compared with the current feature information of the target tracking object, and the object that is most similar to the current feature information of the target tracking object can be selected as a similar object, and the feature information of the target tracking object can be updated to: the current feature information of the similar object, so that when the next comparison is performed, the updated feature information of the target tracking object will be used for comparison.

[0094] In step S1002, the PTZ device is enabled to track the target tracking object in real time based on the updated position information of the target tracking object.

[0095] As an example, combining Fig.11 , assuming that Face1 and Face2 always appear in the preview interface, according to the mode of locking the tracking object, after the target tracking object Face1 is selected, the feature information of each candidate tracking object determined based on the next shooting preview image will be compared with the feature information FaceValue1 of Face1 to find the most similar similar object, and the feature information of the similar object will be used to update the saved feature information FaceValue1 of the target tracking object, and the position information of the similar object will be used to update the saved position information Rect1[left1,top1,right1,bottom1] of the target tracking object. At this time, based on the updated position information of the target tracking object, the gimbal device will track the target tracking object in real time.

[0096] When using a gimbal device to assist an electronic device in object shooting (for example, video shooting), according to an exemplary embodiment of the present disclosure, on the one hand, it is convenient to select a specific target object that needs to be tracked, and on the other hand, the electronic device can interact with the gimbal device to enable the gimbal device to track the target object well, thereby enabling the camera of the electronic device to track and shoot the target object well, so that the shot content can well reflect the situation of the target object, thereby avoiding the situation where the target object to be tracked and shot cannot be completely shot or cannot be shot.

[0097] According to the exemplary embodiments of the present disclosure, it is possible to implement an APP (a native camera application or a third-party application) in an electronic device to select a specific target object to be tracked and photographed when using the camera to shoot, and to enable a gimbal device connected to the electronic device to track the target object during the camera shooting process, that is, to rotate as the target object moves, so that the captured content can well reflect the situation of the target object (for example, keeping the target object in the center of the preview interface in real time), thereby improving the user's shooting experience using the APP.

[0098] Fig.13 A structural block diagram showing an information providing apparatus of an electronic device according to an exemplary embodiment of the present disclosure is shown.

[0099] Reference Fig.13 According to an exemplary embodiment of the present disclosure, an information providing apparatus of an electronic device includes: an opening unit 100 , a determining unit 200 , a selecting unit 300 , and a tracking unit 400 .

[0100] Specifically, the activation unit 100 is configured to activate the intelligent tracking function of the electronic device and establish a connection between the electronic device and the gimbal device based on a preset operation of the user.

[0101] The determination unit 200 is configured to determine the category and number of candidate tracking objects in the preview interface in response to the camera of the electronic device being called by an application of the electronic device when the intelligent tracking function is turned on and a connection is established between the electronic device and the gimbal device.

[0102] The selection unit 300 is configured to determine a target tracking object from the candidate tracking objects in a preset manner based on the categories and quantities of the candidate tracking objects, wherein the preset manner includes: an intelligent selection manner and / or a manual selection manner.

[0103] The tracking unit 400 is configured to enable the pan-tilt device to track the target tracking object.

[0104] As an exemplary embodiment, the selecting unit 300 may be configured to determine the target tracking object from the candidate tracking objects by the intelligent selection method based on the number of candidate tracking objects belonging to a specified category among the candidate tracking objects.

[0105] As an exemplary embodiment, the selection unit 300 may be configured to: in response to the number of candidate tracking objects belonging to the specified category being single, determine the candidate tracking object belonging to the specified category as the target tracking object; in response to the number of candidate tracking objects belonging to the specified category being multiple, automatically determine the target tracking object from the candidate tracking objects belonging to the specified category based on identification information of the candidate tracking objects belonging to the specified category; wherein the identification information includes: credibility of belonging to the specified category, location information and area information indicating the size of the occupied area.

[0106] As an exemplary embodiment, the selection unit 300 may be configured to: screen out the candidate tracking objects whose credibility exceeds a preset threshold from the candidate tracking objects belonging to the specified category; in response to the number of screened candidate tracking objects being multiple, use the candidate tracking object with the largest area among the screened candidate tracking objects as the target tracking object; in response to the number of screened candidate tracking objects being single, use the screened candidate tracking object as the target tracking object; in response to the number of screened candidate tracking objects being zero, use the candidate tracking object that is closest to the center of the preview interface among the candidate tracking objects belonging to the specified category as the target tracking object.

[0107] As an exemplary embodiment, the selection unit 300 may be configured to: in response to a plurality of candidate tracking objects, display tracking object selection items corresponding to each candidate tracking object on the preview interface; and determine the target tracking object in response to a user's selection operation on the tracking object selection item.

[0108] As an exemplary embodiment, the determination unit 200 may be configured to obtain, from the camera hardware abstraction layer, a recognition result of the preview image shot by the camera, so as to determine the category and number of candidate tracking objects in the preview interface.

[0109] As an exemplary embodiment, the determination unit 200 may be configured to: identify the shooting preview image of the camera obtained from the camera hardware abstraction layer to determine the category and number of candidate tracking objects in the preview interface.

[0110] As an exemplary embodiment, the determination unit 200 may be configured to: in response to the camera of the electronic device being called by the application of the electronic device, determine in real time the category and number of current candidate tracking objects in the preview interface; wherein the selection unit 300 may be configured to: based on the category and number of the current candidate tracking objects, determine in real time the latest target tracking object from the current candidate tracking objects through an intelligent selection method; wherein the tracking unit 400 may be configured to: based on the real-time position information of the latest target tracking object, enable the gimbal device to track the latest target tracking object in real time.

[0111] As an exemplary embodiment, the tracking unit 400 may be configured to: update the tracking information of the target tracking object in real time based on the real-time tracking information of each candidate tracking object in the preview interface; enable the gimbal device to track the target tracking object in real time based on the updated position information of the target tracking object; wherein the tracking information includes: position information and feature information.

[0112] As an exemplary embodiment, the tracking unit 400 may be configured to: based on the real-time tracking information of each candidate tracking object in the preview interface, determine the candidate tracking object whose real-time feature information is most similar to the target tracking object as a similar object of the target tracking object; and update the tracking information of the target tracking object to the tracking information of the similar object.

[0113] It should be understood that the specific processing performed by the information providing device of the electronic device according to the exemplary embodiment of the present disclosure has been referred to. Figures 1 to 13 The details have been described in detail and will not be repeated here.

[0114] In addition, it should be understood that the various units in the information providing device of the electronic device according to the exemplary embodiment of the present disclosure can be implemented as hardware components and / or software components. Those skilled in the art can implement the various units, for example, using a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), according to the processing performed by the various units defined.

[0115] According to the computer-readable storage medium of the exemplary embodiment of the present disclosure, a computer program is stored that, when executed by a processor, causes the processor to perform the information providing method of the electronic device as described in the above exemplary embodiment. The computer-readable storage medium can be any data storage device that can store data read out by a computer system. Examples of computer-readable storage media may include: read-only memory, random access memory, read-only optical disk, magnetic tape, floppy disk, optical data storage device, and carrier wave (such as data transmission through the Internet via a wired or wireless transmission path).

[0116] An electronic device according to an exemplary embodiment of the present disclosure includes: a processor (not shown) and a memory (not shown), wherein the memory stores a computer program, and when the computer program is executed by the processor, the information providing method of the electronic device as described in the above exemplary embodiment is implemented.

[0117] According to an exemplary embodiment of the present disclosure, a computer program product may also be provided. Instructions in the computer program product may be executed by at least one processor to implement the information providing method of the electronic device as described in the above exemplary embodiment.

[0118] Although some exemplary embodiments of the present disclosure have been shown and described, it will be appreciated by those skilled in the art that modifications may be made to these embodiments without departing from the principles and spirit of the present disclosure, the scope of which is defined by the claims and their equivalents.

Claims

1. A method for providing information of an electronic device, characterized in that: include: Based on the preset operation of the user, the intelligent tracking function of the electronic device is turned on and a connection is established between the electronic device and the pan / tilt device; When the intelligent tracking function is turned on and a connection is established between the electronic device and the gimbal device, in response to the camera of the electronic device being called by an application of the electronic device, determining the category and number of candidate tracking objects in the preview interface; Based on the categories and quantity of the candidate tracking objects, determining the target tracking object from the candidate tracking objects in a preset manner, wherein the preset manner includes: an intelligent selection manner and / or a manual selection manner; The pan / tilt device is enabled to track the target tracking object.

2. The information providing method according to claim 1, characterized in that: The step of determining the target tracking object from the candidate tracking objects by intelligent selection based on the categories and quantity of the candidate tracking objects comprises: Based on the number of candidate tracking objects belonging to a specified category among the candidate tracking objects, the target tracking object is determined from the candidate tracking objects by the intelligent selection method.

3. The information providing method according to claim 2, characterized in that: The step of determining the target tracking object from the candidate tracking objects by the intelligent selection method based on the number of candidate tracking objects belonging to a specified category among the candidate tracking objects comprises: In response to the number of candidate tracking objects belonging to the specified category being single, determining the candidate tracking object belonging to the specified category as the target tracking object; In response to the number of candidate tracking objects belonging to the specified category being plural, automatically determining the target tracking object from the candidate tracking objects belonging to the specified category according to identification information of the candidate tracking objects belonging to the specified category; The identification information includes: the credibility of belonging to the specified category, location information and area information indicating the size of the occupied area.

4. The information providing method according to claim 3, characterized in that: The step of determining the target tracking object from the candidate tracking objects belonging to the specified category according to the identification information of the candidate tracking objects belonging to the specified category comprises: Filtering out candidate tracking objects whose credibility exceeds a preset threshold from the candidate tracking objects belonging to the specified category; In response to the number of the screened candidate tracking objects being multiple, taking the candidate tracking object with the largest area among the screened candidate tracking objects as the target tracking object; In response to the number of the screened candidate tracking objects being only one, taking the screened candidate tracking objects as the target tracking objects; In response to the number of the screened candidate tracking objects being zero, the candidate tracking object that is closest to the center of the preview interface among the candidate tracking objects belonging to the specified category is used as the target tracking object.

5. The information providing method according to claim 1, characterized in that: The step of determining the target tracking object from the candidate tracking objects by manual selection based on the categories and number of the candidate tracking objects comprises: In response to the number of the candidate tracking objects being multiple, displaying tracking object selection items corresponding to each candidate tracking object one by one on the preview interface; In response to a user's selection operation on a tracking object selection item, the target tracking object is determined.

6. The information providing method according to claim 1, characterized in that: The step of determining the categories and quantities of candidate tracking objects in the preview interface includes: Obtaining, from the camera hardware abstraction layer, a recognition result of the preview image shot by the camera, so as to determine the category and quantity of candidate tracking objects in the preview interface; or, The camera shooting preview image obtained from the camera hardware abstraction layer is recognized to determine the category and quantity of candidate tracking objects in the preview interface.

7. The information providing method according to any one of claims 1 to 4, characterized in that: The step of determining the category and number of candidate tracking objects in the preview interface in response to the camera of the electronic device being called by the application of the electronic device includes: determining the category and number of current candidate tracking objects in the preview interface in real time in response to the camera of the electronic device being called by the application of the electronic device; The step of determining the target tracking object from the candidate tracking objects in a preset manner based on the categories and number of the candidate tracking objects includes: determining the latest target tracking object from the current candidate tracking objects in real time in an intelligent selection manner based on the categories and number of the current candidate tracking objects; The step of causing the pan-tilt device to track the target tracking object includes: causing the pan-tilt device to track the latest target tracking object in real time based on the latest real-time position information of the target tracking object.

8. The information providing method according to any one of claims 1 to 5, characterized in that: The step of enabling the pan / tilt device to track the target tracking object comprises: Based on the real-time tracking information of each candidate tracking object in the preview interface, updating the tracking information of the target tracking object in real time; Enable the pan / tilt device to track the target tracking object in real time based on the updated position information of the target tracking object; The tracking information includes: location information and feature information.

9. The information providing method according to claim 8, characterized in that: The step of updating the tracking information of the target tracking object in real time based on the real-time tracking information of each candidate tracking object in the preview interface comprises: Based on the real-time tracking information of each candidate tracking object in the preview interface, a candidate tracking object whose real-time feature information is most similar to the target tracking object is determined as a similar object to the target tracking object; The tracking information of the target tracking object is updated to the tracking information of the similar object.

10. An information providing device for an electronic device, characterized in that: include: An activation unit, configured to activate the intelligent tracking function of the electronic device and establish a connection between the electronic device and the pan / tilt device based on a preset operation of the user; a determining unit configured to determine the category and number of candidate tracking objects in the preview interface in response to the camera of the electronic device being called by an application of the electronic device when the intelligent tracking function is turned on and a connection is established between the electronic device and the gimbal device; A selection unit is configured to determine a target tracking object from the candidate tracking objects in a preset manner based on the categories and quantities of the candidate tracking objects, wherein the preset manner includes: an intelligent selection manner and / or a manual selection manner; The tracking unit is configured to enable the pan-tilt device to track the target tracking object.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the information providing method of the electronic device according to any one of claims 1 to 9 is implemented.

12. An electronic device, characterized in that: The electronic device comprises: processor; The memory stores a computer program, and when the computer program is executed by the processor, the information providing method of the electronic device according to any one of claims 1 to 9 is implemented.

13. A computer program product comprising computer executable instructions, characterized in that: When the computer executable instructions are executed by a processor, the information providing method of the electronic device according to any one of claims 1 to 9 is implemented.

Images