Switching method of always-on AON camera, electronic device and chip system

Abstract

The application is suitable for the terminal technical field, and provides a switching method of a normally open AON camera, an electronic device and a chip system. The method comprises the following steps: in the case that the camera currently used for realizing AON sensing function of the electronic device is switched, determining a first AON camera used for realizing AON sensing function after switching; inquiring about each registered AON service corresponding to a second AON camera; deregistering each registered AON service corresponding to the second AON camera; and re-registering each current AON service corresponding to the first AON camera. Thus, when the AON camera in the electronic device is switched, each AON service realized by the AON camera used before is deregistered, and each AON service is re-registered based on the AON camera currently used, so that the folding screen electronic device can support the AON service in the folded and unfolded states, and the interactive experience of the user is improved.

Description

Technical Field

[0001] This application belongs to the field of terminal technology, and in particular relates to a switching method for a normally open (AON) camera, an electronic device, a chip system, a computer-readable storage medium, and a computer program product. Background Technology

[0002] As electronic devices become increasingly powerful and feature-rich, the ability to control them without physical contact through always-on (AON) cameras, such as gesture control and gaze sensing, is gradually becoming an essential function for various electronic devices (such as smartphones and tablets), thereby improving the efficiency and convenience of their interaction.

[0003] In related technologies, for electronic devices with multiple screen areas, such as foldable screen phones, AON sensing function is usually only supported on one screen, either when the electronic device is folded or when it is unfolded. This results in incomplete AON sensing function for foldable screen electronic devices, affecting the user's interactive experience. Summary of the Invention

[0004] This application provides an AON camera switching method, electronic device, chip system, computer-readable storage medium, and computer program product, which can solve the problem that foldable screen electronic devices can usually only support AON sensing function on one screen, either when the electronic device is in a folded state or when the electronic device is in an unfolded state, resulting in incomplete AON sensing function of foldable screen electronic devices and affecting the user's interactive experience.

[0005] In a first aspect, embodiments of this application provide a method for switching AON cameras, comprising: when the camera currently used by an electronic device to implement AON sensing function is switched, determining a first AON camera to implement AON sensing function after the switch; querying each registered AON service corresponding to a second AON camera, wherein the second AON camera is the camera used to implement AON sensing function before the switch; unregistering each registered AON service corresponding to the second AON camera; and re-registering each current AON service corresponding to the first AON camera.

[0006] In this way, when the AON camera in the electronic device switches, the various AON services implemented through the previously used AON camera are deregistered, and then the various AON services are reregistered based on the currently used AON camera. This allows the electronic device to implement various AON services using the switched AON camera after the AON camera switches, thereby restoring the various AON service functions of the electronic device. As a result, the foldable screen electronic device can support AON services in both folded and unfolded states, ensuring the integrity of the AON sensing function of the foldable screen electronic device and improving the user's interactive experience.

[0007] In one possible implementation of the first aspect, the registration status of the aforementioned AON service is recorded in the sensing fence corresponding to the AON service, and the number of registered AON services is N, where N is a positive integer; correspondingly, the unregistration of each registered AON service corresponding to the second AON camera includes:

[0008] In the sensing fence, the registration status of the i-th registered AON service is changed from registered to unregistered, and the unregistered message of the i-th registered AON service is sent to the AON driver through the sensing fence, so as to cancel the execution of the service identification result callback corresponding to the i-th registered AON service through the AON driver. Here, i is an integer greater than or equal to 1 and less than or equal to N.

[0009] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0010] Optionally, in another possible implementation of the first aspect, the number of the aforementioned current AON services is N, and correspondingly, before re-registering each of the current AON services corresponding to the first AON camera, the following steps are also included:

[0011] Send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0012] Accordingly, the aforementioned re-registration of each current AON service corresponding to the first AON camera includes:

[0013] Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera.

[0014] Within the sensing fence, the registration status of the i-th current AON service is determined as "registered". The registration message of the i-th current AON service is sent to the AON driver through the sensing fence, so as to establish the service identification result callback corresponding to the i-th current AON service through the AON driver. Here, i is an integer greater than or equal to 1 and less than or equal to N.

[0015] Thus, the registration status of each AON service is maintained through the sensing fence corresponding to the AON service. During deregistration, the registration status of each registered AON service is modified to the deregistration status within the sensing fence. The AON driver is then notified to cancel the execution of the service identification result callbacks corresponding to each registered AON service. The virtual sensor instance between the AON driver and the second AON camera is destroyed, and the second AON camera is powered down to cut off data transmission between them. Subsequently, the first AON camera is powered on, and a virtual sensor instance is established between the AON driver and the first AON camera to establish the AON service. Data transmission between the AON driver and the first AON camera, re-registering each AON service based on the first AON camera within the sensing fence, and when the AON driver receives the AON service registration message sent by the sensing fence, establishing a callback for the service identification result corresponding to that AON service, so that the AON driver returns the service identification result required by that AON service to the sensing fence, restoring the functions of each AON service, thereby achieving successful switching of the AON camera. This enables the electronic device to support AON sensing function in both folded and unfolded states, ensuring the integrity of the AON sensing function of foldable screen electronic devices and improving the user's interactive experience.

[0016] Optionally, in another possible implementation of the first aspect, the registration status of the aforementioned AON service is recorded in the AON driver; correspondingly, before unregistering each registered AON service corresponding to the second AON camera, the process further includes:

[0017] Send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0018] Accordingly, the above-mentioned unregistered AON services corresponding to the second AON camera include:

[0019] Each registered AON service is deregistered sequentially using the AON driver.

[0020] Accordingly, the aforementioned re-registration of each current AON service corresponding to the first AON camera includes:

[0021] Based on the identifier of the first AON camera, each current AON service is re-registered sequentially.

[0022] In this way, by maintaining the registration status of AON services in the AON driver, the status of each AON service can be directly modified in the AON driver when the AON camera switches. The AON driver can also directly cancel the execution of the service identification result callback corresponding to the unregistered AON service and directly establish the service identification result callback corresponding to each re-registered AON service. This eliminates the need for communication between the sensing fence and the AON driver when unregistering and registering each AON service, saving communication overhead during AON camera switching. This not only ensures the integrity of the AON sensing function of foldable screen electronic devices but also improves the response efficiency during AON camera switching, reduces the recovery latency of AON service functions, and further enhances the user's interactive experience.

[0023] Optionally, in another possible implementation of the first aspect, the number of registered AON services is N, where N is a positive integer; correspondingly, the above-mentioned unregistering of each registered AON service sequentially via the AON driver includes:

[0024] In the AON driver, the registration status of the i-th registered AON service is changed from registered to unregistered, and the service identification result callback corresponding to the i-th registered AON service is canceled through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0025] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0026] In this way, by maintaining the registration status of AON services in the AON driver, the status of each AON service can be modified directly in the AON driver when the AON camera switches. The AON driver can also directly cancel the execution of the service identification result callback corresponding to the unregistered AON service and directly establish the service identification result callback corresponding to each re-registered AON service. This eliminates the need for communication between the sensing fence and the AON driver when unregistering and registering each AON service, saving communication overhead during AON camera switching. This not only ensures the integrity of the AON sensing function of foldable screen electronic devices but also improves the response efficiency during AON camera switching, reduces the recovery latency of AON service functions, and further enhances the user's interactive experience.

[0027] Optionally, in another possible implementation of the first aspect, the number of current AON services is N, where N is a positive integer; correspondingly, the above-mentioned re-registration of each current AON service according to the identifier of the first AON camera includes:

[0028] Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera.

[0029] The AON driver establishes a service identification result callback corresponding to the i-th current AON service, and determines the registration status of the i-th current AON service as registered in the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0030] In this way, by maintaining the registration status of AON services in the AON driver, the status of each AON service can be directly modified in the AON driver when the AON camera switches. The AON driver can also directly cancel the execution of the service identification result callback corresponding to the unregistered AON service and directly establish the service identification result callback corresponding to each re-registered AON service. This eliminates the need for communication between the sensing fence and the AON driver when unregistering and registering each AON service, saving communication overhead during AON camera switching. This not only ensures the integrity of the AON sensing function of foldable screen electronic devices but also improves the response efficiency during AON camera switching, reduces the recovery latency of AON service functions, and further enhances the user's interactive experience.

[0031] Optionally, in another possible implementation of the first aspect, the above-mentioned unregistering of each registered AON service sequentially via the AON driver includes:

[0032] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0033] In this way, by maintaining the registration status of AON services in the AON driver and directly destroying the virtual sensor instance between the AON driver and the second AON camera, the registration of each registered AON service can be deregistered at once. This further saves the deregistration time of AON services when switching AON cameras, thus not only ensuring the integrity of the AON sensing function of foldable screen electronic devices, but also further improving the response efficiency when switching AON cameras, further reducing the recovery latency of AON service functions, and further enhancing the user's interactive experience.

[0034] Optionally, in another possible implementation of the first aspect, before determining the first AON camera to implement the AON sensing function after the switch occurs when the camera currently used by the electronic device to implement the AON sensing function is switched, the method further includes:

[0035] The window manager service (WMS) monitors the screen folding state and screen display content of the electronic device. The screen folding state includes folded state and unfolded state.

[0036] When WMS detects a screen folding state or a change in the screen display content, it sends a screen state change notification to the sensing fence corresponding to the AON service.

[0037] By sensing the fence and notifying users of changes in screen status, the system determines the screen the user is currently using. If the camera corresponding to the user's current screen is different from the second AON camera, it determines that the camera used by the electronic device to implement the AON sensing function has switched.

[0038] In this way, by monitoring the screen folding state and screen content of electronic devices in real time through WMS, when the screen folding state or screen content of the electronic device changes, the sensor fence determines whether the screen currently used by the user has changed. When the screen currently used by the user changes, the AON camera is switched to the camera corresponding to the screen the user is using in a timely manner. This ensures that the implementation of AON services always matches the actual usage of the user. This not only guarantees the completeness of the AON sensing function of foldable screen electronic devices, but also further improves the timeliness and accuracy of AON camera switching, and further enhances the user's interactive experience.

[0039] Secondly, embodiments of this application provide an AON camera switching device, comprising: a first determining module, configured to determine a first AON camera to be used to implement the AON sensing function after the switching occurs when the camera currently used by the electronic device to implement the AON sensing function is switched; a first querying module, configured to query each registered AON service corresponding to the second AON camera, wherein the second AON camera is the camera used to implement the AON sensing function before the switching; a first deregistration module, configured to deregister each registered AON service corresponding to the second AON camera; and a first registration module, configured to re-register each current AON service corresponding to the first AON camera.

[0040] In one possible implementation of the second aspect, the registration status of the aforementioned AON service is recorded in the sensing fence corresponding to the AON service, and the number of registered AON services is N, where N is a positive integer; correspondingly, the aforementioned first deregistration module includes:

[0041] The first deregistration unit is used to change the registration status of the i-th registered AON service from the registered state to the deregistration state in the sensing fence, and send the deregistration message of the i-th registered AON service to the AON driver through the sensing fence, so as to cancel the execution of the service identification result callback corresponding to the i-th registered AON service through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0042] The first power-down unit is used to destroy the virtual sensor instance between the AON driver and the second AON camera through the AON driver, and to power down the second AON camera.

[0043] Optionally, in another possible implementation of the second aspect, the number of the aforementioned current AON services is N, and correspondingly, the aforementioned apparatus further includes:

[0044] The first sending module is used to send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0045] Accordingly, the aforementioned first registration module includes:

[0046] The first power-on unit is used to power on the first AON camera through the AON driver according to the identifier of the first AON camera, and to establish a virtual sensor instance between the AON driver and the first AON camera.

[0047] The first registration unit is used to determine the registration status of the i-th current AON service as registered in the sensing fence, and send the registration message of the i-th current AON service to the AON driver through the sensing fence, so as to establish the service identification result callback corresponding to the i-th current AON service through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0048] Optionally, in another possible implementation of the second aspect, the registration status of the aforementioned AON service is recorded in the AON driver; correspondingly, the aforementioned device further includes:

[0049] The second sending module is used to send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0050] Accordingly, the first solution registration module mentioned above includes:

[0051] The second unregistration unit is used to sequentially unregister each registered AON service through the AON driver.

[0052] Accordingly, the aforementioned first registration module includes:

[0053] The second registration unit is used to re-register each current AON service sequentially based on the identifier of the first AON camera.

[0054] Optionally, in another possible implementation of the second aspect, the number of registered AON services is N, where N is a positive integer; correspondingly, the second deregistration unit is specifically used for:

[0055] In the AON driver, the registration status of the i-th registered AON service is changed from the registered status to the unregistered status, and the service identification result callback corresponding to the i-th registered AON service is canceled through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0056] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0057] Optionally, in another possible implementation of the second aspect, the number of the aforementioned current AON services is N, where N is a positive integer; correspondingly, the aforementioned second registration unit is specifically used for:

[0058] Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera.

[0059] The AON driver establishes a service identification result callback corresponding to the i-th current AON service, and determines the registration status of the i-th current AON service as registered in the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0060] Optionally, in another possible implementation of the second aspect, the aforementioned second deregistration unit is specifically used for:

[0061] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0062] Optionally, in another possible implementation of the second aspect, the above-mentioned apparatus further includes:

[0063] The first listening module is used to listen to the screen folding state and screen display content of the electronic device through the window manager service (WMS). The screen folding state includes folded state and unfolded state.

[0064] The second sending module is used to send a screen state change notification to the sensing fence corresponding to the AON service when the WMS detects a screen folding state or a change in the screen display content.

[0065] The second determining module is used to determine the screen currently used by the user based on the screen status change notification through the sensing fence, and to determine that the camera currently used by the electronic device to realize the AON sensing function has switched when the camera corresponding to the screen currently used by the user is different from the second AON camera.

[0066] Thirdly, embodiments of this application provide an electronic device, including: one or more processors, and a memory; the memory is coupled to one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to execute the AON camera switching method as described above.

[0067] Fourthly, embodiments of this application provide a chip system applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to execute the AON camera switching method as described above.

[0068] Fifthly, embodiments of this application provide a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the AON camera switching method as described above.

[0069] Sixthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to execute the AON camera switching method as described above.

[0070] The technical effects achieved by the second, third, fourth, fifth, and sixth aspects mentioned above are similar to those achieved by the corresponding technical means in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0071] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0072] Figure 1 This is a flowchart illustrating an embodiment of the AON camera switching method provided in this application;

[0073] Figure 2 This is a schematic diagram of the structure of an inward-folding screen mobile phone according to an embodiment of this application;

[0074] Figure 3 This is a schematic diagram of the back of an inward-folding screen mobile phone in its unfolded state, according to an embodiment of this application.

[0075] Figure 4 This is a front view of an inward-folding screen mobile phone in an unfolded state, according to an embodiment of this application.

[0076] Figure 5 This is a schematic diagram of the structure of an outward-folding screen mobile phone according to an embodiment of this application;

[0077] Figure 6 This is a schematic diagram of an outward-folding screen mobile phone in a folded state according to an embodiment of this application;

[0078] Figure 7 This is a schematic diagram of an outward-folding screen mobile phone in an unfolded state according to an embodiment of this application;

[0079] Figure 8 This is a schematic diagram of another outward-folding screen mobile phone in an unfolded state according to an embodiment of this application;

[0080] Figure 9 This is a schematic diagram illustrating a usage scenario of an AON camera switching method provided in an embodiment of this application;

[0081] Figure 10 This is a timing diagram of a switching method for an AON camera provided in an embodiment of this application;

[0082] Figure 11 This is a timing diagram of another AON camera switching method provided in an embodiment of this application;

[0083] Figure 12 This is a flowchart illustrating a switching method for an AON camera provided in another embodiment of this application;

[0084] Figure 13 This is a timing diagram of another AON camera switching method provided in an embodiment of this application;

[0085] Figure 14 This is a schematic diagram of the structure of a switching device for an AON camera provided in an embodiment of this application;

[0086] Figure 15 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0087] The following description, with reference to the accompanying drawings, details the switching method, apparatus, electronic device, chip system, storage medium, and computer program of the AON camera provided in this application.

[0088] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating an embodiment of the AON camera switching method provided in this application. The method may include some or all of the following:

[0089] Step 101: If the camera currently used by the electronic device to realize the AON sensing function is switched, determine the first AON camera to realize the AON sensing function after the switch.

[0090] It should be noted that the AON camera switching method of this application embodiment can be executed by the AON camera switching device of this application embodiment. The AON camera switching device of this application embodiment can be configured in any electronic device to execute the AON camera switching method of this application embodiment.

[0091] It should be noted that the embodiments of this application do not limit the operating system installed in the electronic device, and it can be an Android system, a Windows Phone (WP) operating system, or an iOS system, etc. For example, for ease of explanation, the embodiments of this application will use the Android system in the following description.

[0092] In this application embodiment, the electronic device can be a foldable screen electronic device or other electronic device with multiple screens; furthermore, the screen mentioned in this application embodiment can refer to a single independent screen, or a screen area that can be displayed independently or combined with other screen areas to form a single screen for joint display. This application embodiment uses a foldable screen mobile phone as an example for specific explanation.

[0093] For example, the electronic device in the embodiments of this application is as follows: Figure 2 The inward-folding screen phone 200 shown includes two independent screens: a smaller outer screen 210 and a larger inner screen 220. The outer screen 210 contains a camera 230, and the inner screen 220 contains a camera 240. Figure 2 As shown, the inward-folding screen phone 200 can be switched to the folded state by folding along the fold line in the direction of the dotted arrow. When the inward-folding screen phone 200 is in the folded state, the inner screen 220 is covered by the outer screen and cannot be used. The user can use the outer screen 210 for operation and content display, and the camera 230 can be used when the front camera is needed. Figure 2As shown, after the inward-folding screen phone 200 is fully unfolded with the fold line as the axis and in the opposite direction to the dotted arrow, it can be switched to the unfolded state, as shown. Figure 3 The image shown is a rear view of the inward-folding screen phone 200 in its unfolded state. The inward-folding screen phone 200 may also include a rear camera 250. In this state, the outer screen 210 and the back panel of the phone are on the same plane, as shown below. Figure 4 The image shown is a front view of the inward-folding screen phone 200 in its unfolded state. At this time, the inner screen 220 is fully unfolded. Users can choose to use either the inner screen 220 or the outer screen 210, depending on the functionality of the inward-folding screen phone 200. This application embodiment does not limit this. When the user uses the inner screen 220, if the front camera is needed, the camera 240 can be used; if the rear camera is needed, the rear camera 250 can be used.

[0094] For example, the electronic device in the embodiments of this application is as follows: Figure 5 The outward-folding screen phone 500 shown includes a single screen, which can be divided into two screen areas 510 and 520. When the outward-folding screen phone 500 is in the unfolded state, screen areas 510 and 520 can be combined to form a single screen for display. When the outward-folding screen phone 500 is in the folded state, both screen areas 510 and 520 can be displayed as independent screens, and the user can choose to use either screen area 510 or screen area 520 according to their actual needs. Figure 5 As shown, the outward-folding screen phone 500 can be switched to the folded state by folding along the folding line in the direction of the dotted arrow. In the folded state, if the user chooses to use screen area 510 and needs to use the front-facing camera, they can use camera 530 within screen area 510; while screen area 520 may or may not include camera 540 to prevent the camera from occupying too much screen space and to ensure the shooting effect of the rear camera; therefore, as... Figure 6 As shown, when the screen area 520 does not include the camera 540, the rear camera 550 can be set in an area outside the screen area. The width of the screen area 520 can be smaller than the width of the screen area 510 so that the rear camera 550 is not blocked by the screen area 520 when the outward-folding screen phone is in the folded state. Thus, when the outward-folding screen phone 500 is in the folded state and the user selects to use the screen area 520 and needs to use the front camera, the rear camera 550 can be used as the front camera of the screen area 520.

[0095] like Figure 5As shown, the outward-folding screen phone 500 can be switched to the unfolded state by unfolding it in the direction opposite to the dotted arrow, with the folding line as the axis. If the screen area 520 includes the camera 540, the unfolded state diagram of the outward-folding screen phone 500 is as follows. Figure 7 As shown, when the user uses the screen area 510 and 520 together, either camera 530 or camera 540 can be selected or randomly selected as the front-facing camera based on the user's operation, or either camera 530 or camera 540 can be used as the default front-facing camera; if screen area 520 does not contain camera 540, and the outward-folding phone 500 contains a rear camera 550, then the unfolded state of the outward-folding phone 500 is illustrated in the diagram below. Figure 8 As shown, when unfolded, camera 530 can be used as the front camera and rear camera 550 can be used as the rear camera.

[0096] It should be noted that the examples above are merely illustrative and should not be considered as limitations on this application. In actual use, the form, number of screens, combination of screen areas, folding method, and unfolding method of foldable screen phones are not limited to the situations listed above, and the embodiments of this application do not limit them in this regard.

[0097] The AON sensing function in this application embodiment may include functions such as air gestures and gaze detection, which control electronic devices by recognizing user behavior through a camera. For example, it may include keeping the screen on while gazing, displaying an off-screen mode when gazing, reducing the volume of incoming calls when gazing, intelligent screen rotation, and assisting with taking photos, but it is not limited to these.

[0098] The first AON camera can refer to the camera currently used in an electronic device to realize the AON sensing function; the first AON camera is related to the screen currently used by the user.

[0099] For example, such as Figure 9 As shown, assuming the user has enabled the AON service "Watch-On Display," when the user uses the electronic device in a folded state, the camera used to perform the "Watch-On Display" service is the rear camera of the electronic device. When the user unfolds the electronic device and uses it in an unfolded state, the camera used to perform the "Watch-On Display" service is the front camera located on the electronic device's display screen. In this case, the AON camera switching method of this application embodiment can be used to restore the various AON service functions enabled by the user after the AON camera is switched, so that the user can support the AON service functions in any usage state of the electronic device, ensuring the functional integrity of the electronic device.

[0100] In this embodiment, in a foldable phone with AON sensing capability and the user has enabled AON services, if the user switches screens while using the foldable phone, the camera facing the user typically changes. Since AON services usually require collecting user gestures, facial information, etc., if the user switches screens while using the foldable phone, the AON camera used to implement AON services before the switch will be unable to continue executing AON services. Therefore, it is necessary to switch the AON camera, and the front-facing camera used when using the current screen can be designated as the first AON camera after the switch. For example, the camera on the currently used screen can be designated as the first AON camera; or the camera on the same plane as the currently used screen can be designated as the first AON camera.

[0101] As an example, suppose the electronic device used by the user is as follows: Figure 2 The inward-folding screen phone 200 shown above, if the user unfolds the inward-folding screen phone 200 from its folded state to... Figure 4 The unfolded state shown indicates that the screen currently used by the user has switched from the outer screen 210 to the inner screen 220. Therefore, it can be determined that the camera currently used to realize the AON sensing function has switched from camera 230 to camera 240, and thus camera 240 can be identified as the first AON camera. Correspondingly, if the user switches the inward-folding screen phone 200 from the unfolded state to the folded state, that is, the screen currently used by the user has switched from the inner screen 220 to the outer screen 210, it can be determined that the camera currently used to realize the AON sensing function has switched from camera 240 to camera 230, and thus camera 230 can be identified as the first AON camera.

[0102] As an example, suppose the electronic device used by the user is as follows: Figure 6 The outward-folding screen phone 500 shown above, if the user folds the outward-folding screen phone 500 from... Figure 6 The folded state shown unfolds as follows Figure 8 The unfolded state shown indicates that the screen currently used by the user has switched from screen area 520 to a screen composed of screen areas 510 and 520. Therefore, it can be determined that the camera currently used to implement the AON sensing function has switched from the rear camera 550 to camera 530, thus camera 530 can be identified as the first AON camera. Correspondingly, if the user folds the outward-folding screen phone 500 from... Figure 8 The unfolded state shown is switched to as follows: Figure 6 The folded state shown means that the screen currently used by the user, which consists of screen area 510 and screen area 520, is switched to screen area 520. Therefore, it can be determined that the camera currently used to realize the AON sensing function has switched from camera 530 to rear camera 550, and thus the rear camera 550 can be identified as the first AON camera.

[0103] As an example, suppose the electronic device used by the user is as follows: Figure 6 The outward-folding screen phone 500 shown is in the following position: Figure 6 When the user switches from using screen area 520 to using screen area 510 in the folded state shown, it can be determined that the camera currently used to implement the AON sensing function has switched from the rear camera 550 to camera 530, and thus camera 530 can be identified as the first AON camera; correspondingly, if the user switches from using screen area 510 to using screen area 520, it can be determined that the camera currently used to implement the AON sensing function has switched from camera 530 to rear camera 550, and thus rear camera 550 can be identified as the first AON camera.

[0104] Furthermore, the screen folding state and screen content of the electronic device can be monitored in real time via WMS. When the screen folding state or screen content of the electronic device changes, the sensing fence corresponding to the AON service determines whether the screen currently used by the user has changed. When the screen currently used by the user changes, the AON camera is switched to the camera corresponding to the screen the user is currently using. This ensures that the implementation of the AON service always matches the actual usage of the user, thereby not only ensuring the completeness of the AON sensing function of the foldable screen electronic device, but also further improving the timeliness and accuracy of AON camera switching, and further enhancing the user's interactive experience. That is, in one possible implementation of the embodiments of this application, before step 101 above, it may also include:

[0105] The screen folding state and screen display content of the electronic device are monitored by WMS. The screen folding state includes folded state and unfolded state.

[0106] When WMS detects a screen folding state or a change in the screen display content, it sends a screen state change notification to the sensing fence corresponding to the AON service.

[0107] By sensing the fence and notifying users of changes in screen status, the system determines the screen the user is currently using. If the camera corresponding to the user's current screen is different from the second AON camera, it determines that the camera used by the electronic device to implement the AON sensing function has switched.

[0108] In the embodiments of this application, a change in the screen folding state of the electronic device may include the screen of the electronic device switching from a folded state to an unfolded state, or switching from an unfolded state to a folded state; a change in the screen display content of the electronic device may include any one or more screens switching from a lit screen to an off screen, switching from an off screen to a lit screen, or window switching occurring within any screen.

[0109] As one possible implementation, when WMS monitors the screen display content, it can send a screen state change notification to the sensing fence corresponding to the AON service whenever it detects any type of screen content change. This allows the sensing fence to decide whether to switch the AON camera based on the screen state change, thus ensuring the normal execution of the AON service.

[0110] As one possible implementation, since users are usually still operating the screen when sending screen content changes such as window switching, the correlation with user screen switching is low; while screen content changes such as screen turning from on to off and from off to on are usually highly correlated with user screen switching, WMS can also send screen status change notifications to the sensing fence corresponding to AON services when it detects screen content changes such as screen turning from on to off and from off to on for any one or more screens. This avoids sending redundant data, reduces the data processing load of WMS and sensing fence, and thus reduces the power consumption of electronic devices.

[0111] In this embodiment, when the WMS detects a change in the screen folding state of the electronic device, the screen state change notification may include the changed screen folding state. For example, if the screen folding state of the electronic device changes from folded to unfolded, the current unfolded state of the electronic device (e.g., indicated by a flag "1" and indicated by a flag "0") can be sent to the sensing fence via the screen state change notification. When the WMS detects a change in the screen display content of the electronic device, the screen state change notification may include the changed screen identifier and the corresponding display content change result. For example, when the screen with screen identifier 01 changes from on to off, the screen state change notification may include information such as "01, off".

[0112] It should be noted that the above examples are merely illustrative and should not be considered as limitations on this application. In actual use, the specific information included in the screen status change notification can be determined according to actual needs and specific application scenarios, and this application embodiment does not limit this.

[0113] The second AON camera can refer to the camera used to implement AON sensing function before the switch.

[0114] As an example, suppose the electronic device used by the user is as follows: Figure 2 The inward-folding screen phone 200 shown above, if the user unfolds the inward-folding screen phone 200 from its folded state to... Figure 4The unfolded state shown indicates that the user's current screen has switched from the outer screen 210 to the inner screen 220. Therefore, it can be determined that the camera currently used to realize the AON sensing function has switched from camera 230 to camera 240, i.e., camera 240 is the first AON camera and camera 230 is the second AON camera. Correspondingly, if the user switches the inward-folding screen phone 200 from the unfolded state to the folded state, i.e., the user's current screen has switched from the inner screen 220 to the outer screen 210, it can be determined that the camera currently used to realize the AON sensing function has switched from camera 240 to camera 230, i.e., camera 230 is the first AON camera and camera 240 is the second AON camera.

[0115] As an example, suppose the electronic device used by the user is as follows: Figure 6 The outward-folding screen phone 500 shown above, if the user folds the outward-folding screen phone 500 from... Figure 6 The folded state shown unfolds as follows Figure 8 The unfolded state shown indicates that the screen currently used by the user has switched from screen area 520 to a screen composed of screen areas 510 and 520. Therefore, it can be determined that the camera currently used to implement the AON sensing function has switched from the rear camera 550 to camera 530, that is, camera 530 is the first AON camera, and the rear camera 550 is the second AON camera; correspondingly, if the user folds the outward-folding screen phone 500 from... Figure 8 The unfolded state shown is switched to as follows Figure 6 The folded state shown means that the screen currently used by the user, which consists of screen area 510 and screen area 520, is switched to screen area 520. Therefore, it can be determined that the camera currently used to realize the AON sensing function is switched from camera 530 to rear camera 550. That is, rear camera 550 is the first AON camera and camera 530 is the second AON camera.

[0116] As an example, suppose the electronic device used by the user is as follows: Figure 6 The outward-folding screen phone 500 shown is in the following position: Figure 6 When the user switches from using screen area 520 to using screen area 510 in the folded state shown, it can be determined that the camera currently used to implement the AON sensing function has switched from the rear camera 550 to the camera 530, that is, the camera 530 is the first AON camera and the rear camera 550 is the second AON camera; correspondingly, if the user switches from using screen area 510 to using screen area 520, it can be determined that the camera currently used to implement the AON sensing function has switched from the camera 530 to the rear camera 550, that is, the rear camera 550 is the first AON camera and the camera 530 is the second AON camera.

[0117] In this embodiment, if the WMS detects a change in the screen folding state or the screen display content of the electronic device, it can send a screen state change notification to the sensing fence in the aforementioned manner. Then, the sensing fence can determine the screen currently used by the user based on the screen state change notification, and then determine the camera corresponding to the screen currently used by the user and the second AON camera before the switch. If the camera corresponding to the currently used screen is the same as the second AON camera, it can be determined that the current AON camera has not been switched. If the camera corresponding to the currently used screen is different from the second AON camera, it can be determined that the current AON camera has been switched, and the camera corresponding to the currently used screen can be determined as the first AON camera.

[0118] For example, suppose the electronic device used by the user is such as Figure 2 If the WMS detects that the screen folding state of the inward-folding screen phone 200 has switched from folded to unfolded, it can send a screen state change notification to the sensing fence. The sensing fence can then determine that the screen currently used by the user is the inner screen 220, and the camera corresponding to the inner screen 220 is camera 240. Before the switch, the second AON camera was camera 230 corresponding to the outer screen 210. Since the second AON camera is different from camera 240, it can be determined that the current AON camera has switched, and camera 240 can be identified as the first AON camera.

[0119] Step 102: Query each registered AON service corresponding to the second AON camera, where the second AON camera is the camera used to implement the AON sensing function before the switchover.

[0120] The registered AON services corresponding to the second AON camera can refer to the various AON services that the user has already activated and registered based on the second AON camera. For example, if the user has activated three AON services: gaze-on display, gaze-on display with screen off, and gaze-on volume reduction for incoming calls, then the registered AON services corresponding to the second AON camera can include the gaze-on display service, gaze-on display with screen off, and gaze-on volume reduction for incoming calls registered based on the second AON camera when these three services are implemented through the second AON camera.

[0121] One possible implementation is to record the various AON services that a user has activated within the sensing fence corresponding to the AON service and maintain the registration status of each AON service. Therefore, as... Figure 10 As shown, when it is determined to switch AON cameras, the user can query the various AON services that have been enabled by the user through the sensing fence, that is, the various registered services corresponding to the second AON camera.

[0122] One possible implementation is to record the various AON services that a user has enabled and maintain the registration status of each AON service in the AON driver. Therefore, as... Figure 11 As shown, when it is determined to switch AON cameras, the AON driver can be used to query the various AON services that the user has enabled, that is, the various registered services corresponding to the second AON camera.

[0123] Step 103: Unregister each registered AON service corresponding to the second AON camera.

[0124] In this embodiment of the application, after determining that it is necessary to switch the second AON camera to the first AON camera, it can be determined that it is no longer necessary to execute each AON service through the second AON camera, so that each registered AON service corresponding to the second AON camera can be deregistered in sequence.

[0125] As one possible implementation, the registration status of each AON service can be maintained through the sensing fence corresponding to the AON service. During deregistration, the registration status of each registered AON service is modified to the deregistration status in the sensing fence, and the AON driver is notified to cancel the execution of the service identification result callback corresponding to each registered AON service. Furthermore, the virtual sensor instance between the AON driver and the second AON camera is destroyed, and the second AON camera is powered down to cut off data transmission between the AON driver and the second AON camera. That is, in one possible implementation of this application embodiment, the registration status of the AON service is recorded in the sensing fence corresponding to the AON service, and the number of registered AON services is N, where N is a positive integer. Correspondingly, step 103 may include:

[0126] In the sensing fence, the registration status of the i-th registered AON service is changed from registered to unregistered, and the unregistered message of the i-th registered AON service is sent to the AON driver through the sensing fence, so as to cancel the execution of the service identification result callback corresponding to the i-th registered AON service through the AON driver. Here, i is an integer greater than or equal to 1 and less than or equal to N.

[0127] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0128] The unregistration message for a registered AON service may include the service identifier of the registered AON service.

[0129] The callback of the service recognition result corresponding to the registered AON service can be used by the AON driver to return the service recognition result corresponding to the registered AON service to the sensing fence. For example, the service recognition result corresponding to the air gesture type AON service may include information such as the angle between the user's palm, back of hand and electronic device, and the service recognition result corresponding to the gaze type AON service may include information such as the angle between the face and electronic device, but is not limited to these.

[0130] It should be noted that the above examples are merely illustrative and should not be considered as limitations on this application. In actual use, the service identification result corresponding to the AON service is related to the specific function of the AON service, and this application embodiment does not limit this.

[0131] The virtual sensor instance can refer to an instance that enables communication and data transmission between the AON driver and the camera.

[0132] As an example, such as Figure 10 As shown, when WMS detects a change in the screen folding state or the screen display content of an electronic device, it sends a screen state change message to the sensing fence. After the sensing fence determines that the AON camera needs to be switched based on the screen state change message, it can query each registered AON service and then unregister each registered AON service. When deregistering the N registered AON services corresponding to the second AON camera, the deregistration process for each registered AON service within the sensing fence involves modifying the registration status of the registered AON service from registered to deregistered through the sensing fence, and sending the deregistration message of the registered AON service to the AON Hardware Abstraction Layer (HAL). The AON HAL then sends the deregistration message of the registered AON service to the AON driver. Subsequently, the AON driver cancels the service identification result callback corresponding to the registered AON service based on the service identifier contained in the deregistration message, so that the AON driver no longer returns the service identification result corresponding to the registered AON service to the sensing fence based on the second AON camera. This process is repeated sequentially. After deregistering each registered service, the virtual sensor instance between the AON driver and the second AON camera can be destroyed through the AON driver, and the second AON camera can be powered down to cut off data transmission between the AON driver and the second AON camera, thereby temporarily preventing the second AON camera from being used to implement the various AON services.

[0133] Step 104: Re-register each current AON service corresponding to the first AON camera.

[0134] Among them, each current AON service corresponding to the first AON camera can refer to each AON service that the user has already activated and that currently needs to be registered based on the first AON camera.

[0135] It should be noted that, compared to before the AON camera switch, as long as the user neither closes an existing AON service nor opens a new one, the types of current AON services corresponding to the first AON camera are the same as the types of registered AON services corresponding to the second AON camera—all are AON services already activated by the user. The difference between the current AON services and the registered AON services corresponding to the second AON camera is that they are executed through different AON cameras. For example, the registered AON services corresponding to the second AON camera include the "Keep Screen On While Looking" service, the "Screen Off Display While Looking" service, and the "Reduce Incoming Call Volume While Looking" service. If the user neither opens a new AON service nor closes an existing one after the AON camera switch, then the current AON services corresponding to the first AON camera will be the "Keep Screen On While Looking" service, the "Screen Off Display While Looking" service, and the "Reduce Incoming Call Volume While Looking" service registered with the first AON camera.

[0136] In this embodiment of the application, after deregistering each registered AON service corresponding to the second AON camera in sequence, the AON service function of the electronic device can be restored through the first AON camera, thereby allowing each current AON service corresponding to the first AON camera to be re-registered in sequence based on the first AON camera.

[0137] As one possible implementation, the registration status of each AON service can be maintained through a sensing fence corresponding to the AON service. Therefore, when re-registering each AON service, the first AON camera can be powered on and a virtual sensor instance can be established between the AON driver and the first AON camera to establish data transmission between them. Each AON service is then re-registered within the sensing fence based on the first AON camera. Furthermore, when the AON driver receives the AON service registration message sent by the sensing fence, it establishes a callback for the service identification result corresponding to that AON service, allowing the AON driver to return the required service identification result to the sensing fence, thus restoring the functionality of each AON service. That is, in one possible implementation of this application embodiment, the number of current AON services is N; correspondingly, before step 104, the following may also be included:

[0138] Send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0139] Accordingly, step 104 above may include:

[0140] Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera.

[0141] Within the sensing fence, the registration status of the i-th current AON service is determined as "registered". The registration message of the i-th current AON service is sent to the AON driver through the sensing fence, so as to establish the service identification result callback corresponding to the i-th current AON service through the AON driver. Here, i is an integer greater than or equal to 1 and less than or equal to N.

[0142] The registration message for the current AON service may include the service identifier for the current AON service.

[0143] As one possible implementation, such as Figure 10 As shown, after the sensing fence unregisters each registered AON service, it can send an AON camera update message to the AON HAL. The AON HAL then forwards the AON camera update message to the AON driver, allowing the AON driver to determine whether the updated AON camera is the same as the previously used AON camera based on the identifier of the first AON camera in the update message. If they are different, the driver can power on the first AON camera based on its identifier and establish a virtual sensor instance between the AON driver and the first AON camera to facilitate data transmission. Subsequently, for a current AON service, its registration process within the sensing fence involves determining its registration status as registered through the sensing fence, and then sending a registration message corresponding to the current AON service to the AON HAL. HAL sends the registration message corresponding to the current AON service to the AON driver, so that the AON driver can establish a service identification result callback corresponding to the current AON service based on the service identifier in the registration message, so that the AON driver can return the service identification result corresponding to the current AON service obtained through the first AON camera to the perception fence; and so on, after re-registering N current AON services using the same registration process, the functions of each AON service can be restored through the first AON camera.

[0144] The AON camera switching method provided in this application embodiment unregisters each AON service implemented through the previously used AON camera when the AON camera in the electronic device is switched, and then re-registers each AON service based on the currently used AON camera. This allows the electronic device to implement each AON service using the switched AON camera after the AON camera is switched, thereby restoring the AON service functions of the electronic device. As a result, the foldable screen electronic device can support AON services in both folded and unfolded states, ensuring the integrity of the AON sensing function of the foldable screen electronic device and improving the user's interactive experience.

[0145] Please refer to Figure 12 , Figure 12 This is a flowchart illustrating a switching method for an AON camera according to another embodiment of this application. The method may include some or all of the following:

[0146] Step 1201: If the camera currently used by the electronic device to realize the AON sensing function is switched, determine the first AON camera to be used to realize the AON sensing function after the switch.

[0147] Step 1202: Send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera.

[0148] Step 1203: Query each registered AON service corresponding to the second AON camera. The second AON camera is the camera used to implement the AON sensing function before the switchover. The registration status of the AON service is recorded in the AON driver.

[0149] In this embodiment of the application, in order to save communication overhead between the AON driver and the sensing fence when switching AON cameras, the AON driver can record each AON service activated by the user and maintain the registration status of the AON service. For example... Figure 11As shown, in this scenario, when the sensing fence determines that an AON camera is switching, it can directly send an AON camera update message to the AON HAL. The AON HAL then sends the AON camera update message to the AON driver. Upon receiving the AON camera update message, the AON driver determines whether the AON camera currently implementing the AON service is the first AON camera. If not, it queries each registered AON service corresponding to the second AON camera, directly unregisters each registered AON service of the second AON camera, and re-registers each current AON service corresponding to the first AON camera. This eliminates the need to communicate with the sensing fence, saving communication overhead during AON camera switching. This not only ensures the integrity of the AON sensing function of the foldable screen electronic device but also improves the response efficiency during AON camera switching, reduces the recovery latency of the AON service function, and further enhances the user's interactive experience.

[0150] The specific implementation process and principle of steps 1201-1203 can be found in the detailed description of the above embodiments, and will not be repeated here.

[0151] Step 1204: Unregister each registered AON service sequentially using the AON driver.

[0152] As one possible implementation, the registration status of AON services can be maintained in the AON driver, and the status of each AON service can be directly modified in the AON driver when the AON camera switches. Furthermore, the callback of the service identification result corresponding to the unregistered AON service can be directly canceled through the AON driver, thereby destroying the virtual sensor instance between the AON driver and the second AON camera and powering down the second AON camera. This eliminates the need for repeated communication between the sensing fence and the AON driver during the unregistration process, saving communication overhead during AON camera switching. This allows for faster restoration of the AON service function of the electronic device, ensuring the integrity of the AON sensing function of the foldable screen electronic device, improving the response efficiency during AON camera switching, reducing the recovery latency of the AON service function, and further enhancing the user's interactive experience. In one possible implementation of this application embodiment, the number of registered AON services is N, where N is a positive integer; correspondingly, step 1204 may include:

[0153] In the AON driver, the registration status of the i-th registered AON service is changed from registered to unregistered, and the service identification result callback corresponding to the i-th registered AON service is canceled through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0154] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0155] As an example, such as Figure 11 As shown, when WMS detects a change in the screen folding state or the screen display content of an electronic device, it sends a screen state change message to the sensing fence. After the sensing fence determines that the AON camera needs to be switched based on the screen state change message, it can send an AON camera update message to the AON HAL, which then sends the AON camera update message to the AON driver. After receiving the AON camera update message, the AON driver determines whether the AON camera currently implementing the AON service is the first AON camera. If not, it can query each registered AON service corresponding to the second AON camera and then unregister each registered AON service in sequence. For a registered AON service, the corresponding deregistration process is as follows: In the AON driver, the registration status of the registered AON service is changed from registered to deregistered. The AON driver also cancels the execution of the service identification result callback corresponding to the registered AON service, so that the AON driver no longer returns the service identification result corresponding to the registered AON service to the sensing fence based on the second AON camera. Similarly, after deregistering each registered service in the above manner, the virtual sensor instance between the AON driver and the second AON camera can be destroyed through the AON driver, and the second AON camera can be powered down to cut off the data transmission between the AON driver and the second AON camera, so that the second AON camera is temporarily no longer used to implement each AON service.

[0156] Furthermore, to further reduce the recovery latency of AON service functions, the registration status of AON services can be maintained in the AON driver, and the virtual sensor instance between the AON driver and the second AON camera can be directly destroyed to achieve one-time unregistration of each registered AON service. This further saves the unregistration time of AON services when switching AON cameras, thus not only ensuring the integrity of the AON sensing function of the foldable screen electronic device, but also further improving the response efficiency when switching AON cameras, further reducing the recovery latency of AON service functions, and further improving the user's interactive experience. That is, in one possible implementation of the embodiments of this application, the above step 1204 may include:

[0157] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0158] As one possible implementation, such as Figure 13As shown, if the virtual sensor instance between the AON driver and the second AON camera is directly destroyed, the N registered AON services corresponding to the second AON camera can be unregistered at once. Thus, when switching AON cameras, the virtual sensor instance between the AON driver and the second AON camera can be destroyed directly through the AON driver, and the second AON camera can be powered down. This further improves the efficiency of AON camera switching and further reduces the recovery latency of AON service functions.

[0159] Step 1205: Based on the identifier of the first AON camera, re-register each current AON service in sequence.

[0160] As one possible implementation, the registration status of AON services can be maintained in the AON driver. After deregistering each registered AON service corresponding to the second AON camera, each current AON service can be directly re-registered in the AON driver based on the identifier of the first AON camera. This eliminates the need for communication between the sensing fence and the AON driver when registering each AON service, saving communication overhead during AON camera switching. This not only ensures the integrity of the AON sensing function of the foldable screen electronic device but also improves the response efficiency during AON camera switching, reduces the recovery latency of AON service functions, and further enhances the user's interactive experience. In one possible implementation of this application embodiment, the number of current AON services is N, where N is a positive integer; correspondingly, step 1205 may include:

[0161] Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera.

[0162] The AON driver establishes a service identification result callback corresponding to the i-th current AON service, and determines the registration status of the i-th current AON service as registered in the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0163] As one possible implementation, such as Figure 11 and Figure 13As shown, after unregistering each registered AON service and powering down the second AON camera, the AON driver can power on the first AON camera based on its identifier and establish a virtual sensor instance between the AON driver and the first AON camera to facilitate data transmission. Then, for a current AON service, its registration process in the AON driver involves establishing a callback for the service identification result corresponding to that current AON service. This allows the AON driver to return the service identification result obtained from the first AON camera to the sensing fence, and the AON driver determines the registration status of the current AON service as registered. This process is repeated for N current AON services. After re-registering using the same process, the functions of each AON service can be restored through the first AON camera. This not only ensures the completeness of the AON sensing function of the foldable screen electronic device but also improves the response efficiency during AON camera switching, reduces the recovery latency of AON service functions, and further enhances the user's interactive experience.

[0164] The AON camera switching method provided in this application maintains the registration status of AON services in the AON driver. Therefore, when switching AON cameras, the status of each AON service can be directly modified in the AON driver. The AON driver can also directly cancel the service identification result callback corresponding to the unregistered AON service and directly establish the service identification result callback corresponding to each re-registered AON service. This eliminates the need for communication between the sensing fence and the AON driver when unregistering and registering each AON service, saving communication overhead during AON camera switching. This not only ensures the integrity of the AON sensing function of foldable screen electronic devices but also improves the response efficiency during AON camera switching, reduces the recovery latency of AON service functions, and further enhances the user's interactive experience.

[0165] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0166] Corresponding to the AON camera switching method described in the above embodiments, Figure 14 A structural block diagram of the switching device for an AON camera provided in an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiment of this application are shown.

[0167] Reference Figure 14 The device 1400 includes:

[0168] The first determining module 1401 is used to determine the first AON camera to implement the AON sensing function after the switch when the camera currently used by the electronic device to implement the AON sensing function is switched.

[0169] The first query module 1402 is used to query each registered AON service corresponding to the second AON camera, wherein the second AON camera is the camera used to implement the AON sensing function before the switchover.

[0170] The first unregistration module 1403 is used to unregister each registered AON service corresponding to the second AON camera;

[0171] The first registration module 1404 re-registers each current AON service corresponding to the first AON camera.

[0172] In practical use, the AON camera switching device provided in this application embodiment can be configured in any electronic device to execute the aforementioned AON camera switching method.

[0173] The AON camera switching device provided in this application embodiment unregisters each AON service implemented through the previously used AON camera when the AON camera in the electronic device is switched, and then re-registers each AON service based on the currently used AON camera. This allows the electronic device to implement each AON service using the switched AON camera after the AON camera is switched, thereby restoring the AON service functions of the electronic device. As a result, the foldable screen electronic device can support AON services in both folded and unfolded states, ensuring the integrity of the AON sensing function of the foldable screen electronic device and improving the user's interactive experience.

[0174] In one possible implementation of this application, the registration status of the aforementioned AON service is recorded in the sensing fence corresponding to the AON service, and the number of registered AON services is N, where N is a positive integer; correspondingly, the aforementioned first deregistration module 1403 includes:

[0175] The first deregistration unit is used to change the registration status of the i-th registered AON service from the registered state to the deregistration state in the sensing fence, and send the deregistration message of the i-th registered AON service to the AON driver through the sensing fence, so as to cancel the execution of the service identification result callback corresponding to the i-th registered AON service through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0176] The first power-down unit is used to destroy the virtual sensor instance between the AON driver and the second AON camera through the AON driver, and to power down the second AON camera.

[0177] Furthermore, in another possible implementation of this application, the number of the aforementioned current AON services is N, and correspondingly, the aforementioned device 1400 further includes:

[0178] The first sending module is used to send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0179] Accordingly, the aforementioned first registration module 1404 includes:

[0180] The first power-on unit is used to power on the first AON camera through the AON driver according to the identifier of the first AON camera, and to establish a virtual sensor instance between the AON driver and the first AON camera.

[0181] The first registration unit is used to determine the registration status of the i-th current AON service as registered in the sensing fence, and send the registration message of the i-th current AON service to the AON driver through the sensing fence, so as to establish the service identification result callback corresponding to the i-th current AON service through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0182] Furthermore, in another possible implementation of this application, the registration status of the aforementioned AON service is recorded in the AON driver; correspondingly, the aforementioned device 1400 further includes:

[0183] The second sending module is used to send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera;

[0184] Accordingly, the first solution registration module 1403 mentioned above includes:

[0185] The second unregistration unit is used to sequentially unregister each registered AON service through the AON driver.

[0186] Accordingly, the aforementioned first registration module 1404 includes:

[0187] The second registration unit is used to re-register each current AON service sequentially based on the identifier of the first AON camera.

[0188] Furthermore, in yet another possible implementation of this application, the number of registered AON services is N, where N is a positive integer; correspondingly, the second deregistration unit is specifically used for:

[0189] In the AON driver, the registration status of the i-th registered AON service is changed from the registered status to the unregistered status, and the service identification result callback corresponding to the i-th registered AON service is canceled through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0190] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0191] Furthermore, in another possible implementation of this application, the number of the aforementioned current AON services is N, where N is a positive integer; correspondingly, the aforementioned second registration unit is specifically used for:

[0192] Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera.

[0193] The AON driver establishes a service identification result callback corresponding to the i-th current AON service, and determines the registration status of the i-th current AON service as registered in the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

[0194] Furthermore, in another possible implementation of this application, the aforementioned second deregistration unit is specifically used for:

[0195] The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered down.

[0196] Furthermore, in another possible implementation of this application, the aforementioned device 1400 further includes:

[0197] The first listening module is used to listen to the screen folding state and screen display content of the electronic device through the window manager service (WMS). The screen folding state includes folded state and unfolded state.

[0198] The second sending module is used to send a screen state change notification to the sensing fence corresponding to the AON service when the WMS detects a screen folding state or a change in the screen display content.

[0199] The second determining module is used to determine the screen currently used by the user based on the screen status change notification through the sensing fence, and to determine that the camera currently used by the electronic device to realize the AON sensing function has switched when the camera corresponding to the screen currently used by the user is different from the second AON camera.

[0200] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0201] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0202] To implement the above embodiments, this application also proposes an electronic device.

[0203] Figure 15 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application.

[0204] See Figure 15 The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0205] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0206] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0207] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0208] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from this memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0209] In some embodiments, the processor 110 may include one or more interfaces, such as an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0210] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0211] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device 100 via the power management module 141.

[0212] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0213] The electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. As an example, the electronic device 100 in this embodiment may be a foldable electronic device, and the display screen 194 may be a foldable display screen, or multiple displays 194 may be included to obtain different screen sizes when the electronic device 100 is in a folded state and an unfolded state.

[0214] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is an integer greater than 1.

[0215] Electronic device 100 can implement shooting functions through ISP, camera 193, video codec, GPU, display screen 194, and application processor. In some embodiments, electronic device 100 may include multiple cameras 193, each camera 193 can work with the currently used display screen to implement AON services of the electronic device.

[0216] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's image sensor. The light signal is converted into an electrical signal, and the image sensor transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimizations on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be integrated into the camera 193.

[0217] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0218] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions, such as saving music, video, and other files on the external memory card.

[0219] Internal memory 121 can be used to store computer-executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created by electronic device 100 during use (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0220] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D and application processor.

[0221] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scenario, electronic device 100 can utilize the distance sensor 180F for distance measurement to achieve fast focusing.

[0222] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0223] It should be noted that the implementation process and technical principles of the electronic device in this embodiment are explained in the foregoing description of the switching method of the AON camera in the embodiments of this application, and will not be repeated here.

[0224] This application also provides a chip system for use in an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform the steps in the above-described method embodiments.

[0225] This application also provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the steps described in the various method embodiments above.

[0226] This application also provides a computer program product that, when run on an electronic device, causes the electronic device to perform the steps described in the various method embodiments above.

[0227] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a device / electronic device, a recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0228] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0229] In the above embodiments, specific details such as particular system structures and techniques have been set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application can also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary details.

[0230] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0231] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0232] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0233] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0234] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0235] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0236] In the embodiments provided in this application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings or direct couplings or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0237] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0238] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for switching a normally open (AON) camera, characterized in that, Applications in foldable screen electronic devices, including: The Window Management Service (WMS) monitors the screen folding state and screen display content of the electronic device, wherein the screen folding state includes a folded state and an unfolded state. When the WMS detects that the screen is in a folded state or that the screen display content has changed, it sends a screen state change notification to the sensing fence corresponding to the AON service. The change in screen display content includes any one or more screens switching from on to off, from off to on, or window switching within any screen. Based on the screen state change notification, the sensor fence determines the screen currently used by the user. If the camera corresponding to the screen currently used by the user is different from the second AON camera, it is determined that the camera currently used by the electronic device to realize the AON sensing function has been switched. The second AON camera is the camera used to realize the AON sensing function before the switch. When the camera currently used by the electronic device to realize the AON sensing function is switched, the first AON camera to realize the AON sensing function after the switch is determined. Query each registered AON service corresponding to the second AON camera, wherein each registered AON service corresponding to the second AON camera refers to each AON service that the user has activated and registered based on the second AON camera; Unregister each of the registered AON services corresponding to the second AON camera; Re-register each current AON service corresponding to the first AON camera, wherein each current AON service corresponding to the first AON camera refers to each AON service that the user has already activated and that currently needs to be registered based on the first AON camera. The difference between the current AON service and the registered AON service corresponding to the second AON camera is that they are executed through different AON cameras.

2. The method as described in claim 1, characterized in that, The registration status of the AON service is recorded in the sensing fence corresponding to the AON service. The number of registered AON services is N, where N is a positive integer. Unregistering each of the registered AON services corresponding to the second AON camera includes: In the sensing fence, the registration status of the i-th registered AON service is changed from registered to unregistered, and the unregistered message of the i-th registered AON service is sent to the AON driver through the sensing fence, so as to cancel the execution of the service identification result callback corresponding to the i-th registered AON service through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N. The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered off.

3. The method as described in claim 2, characterized in that, The number of current AON services is N. Before re-registering each current AON service corresponding to the first AON camera, the process further includes: Send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera; The re-registration of each current AON service corresponding to the first AON camera includes: Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera. Within the sensing fence, the registration status of the i-th current AON service is determined to be registered, and the registration message of the i-th current AON service is sent to the AON driver through the sensing fence, so as to establish a service identification result callback corresponding to the i-th current AON service through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

4. The method as described in claim 1, characterized in that, The registration status of the AON service is recorded in the AON driver. Before unregistering each of the registered AON services corresponding to the second AON camera, the process further includes: Send an AON camera update message to the AON driver, wherein the AON camera update message includes the identifier of the first AON camera; The unregistration of each of the registered AON services corresponding to the second AON camera includes: The AON driver sequentially unregisters each of the registered AON services; The re-registration of each current AON service corresponding to the first AON camera includes: Based on the identifier of the first AON camera, each of the current AON services is re-registered sequentially.

5. The method as described in claim 4, characterized in that, The number of registered AON services is N, where N is a positive integer. The step of sequentially unregistering each registered AON service through the AON driver includes: In the AON driver, the registration status of the i-th registered AON service is changed from the registered status to the unregistered status, and the service identification result callback corresponding to the i-th registered AON service is canceled through the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N; The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered off.

6. The method as described in claim 4, characterized in that, The number of current AON services is N, where N is a positive integer. The step of re-registering each current AON service sequentially based on the identifier of the first AON camera includes: Based on the identifier of the first AON camera, the first AON camera is powered on via the AON driver, and a virtual sensor instance is established between the AON driver and the first AON camera. The AON driver establishes a service identification result callback corresponding to the i-th current AON service, and determines the registration status of the i-th current AON service as registered in the AON driver, where i is an integer greater than or equal to 1 and less than or equal to N.

7. The method as described in claim 4, characterized in that, The step of sequentially unregistering each of the registered AON services via the AON driver includes: The virtual sensor instance between the AON driver and the second AON camera is destroyed by the AON driver, and the second AON camera is powered off.

8. An electronic device, characterized in that, The electronic device includes: one or more processors, and a memory; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, and the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-7.

9. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-7.

Images