Image switching display method and device, electronic equipment and readable storage medium

By using data buffers for data sharing in smart wearable devices, the invisible switching between the AP side and the CP side is realized, which solves the problem of time-consuming state switching, improves the real-time user experience and the hardware resource utilization of the device efficiency.

CN118939446APending Publication Date: 2024-11-12GOERTEK INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310533992.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

In smart wearable devices, the state switching between the AP side and the CP side in the AR dual system takes a long time, resulting in users being unable to quickly enter the camera preview interface, affecting the real-time experience.

Method used

By receiving the application triggering instruction while the first processor is in a sleep state, triggering the target application and sending the preview frame image data to the data buffer, the second processor reads and performs preview switching display in the display interface, avoiding additional information The switching process can efficiently reuse hardware resources.

Benefits of technology

It realizes sensorless switching of images in dual AR systems, ensuring the continuity and real-timeness of user operations, and improving user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939446A_ABST
    Figure CN118939446A_ABST
Patent Text Reader

Abstract

The invention discloses an image switching display method and device, electronic equipment and a readable storage medium, and relates to the field of intelligent wearable device.The image switching display method comprises the steps that when a first processor is in a dormant state, a target application program is triggered through an application triggering instruction received by the first processor; determining preview frame image data according to the triggered target application program, and sending the preview frame image data to a preset data buffer area for storage, the data buffer area being a data sharing area between the first operating system and the second operating system; and reading the preview frame image data stored in the data buffer area through the second processor, and performing preview switching display on an image displayed in a preset display interface according to the read preview frame image data. According to the invention, non-inductive switching of the images in the AR dual systems in the intelligent wearable device can be realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of smart wearable devices, and in particular to an image switching display method, device, electronic device and readable storage medium. Background Art

[0002] VR (Virtual Reality) devices or AR (Augmented Reality) devices are currently rapidly developing and popularizing virtual reality and augmented reality products. Many smart wearable devices on the market, such as AR / VR glasses or AR / VR helmets, often have higher and higher requirements for system computing power, power consumption, performance, etc. The architecture design of smart wearable devices is becoming more and more sophisticated and complex. In order to take into account the support and expansion of AR / VR product functions and good battery life performance, the dual operating system based on "Android + RTOS (Real-time operating system)" (referred to as AR dual system) has also been increasingly used.

[0003] In smart wearable devices, if the user needs to open the camera and preview, the current common practice is that the AP side (i.e., the first processor) in the AR dual system switches from the sleep state to the display state, and takes over the display through the AP side. The CP side (i.e., the second processor) in the AR dual system will switch from the display state to the sleep state. However, there is a defect in this process. After the user presses the camera button, the state switching between the AP side and the CP side takes a certain amount of time. The user needs to wait for a switching process to enter the camera's preview interface image. The preview interface image of the camera cannot be quickly entered according to the user's actual needs, which greatly affects the user's real-time experience. Summary of the invention

[0004] The main purpose of the present application is to provide an image switching display method, device, electronic device and readable storage medium, aiming to solve the technical problem of how to achieve seamless switching of images in AR dual systems in smart wearable devices.

[0005] To achieve the above object, the present application provides an image switching display method, which is applied to a smart wearable device, wherein the smart wearable device includes a first processor running a first operating system and a second processor running a second operating system, and the image switching display method includes the following steps:

[0006] When the first processor is in a dormant state, triggering a target application program through an application trigger instruction received by the first processor;

[0007] Determine preview frame image data according to the triggered target application, and send the preview frame image data to a preset data buffer for storage, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0008] The preview frame image data stored in the data buffer is read by the second processor, and the image displayed in the preset display interface is preview-switched and displayed according to the read preview frame image data.

[0009] Optionally, the preview frame image data includes image parameters of the preview frame image.

[0010] The step of determining the preview frame image data according to the triggered target application and sending the preview frame image data to a preset data buffer for storage includes:

[0011] Determining image parameters of the preview frame image to be acquired according to the triggered target application, wherein the image parameters include an image frame rate and an image size of the preview frame image;

[0012] The image parameters are sent to a preset data buffer for storage.

[0013] Optionally, the preview frame image data includes a preview frame image.

[0014] After the step of sending the image parameters to a preset data buffer for storage, the method further comprises:

[0015] The preview frame image is acquired according to the triggered target application, and the preview frame image is sent to the data buffer for storage in association with the image parameters.

[0016] Optionally, the step of reading the preview frame image data stored in the data buffer by the second processor, and performing preview switching display of the image displayed in the preset display interface according to the read preview frame image data, includes:

[0017] Reading the image parameters stored in the data buffer through the second processor, and constructing a display framework according to the image parameters;

[0018] The preview frame image stored in the data buffer in association with the image parameters is read by the second processor, and a target display image is constructed based on the display frame and the preview frame image, and a preview switching display of the image displayed in the preset display interface is performed based on the target display image.

[0019] Optionally, the step of constructing a display framework according to the image parameters includes:

[0020] Determining display parameters corresponding to a preset display interface, wherein the display parameters include a display size;

[0021] The image parameters are adjusted according to the display parameters to obtain a display frame.

[0022] Optionally, after the step of reading the preview frame image data stored in the data buffer by the second processor and performing preview switching display of the image displayed in the preset display interface according to the read preview frame image data, the method further comprises:

[0023] The state parameters of the target application are determined by the first operating system, and when it is detected that the state parameters are updated, the updated state parameters are sent to the second operating system, and the second operating system synchronously updates the displayed preview frame image data based on the received updated state parameters.

[0024] In addition, to achieve the above-mentioned purpose, the present application also provides an image switching display method, the image switching display method is applied to a first processor in a smart wearable device, the first processor runs a first operating system, the smart wearable device includes a second processor running a second operating system, and the image switching display method includes the following steps:

[0025] When the first processor is in a dormant state, triggering a target application program through a received application trigger instruction;

[0026] Preview frame image data is determined based on the triggered target application, and the preview frame image data is sent to a preset data buffer for storage, so that the second processor reads the preview frame image data stored in the data buffer and performs preview switching display on the image displayed in the preset display interface, wherein the data buffer is a data sharing area between the first operating system and the second operating system.

[0027] In addition, to achieve the above-mentioned purpose, the present application also provides an image switching display method, the image switching display method is applied to a second processor in a smart wearable device, the second processor runs a second operating system, the smart wearable device includes a first processor running a first operating system, and the image switching display method includes the following steps:

[0028] Displaying an image corresponding to the second operating system in a preset display interface;

[0029] Upon detecting that the target application in the first processor is triggered, reading the preview frame image data stored in the data buffer, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0030] The image displayed in the display interface is previewed and switched for display according to the read preview frame image data.

[0031] The present application also provides an electronic device, which is a physical device, and includes: a memory, a processor, and a program of the image switching display method stored in the memory and executable on the processor. When the program of the image switching display method is executed by the processor, the steps of the image switching display method as described above can be implemented.

[0032] The present application also provides a readable storage medium, which is the computer-readable storage medium, and the computer-readable storage medium stores a program for implementing the image switching display method. The program for implementing the image switching display method is executed by a processor to implement the steps of the above-mentioned image switching display method.

[0033] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned image switching display method when executed by a processor.

[0034] The technical solution of the present application is to trigger the target application according to the received application trigger instruction when the first processor is in a dormant state, determine the preview frame image data according to the triggered target application, send it to the data buffer for storage, and read the preview frame image data in the data buffer by the second processor to preview and switch the image displayed in the display interface. In this way, the preview frame image data in the first processor can be migrated to the second processor, and there is no additional switching process in the upper layer, which efficiently reuses the underlying hardware resources, ensures the continuity and real-time nature of the user's operation behavior, and realizes the seamless switching of images in the AR dual system in the smart wearable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0036] In order to more clearly illustrate the technical solutions in this embodiment or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0037] Figure 1 This is a flow chart of the first embodiment of the image switching display method of the present application;

[0038] Figure 2This is a schematic diagram of a scene flow in the first embodiment of the image switching display method of the present application;

[0039] Figure 3 This is a flow chart of a second embodiment of the image switching display method of the present application;

[0040] Figure 4 This is a schematic diagram of the flow chart of the third embodiment of the image switching display method of the present application;

[0041] Figure 5 This is a flowchart of a fourth embodiment of the image switching display method of the present application;

[0042] Figure 6 A schematic diagram of a module structure of the image switching display device of the present application;

[0043] Figure 7 This is another schematic diagram of the module structure of the image switching display device of the present application;

[0044] Figure 8 This is another module structure diagram of the image switching display device of the present application;

[0045] Fig. 9 Schematic diagram of the device structure of the hardware operating environment involved in the electronic device in this embodiment.

[0046] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0048] In this embodiment, the smart wearable device of the present application can be, for example, a mixed reality (Mixed Reality)—MR device, an augmented reality (Augmented Reality)—AR device, a virtual reality (Virtual Reality)—VR device, an extended reality (Extended Reality)—XR device, or some combination thereof.

[0049] With the development of computer, electronic information technology and artificial intelligence technology, smart wearable devices are gradually gaining more and more attention and applications in different industries such as industry, security, and education. At the same time, smart wearable device products often have higher and higher requirements for system computing power, power consumption, performance, etc., and the architecture design of their software systems is becoming more and more sophisticated and complex. In order to support and expand the functions of VR / AR / MR / XR products, especially to improve battery life, dual operating systems based on "Android + RTOS (Real-time operating system)" (referred to as AR dual systems) have also been increasingly used.

[0050] The AR dual system includes AP and CP. Among them, AP is the Android system (first processor) and CP is the RTOS system (second processor). When the AP side (first processor) is in sleep mode, the CP side (second processor) takes over the display. If the user needs to operate the camera (want to open the camera and preview), the normal operation is that the AP side (first processor) switches from sleep mode to display mode (because the camera hardware module is integrated on the AP side) and the AP side takes over the display, and the CP side switches from display mode to sleep mode. The camera hardware module on the AP side (first processor) is quickly powered on and then the camera is turned on to enter the camera preview mode on the AP side. This will bring a problem. After the user presses the camera button, the state switching between the AP side and the CP side takes a certain amount of time. The user needs to wait for a switching process to enter the camera preview interface. The camera preview interface cannot be quickly entered according to the user's actual needs, which has a great impact on the user's real-time experience.

[0051] Embodiment 1

[0052] Based on this, please refer to Figure 1 This embodiment provides an image switching display method, which is applied to a smart wearable device. The smart wearable device includes a first processor running a first operating system and a second processor running a second operating system. The image switching display method includes:

[0053] Step S10, when the first processor is in a dormant state, triggering a target application program through an application trigger instruction received by the first processor;

[0054] Step S20, determining preview frame image data according to the triggered target application, and sending the preview frame image data to a preset data buffer for storage, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0055] Step S30: The second processor reads the preview frame image data stored in the data buffer, and performs preview switching display on the image displayed in the preset display interface according to the read preview frame image data.

[0056] Since the AP (first processor) and CP (second processor) in the AR dual system need to be frequently exchanged, and the camera hardware module is integrated on the AP side, if the AP side is in sleep mode, the current practice is to switch the AP side from sleep mode to wake-up mode and take over display control, so there will be a process from CP side taking over display to AP side taking over display, and then the camera preview screen will be presented on the AP side. That is, the user needs to switch from the usage scenario on the CP side to the usage scenario on the AP side before using the camera hardware resources. The user can see a system switching process (from AP side to CP side) on the interface.

[0057] Therefore, to avoid this defect, in this embodiment, in order to improve the immediacy and user experience, the AR dual system preview interface in the smart wearable device is switched seamlessly. When the first processor on the AP side is in a dormant state, the first operating system on the AP side only needs to trigger the awakening of the target application according to the application trigger instruction received by the first processor, such as powering on the camera hardware module (at this time, there is no need to power on other modules on the AP side), and most modules such as the display part on the AP side do not need to be powered on or awakened, and the CP side can continue to control the display. The preview frame image data on the AP side, such as the camera preview frame (real-time preview screen), is sent to the CP side through dual-machine communication (data sharing area between the AP side and the CP side), and the second processor on the CP side switches the display on the CP side after receiving the preview frame data. It is ensured that after the user presses the camera button, the camera preview frame (real-time preview screen) can be migrated from the AP side to the CP side, and there is no additional switching process in the upper layer, and the underlying camera hardware resources are efficiently reused. The continuity and real-time nature of the user's operation behavior are guaranteed. For the user, it looks like directly opening the camera hardware resources on the CP side. Thereby achieving the goal of allowing the user to switch the camera preview without feeling.

[0058] In this embodiment, the target application refers to the application to be started and run by the smart wearable device. For example, a camera, etc. The user can input the application trigger instruction corresponding to the application triggered by the user's needs into the smart wearable device through a preset trigger input method, and the coprocessor of the smart wearable device can determine the application triggered by the application trigger instruction according to the application trigger instruction, and the corresponding triggered application is the target application to be started and run. Among them, the trigger input method includes but is not limited to voice input, physical button pressing input or touch screen touch input.

[0059] In this embodiment, the first operating system running on the first processor may be an Android system, and the second operating system running on the second processor may be a real-time operating system. In addition, the smart wearable device includes a first processor running the first operating system, and a second processor running the second operating system. Considering that different application programs correspond to different operating load values ​​or operating power consumption values, or different application programs have different hardware configuration requirements for the processor, the operating systems supporting the running of the application programs are often different for different application programs. For example, the application programs include but are not limited to AR navigation, AR shopping, taking pictures, music playback, settings (setting functions for parameters such as sound or image), information notifications, weather status, and voice calls, etc., wherein, considering that the operating load or operating power consumption of applications such as AR navigation and AR shopping is higher, and the hardware configuration requirements for the processor are higher, the operating system supporting the AR navigation and AR shopping applications can be set in the first operating system, and other applications with relatively low operating load or operating power consumption (such as music playback, information notifications, weather status, and voice calls, etc.) can be set in the second operating system.

[0060] Therefore, in this embodiment, only the first processor runs the target application and the second processor displays the image corresponding to the target application for illustration, but the present invention is not limited thereto. Alternatively, the second processor runs the target application and the first processor displays the image corresponding to the target application. Alternatively, the first processor and the second processor jointly run the target application, and the image corresponding to the target application is displayed by the first processor / or the second processor.

[0061] Further, for step S10, when the first processor is in a dormant state, triggering a target application program through an application trigger instruction received by the first processor;

[0062] In this embodiment, all hardware modules for running the target application can be arranged on the first processor side. For example, the camera hardware module is integrated and arranged on the first processor side. Therefore, when the first processor and its first operating system are in a dormant state, and an application trigger instruction corresponding to the target application is detected on the smart wearable device, the application trigger instruction is sent to the first processor, so as to trigger the target application through the first processor and run the target application through the first operating system.

[0063] Further, for step S20, the preview frame image data is determined according to the triggered target application, and the preview frame image data is sent to a preset data buffer for storage, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0064] In this embodiment, the first processor side can be awakened by controlling the corresponding hardware module through the triggered target application. For example, when the target application is a camera, the camera hardware module can be awakened and powered on. Other modules on the first processor side are not processed and remain in a dormant state.

[0065] In this embodiment, a dual-machine communication can be performed between the first operating system on the first processor side and the second operating system on the second processor side. And the dual-machine communication can be performed through a constructed data buffer. That is, the data interaction process between the first operating system and the second operating system is first sent to the data buffer for storage, and then sent to the corresponding operating system through the data buffer.

[0066] In this embodiment, after waking up the hardware module corresponding to the target application, the hardware module can be controlled to obtain the corresponding preview frame image, and the preview frame image can be sent to a pre-set data buffer for storage. Optionally, the preview frame image data can be relevant information of the preview frame image obtained by the target application, such as image parameters of the preview frame image (such as frame rate, size, etc.), and the preview frame image. For example, when the target application is a camera, the preview frame image can be a preview image to be captured obtained by the camera hardware module. The preview frame image may include one frame of preview image or multiple frames of preview image.

[0067] Further, for step S30, the preview frame image data stored in the data buffer is read by the second processor, and the image displayed in the preset display interface is preview-switched and displayed according to the read preview frame image data.

[0068] In this embodiment, after the first processor sends the preview frame image data to the data buffer for storage, the preview frame image data stored in the data buffer can be read by the second processor. And the data buffer can be read by the second operating system. Optionally, the first operating system can also choose to encrypt and store the preview frame image data in the data buffer, and the second operating system decrypts the encrypted preview frame image data.

[0069] Optionally, the second operating system on the second processor side can remain in an awake state. And an image related to the second operating system is displayed in a display interface corresponding to the smart wearable device. After the second operating system obtains the preview frame image data, the image displayed in the display interface can be previewed and switched, that is, the preview frame image corresponding to the preview frame image data is displayed.

[0070] In addition, to assist in understanding the image switching display principle of the AR dual system in this embodiment, an example is given below.

[0071] For example, Figure 2 As shown, there are AR dual systems in the smart wearable device, including AP (Android system) and CP (RTOS (Real-time operating system) system). And the screen display can be switched to the CP side first, and the display interface can be taken over by the CP side. Then the AP side is put into sleep mode. After the user presses the camera button, the screen display remains on the CP side, the camera module on the AP side is quickly powered on, and other modules are not powered on. The AP side sends preview frame information (image frame rate and size) to the data buffer (dual-machine communication), that is, it is sent by dual-machine communication. Among them, the preview frame information can be the image parameters of the preview frame image. The CP side parses the camera frame information transmitted from the AP side and prepares the display screen (size). The AP side sends the camera preview frame (which can be a preview frame image) to the data buffer (dual-machine communication). The CP side displays the camera frame data transmitted from the AP side. The camera status of the AP side is updated (exit camera), and the camera status is updated to the CP side through dual-machine communication. The CP side updates the camera status transmitted from the AP side (exit camera).

[0072] In this embodiment, when the first processor is in a dormant state, the target application is triggered according to the received application trigger instruction, and the preview frame image data is determined according to the triggered target application, and sent to the data buffer for storage, and the preview frame image data in the data buffer is read by the second processor to preview and switch the image displayed in the display interface. In this way, the preview frame image data in the first processor can be migrated to the second processor, and there is no additional switching process in the upper layer, which efficiently reuses the underlying hardware resources, ensures the continuity and real-time performance of the user's operation behavior, and realizes the seamless switching of images in the AR dual system in the smart wearable device.

[0073] Embodiment 2

[0074] Based on the first embodiment of the present application, in another embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 3 The preview frame image data includes image parameters of the preview frame image. Step S20, determining the preview frame image data according to the triggered target application, and sending the preview frame image data to a preset data buffer for storage, comprises:

[0075] Step a, determining image parameters of the preview frame image to be acquired according to the triggered target application, wherein the image parameters include an image frame rate and an image size of the preview frame image;

[0076] Step b: sending the image parameters to a preset data buffer for storage.

[0077] In this embodiment, on the first processor side, after the target application is triggered, the first operating system will run the target application and control the hardware module corresponding to the target application to perform corresponding actions. For example, when the hardware module is a camera hardware module, the camera hardware module can be controlled to prepare for camera shooting operations, and the preview frame image is obtained through the camera in the camera hardware module, and the image parameters of the preview frame image, such as the image frame rate and image size, are determined. The image frame rate and image size are sent to the data buffer for storage, so that the second operating system in the second processor can read the image frame rate and image size in the data buffer.

[0078] Optionally, for the image parameters of the preview frame images, the first operating system may send the image parameters of one frame image to the data buffer for storage each time, or may send the image parameters of all frame images to the data buffer for storage at one time.

[0079] In this embodiment, when the preview frame image data includes image parameters of the preview frame image, the image parameters are sent to the data buffer for storage, so that the image parameters are migrated from the first processor to the second processor.

[0080] Further, the preview frame image data includes a preview frame image,

[0081] After the step of sending the image parameters to a preset data buffer for storage, the method further comprises:

[0082] Step c: acquiring a preview frame image according to the triggered target application, and sending the preview frame image to the data buffer for storage in association with the image parameters.

[0083] In this embodiment, after the first operating system sends the image parameters to the data buffer, the second operating system may also perform an image acquisition operation according to the triggered target application to obtain a preview frame image, and send the preview frame image to the data buffer for storage in association with the image parameters. For example, when the target application is a camera, the image captured by the camera may be used as a preview frame image, and the preview frame image may be sent to the data buffer for storage in association with the image parameters.

[0084] Optionally, when there is only one image parameter stored in the data buffer, the preview frame image can be directly associated with the image parameter for storage. When there are multiple image parameters stored in the data buffer, the image parameter matching the preview frame image is first determined, and then the preview frame image is associated with the matching image parameter for storage.

[0085] In this embodiment, when the preview frame image data includes a preview frame image, the captured preview frame image is sent to the data buffer area image parameters for associated storage, thereby enabling the preview frame image to be migrated from the first processor to the second processor and played through the second processor, thereby achieving seamless switching of images.

[0086] Further, the step of reading the preview frame image data stored in the data buffer by the second processor, and performing preview switching display of the image displayed in the preset display interface according to the read preview frame image data includes:

[0087] Step c, reading the image parameters stored in the data buffer by the second processor, and constructing a display framework according to the image parameters;

[0088] In this embodiment, after the first processor stores the preview frame image data in the data buffer, the image parameters stored in the data buffer can be read by the second processor, so as to construct a display frame according to the read image parameters, so that the preview frame image read subsequently can be successfully displayed in the display interface. Optionally, the state of the preview frame image data can be set in the data buffer, such as whether it is successfully read by the second processor. When the reading operation of the second processor is detected, and the image parameters or preview frame image in the preview frame image data are not successfully read, the preview frame image data stored in the data buffer are packaged together and sent to the second processor for decompression by the second operating system in the second processor, and the image switching display in the display interface is performed.

[0089] Furthermore, the step of constructing a display framework according to the image parameters includes:

[0090] Step c1, determining display parameters corresponding to a preset display interface, wherein the display parameters include a display size;

[0091] Step c2: adjusting the image parameters according to the display parameters to obtain a display frame.

[0092] In this embodiment, when constructing the display framework, it is also necessary to determine the display interface corresponding to the smart wearable device (which can be the display interface of the smart wearable device itself or the display interface of the terminal that establishes a communication connection with the smart wearable device), and determine the display parameters corresponding to the display interface, such as the display size, the supported display frame rate, etc. Then, the image parameters are adjusted according to the display parameters, so that the adjusted image parameters meet the requirements corresponding to the display parameters, such as the length and width in the image parameters are less than or equal to the length and width in the display parameters, etc. The adjusted image parameters are used as the display framework.

[0093] Step d, reading the preview frame image stored in the data buffer in association with the image parameters through the second processor, and constructing a target display image based on the display frame and the preview frame image, and performing preview switching display of the image displayed in the preset display interface based on the target display image.

[0094] In this embodiment, the smart wearable device can read the preview frame image stored in the data buffer in association with the image parameters through the second processor, and then adjust the preview frame image according to the display framework to obtain the target display image. And when adjusting, at least one of the image parameters such as the image size and the image frame rate of the preview frame image can be adjusted. Optionally, after the second processor reads the preview frame image in the data buffer, it will clear the preview frame image and the corresponding image parameters stored in the data buffer.

[0095] Optionally, after acquiring the target display image, the image displayed in the display interface can be directly previewed and switched for display, that is, it is switched to the target display image so as to be displayed by the second processor.

[0096] In this embodiment, the image parameters are read by the second processor, and a display framework is constructed according to the image parameters and the display parameters. The preview frame image is then read by the second processor, and the second processor constructs a target display image according to the preview frame image and the display framework, and performs preview switching display according to the target display image, thereby realizing seamless switching of images in the AR dual systems in the smart wearable device.

[0097] Further, after the step of reading the preview frame image data stored in the data buffer by the second processor and performing preview switching display on the image displayed in the preset display interface according to the read preview frame image data, the method further comprises:

[0098] Step e: determining the state parameters of the target application through the first operating system, and when detecting that the state parameters are updated, sending the updated state parameters to the second operating system; the second operating system synchronously updates the displayed preview frame image data according to the received updated state parameters.

[0099] In this embodiment, after the preview frame image corresponding to the target application is controlled to be displayed through the second operating system. If it is detected on the first processor side that the state parameters of the target application are updated. For example, the state parameters are converted from a running state to a stopped state, etc. At this time, the updated state parameters can be sent to the second operating system through dual-machine communication, such as to a data buffer, and the second operating system reads the updated state parameters in the data buffer, and then updates the displayed preview frame image data according to the updated state parameters. For example, if an instruction corresponding to stopping the target application input by the user is detected on the first processor side, the target application is stopped, and the state parameters of the target application are controlled to be changed to a stopped state, and then sent to the second operating system. The second operating system exits the displayed preview frame image based on the received updated state parameters, and can redisplay the image before the preview frame image is displayed.

[0100] In this embodiment, when the state parameters of the target application are determined to be updated according to the first operating system, they are synchronously sent to the second operating system to update the displayed preview frame image data, thereby ensuring seamless switching between the first processor and the second processor.

[0101] Embodiment 3

[0102] The present application also provides an image switching display method, please refer to Figure 4 The image switching display method is applied to a first processor in a smart wearable device, the first processor runs a first operating system, the smart wearable device includes a second processor running a second operating system, and the image switching display method includes the following steps:

[0103] Step S1, triggering a target application program through a received application trigger instruction when the first processor is in a dormant state;

[0104] Step S2, determining preview frame image data based on the triggered target application, and sending the preview frame image data to a preset data buffer for storage, so that the second processor reads the preview frame image data stored in the data buffer and performs preview switching display on the image displayed in the preset display interface, wherein the data buffer is a data sharing area between the first operating system and the second operating system.

[0105] Furthermore, the first processor in this embodiment may be the same as the first processor in the above-mentioned embodiment 1 or embodiment 2, and execute the same steps, which will not be elaborated here.

[0106] Embodiment 4

[0107] The present application also provides an image switching display method, please refer to Figure 5 The image switching display method is applied to a second processor in a smart wearable device, the second processor runs a second operating system, the smart wearable device includes a first processor running a first operating system, and the image switching display method includes the following steps:

[0108] Step S100, displaying an image corresponding to the second operating system in a preset display interface;

[0109] Step S200, upon detecting that the target application in the first processor is triggered, reading the preview frame image data stored in the data buffer, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0110] Step S300 , preview switching and displaying the image displayed in the display interface according to the read preview frame image data.

[0111] Furthermore, the second processor in this embodiment may be the same as the second processor in the above-mentioned embodiment 1 or embodiment 2, and execute the same steps, which will not be elaborated here.

[0112] Embodiment 5

[0113] The present application also provides an image switching display device, please refer to Figure 6 The image switching display device is provided in a smart wearable device, the smart wearable device includes a first processor running a first operating system, and a second processor running a second operating system, and the image switching display device includes:

[0114] A trigger module A10, configured to trigger a target application program through an application trigger instruction received by the first processor when the first processor is in a dormant state;

[0115] A sending module A20, used for determining preview frame image data according to the triggered target application, and sending the preview frame image data to a preset data buffer for storage, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0116] The switching module A30 is used to read the preview frame image data stored in the data buffer through the second processor, and perform preview switching display on the image displayed in the preset display interface according to the read preview frame image data.

[0117] Optionally, the preview frame image data includes image parameters of the preview frame image, and the sending module A20 is used to:

[0118] Determining image parameters of the preview frame image to be acquired according to the triggered target application, wherein the image parameters include an image frame rate and an image size of the preview frame image;

[0119] The image parameters are sent to a preset data buffer for storage.

[0120] Optionally, the preview frame image data includes a preview frame image, and the sending module A20 is used to:

[0121] The preview frame image is acquired according to the triggered target application, and the preview frame image is sent to the data buffer for storage in association with the image parameters.

[0122] Optionally, the switching module A30 is used to:

[0123] Reading the image parameters stored in the data buffer through the second processor, and constructing a display framework according to the image parameters;

[0124] The preview frame image stored in the data buffer in association with the image parameters is read by the second processor, and a target display image is constructed based on the display frame and the preview frame image, and a preview switching display of the image displayed in the preset display interface is performed based on the target display image.

[0125] Optionally, the switching module A30 is used to:

[0126] Determining display parameters corresponding to a preset display interface, wherein the display parameters include a display size;

[0127] The image parameters are adjusted according to the display parameters to obtain a display frame.

[0128] Optionally, the switching module A30 is used to:

[0129] The state parameters of the target application are determined by the first operating system, and when it is detected that the state parameters are updated, the updated state parameters are sent to the second operating system, and the second operating system synchronously updates the displayed preview frame image data based on the received updated state parameters.

[0130] In addition, the present application also provides an image switching display device, please refer to Figure 7 The image switching display device is provided in a first processor in the smart wearable device, the first processor runs a first operating system, the smart wearable device includes a second processor running a second operating system, and the image switching display device includes:

[0131] A receiving module A1, configured to trigger a target application program by receiving an application trigger instruction when the first processor is in a dormant state;

[0132] The storage module A2 is used to determine the preview frame image data according to the triggered target application, and send the preview frame image data to a preset data buffer for storage, so that the second processor can read the preview frame image data stored in the data buffer and perform preview switching display on the image displayed in the preset display interface, wherein the data buffer is a data sharing area between the first operating system and the second operating system.

[0133] In addition, the present application also provides an image switching display device, please refer to Figure 8 The image switching display device is provided in a second processor in the smart wearable device, the second processor runs a second operating system, the smart wearable device includes a first processor running a first operating system, and the image switching display device includes:

[0134] Display module A100, used to display an image corresponding to the second operating system in a preset display interface;

[0135] A reading module A200, configured to read the preview frame image data stored in a data buffer when detecting that the target application in the first processor is triggered, wherein the data buffer is a data sharing area between the first operating system and the second operating system;

[0136] The preview switching display module A300 is used to perform preview switching display on the image displayed in the display interface according to the read preview frame image data.

[0137] The image switching display device provided in the embodiment of the present invention adopts the image switching display method of any one of the above-mentioned embodiments 1 to 4, and can realize the seamless switching of images in the AR dual system in the smart wearable device. Compared with the prior art, the beneficial effects of the image switching display device provided in the embodiment of the present invention are the same as the beneficial effects of the image switching display method provided in the above-mentioned embodiment, and other technical features in the image switching display device are the same as the features disclosed in the above-mentioned embodiment method, which will not be repeated here.

[0138] Embodiment 6

[0139] An embodiment of the present invention provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the image switching display method in the above-mentioned embodiment one.

[0140] Reference below Fig. 9 , which shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present disclosure. The electronic device in the embodiments of the present disclosure may include, but is not limited to, a mixed reality (Mixed Reality)-MR device, an augmented reality (Augmented Reality)-AR device, a virtual reality-(Virtual Reality)-VR device, an extended reality (Extended Reality)-XR device, or some combination thereof, and other smart wearable devices. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0141] like Fig. 9 As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device into a random access memory (RAM). In the RAM, various programs and data required for the operation of the electronic device are also stored. The processing device, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0142] Typically, the following systems can be connected to the I / O interface: input devices including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices including, for example, a magnetic tape, a hard disk, etc.; and communication devices. The communication device can allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an electronic device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.

[0143] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0144] The electronic device provided by the present invention adopts the image switching display method in the above embodiment to realize the seamless switching of images in the AR dual system in the smart wearable device. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of the present invention are the same as the beneficial effects of the image switching display method provided by the above embodiment, and the other technical features in the electronic device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0145] It should be understood that the various parts of the present disclosure can be implemented with hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0146] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

[0147] Embodiment 7

[0148] An embodiment of the present invention provides a readable storage medium, including a computer-readable storage medium having computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the image switching display method in the above embodiment.

[0149] The computer-readable storage medium provided in the embodiment of the present invention may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0150] The computer-readable storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0151] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device can execute each step in the above embodiment.

[0152] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0153] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0154] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0155] The computer-readable storage medium provided by the present invention stores computer-readable program instructions for executing the above-mentioned image switching display method, which can realize the seamless switching of images in the AR dual systems in the smart wearable device. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiment of the present invention are the same as the beneficial effects of the image switching display method provided by the above-mentioned embodiment 1 or embodiment 2, and will not be repeated here.

[0156] Embodiment 8

[0157] An embodiment of the present invention further provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, the steps of the image switching display method described above are implemented.

[0158] The computer program product provided by the present application can realize the seamless switching of images in the AR dual system in the smart wearable device. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present invention are the same as the beneficial effects of the image switching display method provided by any of the above embodiments, which will not be repeated here.

[0159] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims

1. An image switching display method, characterized in that: The image switching display method is applied to a smart wearable device, wherein the smart wearable device includes a first processor running a first operating system and a second processor running a second operating system. The image switching display method includes the following steps: When the first processor is in a dormant state, triggering a target application program through an application trigger instruction received by the first processor; Determining preview frame image data according to the triggered target application, and sending the preview frame image data to a preset data buffer for storage, wherein the data buffer is a data sharing area between the first operating system and the second operating system; The preview frame image data stored in the data buffer is read by the second processor, and the image displayed in the preset display interface is preview-switched and displayed according to the read preview frame image data.

2. The image switching display method according to claim 1, characterized in that: The preview frame image data includes image parameters of the preview frame image. The step of determining the preview frame image data according to the triggered target application and sending the preview frame image data to a preset data buffer for storage includes: Determining image parameters of the preview frame image to be acquired according to the triggered target application, wherein the image parameters include an image frame rate and an image size of the preview frame image; The image parameters are sent to a preset data buffer for storage.

3. The image switching display method according to claim 2, characterized in that: The preview frame image data includes a preview frame image, After the step of sending the image parameters to a preset data buffer for storage, the method further comprises: The preview frame image is acquired according to the triggered target application, and the preview frame image is sent to the data buffer for storage in association with the image parameters.

4. The image switching display method according to claim 3, characterized in that: The step of reading the preview frame image data stored in the data buffer by the second processor, and performing preview switching display on the image displayed in the preset display interface according to the read preview frame image data, comprises: Reading the image parameters stored in the data buffer through the second processor, and constructing a display framework according to the image parameters; The preview frame image stored in the data buffer in association with the image parameters is read by the second processor, and a target display image is constructed based on the display frame and the preview frame image, and a preview switching display of the image displayed in the preset display interface is performed based on the target display image.

5. The image switching display method according to claim 4, characterized in that: The step of constructing a display framework according to the image parameters comprises: Determining display parameters corresponding to a preset display interface, wherein the display parameters include a display size; The image parameters are adjusted according to the display parameters to obtain a display frame.

6. The image switching display method according to claim 1, characterized in that: After the step of reading the preview frame image data stored in the data buffer by the second processor and performing preview switching display on the image displayed in the preset display interface according to the read preview frame image data, the method further comprises: The state parameters of the target application are determined by the first operating system, and when it is detected that the state parameters are updated, the updated state parameters are sent to the second operating system, and the second operating system synchronously updates the displayed preview frame image data based on the received updated state parameters.

7. An image switching display method, characterized in that: The image switching display method is applied to a first processor in a smart wearable device, the first processor runs a first operating system, the smart wearable device includes a second processor running a second operating system, and the image switching display method includes the following steps: When the first processor is in a dormant state, triggering a target application program through a received application trigger instruction; Preview frame image data is determined based on the triggered target application, and the preview frame image data is sent to a preset data buffer for storage, so that the second processor reads the preview frame image data stored in the data buffer and performs preview switching display on the image displayed in the preset display interface, wherein the data buffer is a data sharing area between the first operating system and the second operating system.

8. An image switching display method, characterized in that: The image switching display method is applied to a second processor in a smart wearable device, the second processor runs a second operating system, the smart wearable device includes a first processor running a first operating system, and the image switching display method includes the following steps: Displaying an image corresponding to the second operating system in a preset display interface; Upon detecting that the target application in the first processor is triggered, reading the preview frame image data stored in the data buffer, wherein the data buffer is a data sharing area between the first operating system and the second operating system; The image displayed in the display interface is previewed and switched for display according to the read preview frame image data.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the image switching display method according to any one of claims 1 to 8.

10. A readable storage medium, characterized in that: The readable storage medium is a computer-readable storage medium, on which is stored a program for implementing the image switching display method, and the program for implementing the image switching display method is executed by a processor to implement the steps of the image switching display method as described in any one of claims 1 to 8.