Display method of smart watch, communication device and smart watch
Patent Information
- Application Number
- CN202380049291.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-12-30
- Filing Date
- 2023-11-27
- Publication Date
- 2025-02-18
Smart Images
Figure CN119487473A_ABST
Abstract
Description
Smart watch display method, communication device and smart watch
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on December 30, 2022, with application number 202211736251.7 and application name “A display method, communication device and smart watch for a smart watch”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the technical field of smart watches, and more specifically, to a display method, a communication device and a smart watch. Background Art
[0003] As smartwatches incorporate more and more applications and services, their battery life is becoming increasingly important. To improve battery life, most smartwatches currently include both an application processor and a coprocessor. Because the coprocessor consumes significantly less power than the application processor, the application processor can be put into a dormant state while certain services are running on the coprocessor, reducing the smartwatch's power consumption.
[0004] However, in related technologies, after receiving a user operation, the coprocessor sends the corresponding input information to the application processor, which then identifies and processes it. This ultimately results in a longer time to launch the corresponding service and a poor user experience.
[0005] Summary of the Invention
[0006] The present application provides a display method, a communication device and a smart watch for a smart watch, which recognize user operations through a coprocessor, and directly processes the services corresponding to the user operations that the coprocessor can handle, and sends the services corresponding to the user operations that cannot be handled to an application processor for processing, thereby solving the problem of slow service startup caused by the coprocessor directly sending the user operation data to the application processor.
[0007] In a first aspect, the present application provides a display method for a smartwatch, the smartwatch comprising an application processor and a coprocessor, wherein the power consumption of the coprocessor during operation is less than the power consumption of the application processor during operation. The method comprises: when the application processor is in a sleep state, the coprocessor determines a first service corresponding to a first operation of the user. When the first service is a service that the coprocessor can execute, the coprocessor executes the first service. When the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor, and when the application processor is in an awake state, the coprocessor sends the first service to the application processor. In response to a first instruction, the application processor executes the first service.
[0008] In the display method provided in the first aspect, the coprocessor determines the first service corresponding to the user's first operation based on the operation. After determining the service, the coprocessor can determine whether the service is executable by the coprocessor. If the service is executable by the coprocessor, it can be executed directly without waking up the application processor, thereby saving power. If the service cannot be executed by the coprocessor, the service is sent to the application processor, which quickly executes the first service based on the first instruction. This improves the problem of slow service startup and further enhances the user experience.
[0009] In one possible implementation of the first aspect, before the coprocessor determines the first service corresponding to the user's first operation, the method further includes: the coprocessor receiving input information of the user's first operation; and the coprocessor determining the user's first operation based on the input information of the user's first operation. In this implementation, after receiving the input information corresponding to the user's first operation, the coprocessor directly determines the type of the first operation based on the input information, rather than sending the input information corresponding to the first operation to the application processor for identification. This approach saves power consumption of the smartwatch.
[0010] In a possible implementation of the first aspect, the method further includes: the coprocessor determining whether a service corresponding to the first operation is in a preset list; if the service corresponding to the first operation is in the preset list, determining that the service corresponding to the first operation is a service executable by the coprocessor; and if the service corresponding to the first operation is not in the preset list, determining that the service corresponding to the first operation is a service not executable by the coprocessor. In this implementation, the coprocessor includes a preset list of executable services, and after the coprocessor determines the service, it can search the preset list to see whether the coprocessor can execute the service.
[0011] In one possible implementation of the first aspect, the first instruction is used to instruct the application processor to open the package name of the first service corresponding to the first operation. In this implementation, when the first instruction corresponds to the package name of the first service, the application processor can quickly open the service corresponding to the package name, thereby increasing the speed of opening the service.
[0012] In one possible implementation of the first aspect, when the first operation is a key operation, the input information includes a Down event and an Up event. After the coprocessor receives the Down event from the user, the coprocessor sends a wake-up message to the application processor. In this implementation, after the coprocessor receives the Down event, the coprocessor sends a wake-up message to the application processor. Because the application processor has already been awakened, upon receiving the first instruction sent by the coprocessor, the application processor directly executes the first service. This method improves service execution efficiency and further enhances the user experience.
[0013] In a possible implementation of the first aspect, the first operation includes a touch operation, and the touch operation includes any one of: clicking, long pressing, and sliding.
[0014] In a possible implementation of the first aspect, the first operation includes a key operation, and the key operation includes: any one of a single click, a double click, and a long press.
[0015] In a second aspect, the present application provides a display method for a smartwatch, the smartwatch including a coprocessor, the method comprising: the coprocessor determining a first service corresponding to a first operation of a user; when the first service is a service executable by the coprocessor, the coprocessor executing the first service; when the first service is a service not executable by the coprocessor, the coprocessor sending a wake-up message to an application processor. When the application processor is in an awake state, the coprocessor sending a first instruction to the application processor.
[0016] The display method provided by the second aspect is that the coprocessor determines the first service corresponding to the user's operation. After determining the service, the coprocessor can judge whether the service can be executed by the coprocessor. When the service coprocessor can execute it, it can be executed directly without waking up the application processor. When the service coprocessor cannot execute it, the service is sent to the application processor, thereby reducing the power consumption of the smart watch and further improving the user experience.
[0017] In a third aspect, a communication device is provided, which includes a unit for executing each step in the above first aspect or any possible implementation of the first aspect.
[0018] In a fourth aspect, a communication device is provided, which includes at least one processor and a memory, the processor and the memory are coupled, the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the method in the above first aspect or any possible implementation of the first aspect is executed.
[0019] In a fifth aspect, a communication device is provided, which includes at least one processor and an interface circuit, and the at least one processor is used to execute the method in the above first aspect or any possible implementation of the first aspect.
[0020] In a sixth aspect, a smart watch is provided, which includes an application processor and a coprocessor. The power consumption of the coprocessor during operation is less than the power consumption of the application processor during operation. The coprocessor is used to execute the method executed by the coprocessor in the above first aspect or any possible implementation of the first aspect, and the application processor is used to execute the method executed by the application processor in the above first aspect or any possible implementation of the first aspect.
[0021] In a seventh aspect, a computer program product is provided, which includes a computer program. When the computer program is executed by a processor, it is used to execute the method in the above first aspect or any possible implementation of the first aspect.
[0022] In an eighth aspect, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed, it is used to execute the method in the above first aspect or any possible implementation of the first aspect.
[0023] In the ninth aspect, a chip is provided, which includes: a processor for calling and running a computer program from a memory, so that a communication device equipped with the chip executes a method for executing the above first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] FIG1 shows a schematic structural diagram of a smartwatch according to an embodiment of the present application;
[0025] FIG2 shows a schematic diagram of an example of a smartwatch display interface provided by an embodiment of the present application;
[0026] FIG3 shows a schematic diagram of another example of a smartwatch display interface provided by an embodiment of the present application;
[0027] FIG4 shows a schematic diagram of another example of a smartwatch display interface provided by an embodiment of the present application;
[0028] FIG5 shows a schematic diagram of another example of a smartwatch display interface provided by an embodiment of the present application;
[0029] FIG6 shows a schematic diagram of the software architecture of a smartwatch in the related art;
[0030] FIG7 is a schematic diagram showing the time consumption of opening corresponding functions in the related art;
[0031] FIG8 is a schematic diagram showing the software architecture of a smartwatch according to an embodiment of the present application;
[0032] FIG9 shows a schematic diagram of an interface display of a smart watch provided in an embodiment of the present application;
[0033] FIG10 shows a schematic diagram of an interface display of a smart watch provided in an embodiment of the present application;
[0034] FIG11 shows a schematic diagram of an interface of another smart watch provided in an embodiment of the present application;
[0035] FIG12 is a schematic flowchart of a display method 1200 for a smart watch provided in an embodiment of the present application;
[0036] FIG13 is a schematic flowchart of another example of a display method 1300 for a smart watch provided in an embodiment of the present application;
[0037] FIG14 is a schematic diagram showing the structure of a smart watch 100 provided in an embodiment of the present application;
[0038] FIG15 shows a schematic diagram of a chip system. DETAILED DESCRIPTION
[0039] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application.
[0040] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be limiting of the present application. As used in the specification and appended claims of this application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one or more (including two); "and / or" describes the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship.
[0041] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0042] The "multiple" involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first" and "second" are only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance or order.
[0043] Currently, to extend the battery life of smartwatches, most smartwatches use a dual-processor architecture. Specifically, a smartwatch includes an application processor and a coprocessor, also known as a sensor hub. The coprocessor consumes less power than the application processor. Both the application processor and the coprocessor support key components such as the liquid crystal display (LCD) panel, touch panel (TP), and key. These components can be switched back and forth between the two processors based on business needs. This allows some business operations to be executed on the coprocessor while the application processor is dormant, thereby reducing the power consumption of the smartwatch and extending its battery life.
[0044] FIG1 shows a schematic structural diagram of an example of a smartwatch provided in an embodiment of the present application. As shown in FIG1 , the smartwatch includes an application processor, a coprocessor, and a touch screen / button. The application processor and the coprocessor are both electrically connected to the touch screen / button. The power consumption of the coprocessor during operation is less than that of the application processor during operation. The coprocessor can control the time, date, weather, calendar update and display, and can also support the operation of some sports function applications. When the coprocessor is in working state, the application processor is in sleep state, that is, the total power consumption of the smartwatch is reduced by the coprocessor with lower power consumption.
[0045] However, when the coprocessor is in a working state and the application processor is in a dormant state, some services cannot be implemented on the coprocessor or the implementation effect is poor. Therefore, it is necessary to switch the coprocessor to the application processor.
[0046] For example, when the coprocessor is in working state and the application processor is in sleep state, the user clicks the Power button on the main interface. Since the main menu service corresponding to clicking the Power button cannot be implemented on the coprocessor, it is necessary to switch from the coprocessor to the application processor to display the Launcher (main menu interface).
[0047] For example, FIG2 shows an interface diagram of a smartwatch display interface. As shown in FIG2 (a), the smartwatch is in the main interface. When the user wants to quickly open the main menu interface of the smartwatch, he can quickly enter the main menu interface of the smartwatch by clicking the Power button. As shown in FIG2, when the user clicks the Power button in the interface shown in FIG2 (a), the display interface of the smartwatch switches from the interface shown in FIG2 (a) to the interface shown in FIG2 (b). As shown in FIG2 (b), the interface displays the main menu interface of the smartwatch, wherein the main menu interface includes multiple applications.
[0048] For example, when the coprocessor is in working state and the application processor is in sleep state, the user clicks the Function key on the main interface. Since the multi-task list display service corresponding to clicking the Function key cannot be implemented on the coprocessor, it is necessary to switch from the coprocessor to the application processor to display the multi-task list.
[0049] Exemplarily, FIG3 shows another example of an interface diagram of a smartwatch display interface. As shown in FIG3 (a), the smartwatch is in the main interface. When the user wants to quickly open the multitasking list of the smartwatch, the user can click the Function key to enter the multitasking list interface of the smartwatch. As shown in FIG3, when the user clicks the Function key in the interface shown in FIG3, the display interface of the smartwatch switches from the interface shown in FIG3 (a) to the interface shown in FIG3 (b). As shown in FIG3 (b), the interface displays the multitasking list interface of the smartwatch. Exemplarily, the multitasking list may include WeChat, physical training, and phone applications.
[0050] For example, when the coprocessor is in working state and the application processor is in sleep state, the user long presses the Function key on the main interface. Since the voice assistant service corresponding to long pressing the Function key cannot be implemented on the coprocessor, it is necessary to switch from the coprocessor to the application processor to start the voice assistant function.
[0051] For example, Figure 4 shows an interface diagram of another example of a smart watch display interface. As shown in the interface in Figure 4 (a), the smart watch is in the main interface. When the user wants to quickly open the voice assistant of the smart watch, he can long press the Function key to enter the voice assistant interface of the smart watch. As shown in Figure 4, when the user long presses the Function key in the interface as shown in Figure 4 (a), the display interface of the smart watch switches from the interface shown in Figure 4 (a) to the interface shown in Figure 4 (b). As shown in Figure 4 (b), the interface displays the voice assistant interface of the smart watch, and the user can send corresponding voice commands to the smart watch through voice messages.
[0052] For example, when the coprocessor is in working state and the application processor is in sleep state, the user clicks on the call application on the touch screen of the main interface. Since the call application service cannot be implemented on the coprocessor, it is necessary to switch from the coprocessor to the application processor to start the call function.
[0053] Exemplarily, FIG5 shows another example of an interface diagram of a smartwatch display interface. As shown in FIG5 (a), the smartwatch is in the main interface. When the user wants to open the call application on the main interface, he can click the call application icon on the smartwatch display interface to enter the recent call interface of the call application. As shown in FIG5, when the user clicks the phone application icon in the interface shown in FIG5 (a), the display interface of the smartwatch switches from the interface shown in FIG5 (a) to the interface shown in FIG5 (b). As shown in FIG5 (b), the interface displays the recent call interface of the phone application. Exemplarily, the recent call interface includes call records of MOM, Xiao Li and Xiao Wang. As shown in FIG5 (c), the user can further click MOM to make a voice call.
[0054] The following describes in detail how the coprocessor in the related art switches to the application processor to open the corresponding service after receiving a user operation (key operation or touch screen operation) in combination with the scenarios shown in Figures 2, 3, 4 and 5.
[0055] When the user clicks a button on the smartwatch, the coprocessor first saves the button data and then wakes up the application processor. After the coprocessor wakes up the application processor, the application processor sends a message to the coprocessor, informing the coprocessor that the application processor is ready to take over the button operation or touch screen operation, and then the coprocessor sends the cached button data to the application processor. After receiving the button data, the application processor determines the button type based on the button data, such as single-click, double-click, or long press, and then determines the button event (service) based on the button type. For example, when the user clicks the Power button, the corresponding event is to pull up the main interface of the smartwatch, the user clicks the Function key, the corresponding event is to pull up the multi-tasking display function of the smartwatch, or the user long presses the Function key, the corresponding event is to pull up the voice assistant function of the smartwatch. After the application processor determines the button event, it pulls up the corresponding function according to the button event.
[0056] For example, FIG6 shows a schematic diagram of the software architecture of a smartwatch in the related art. As shown in FIG6 , when the coprocessor is in working state and the application processor is in sleep state, the button function or touch function of the smartwatch is switched to the coprocessor. When the user clicks the Power button on the smartwatch, the Key in the Key driver collects the user's button operation on the smartwatch and caches the button event. Then, the coprocessor sends a message to the application processor to wake up the application processor. After the application processor wakes up, the coprocessor sends the button data to the application processor. The application processor reports the corresponding button operation to the Event Hub.
[0057] It should be understood that the Event Hub is a highly scalable, distributed, time-series-based event center that can process streaming events in real time and provide alarms and reminders.
[0058] The Event Hub in the application processor determines the key event type based on the user's key press. The Input module reads the key event from the Event Hub and displays the corresponding event on the smartwatch's watch face. For example, this can display the main menu interface, multi-tasking display, SOS, or voice assistant functions.
[0059] For example, in conjunction with the interface diagram shown in Figure 2, Figure 7 illustrates a schematic diagram of the time it takes for an application processor to open the main menu interface in the related art. As shown in Figure 7, when a user clicks the Power button, the coprocessor caches key events (Down and Up events) and wakes up the application processor. The application processor's peripheral driver wakes up in 60ms. After the application processor receives the wake-up event from the coprocessor, the wake-up system begins switching, and the application processor sends a "ready" message to the coprocessor, indicating that the application processor can take over LCD / TP / Key operations. This process takes an average of 260ms. After receiving the "ready" message from the application processor, the coprocessor sends the cached Down and Up events to the application processor. The application processor takes 150ms to send the cached Down and Up events to the coprocessor. After receiving the Down and Up events, the application processor determines the key type of the key data, such as single-click, double-click, or long-press, based on the interval between the Down and Up events. For example, in the scenario shown in Figure 2, the key type is single-click. The application processor then determines the key event corresponding to the key type, i.e., the key event corresponding to the user clicking Power is displayed on the main interface.
[0060] Furthermore, the application processor opens the package name of the encapsulated main interface, which takes 80ms. Finally, the application processor switches the lock screen interface of the smart watch to the main interface display, which takes 350ms.
[0061] It can be seen that although the use of application processors and coprocessors can reduce the power consumption of smart watches, when the application processor is in sleep mode, it takes a lot of time to pull up the corresponding business of the application processor from the coprocessor, resulting in a reduced user experience. In addition, when the key events are transmitted through dual-core communication, there may be experiments in communication and system task scheduling. If there is an error in the interval between multiple consecutive key events, the application server will recognize that the time interval is different from the original time interval when reporting from the coprocessor to the application server, and it will be unable to accurately time the key type. For example, when there is an error in the time interval, a double-click event may be recognized as two single-click events, which will eventually lead to the problem of pulling up the service incorrectly.
[0062] In view of this, the present application provides a display method for a smart watch, which includes an application processor and a coprocessor, and the power consumption of the coprocessor when running is less than the power consumption of the application processor when running. When the coprocessor of the smart watch is in a working state and the application processor is in a dormant state, the user's first operation is received, and the first operation includes a key operation or a touch screen operation. The coprocessor determines the business corresponding to the first operation based on the user's first operation, and determines whether the business coprocessor can handle it. When the business coprocessor can handle it, it processes it directly. When the business coprocessor cannot handle it, a wake-up message is sent to the application processor and the business is sent to the application processor. The method provided by the present application first identifies the user operation through the coprocessor, and directly processes the business that the coprocessor can handle, and sends the business corresponding to the user operation that cannot be processed to the application processor for processing, thereby solving the problem of slow business startup caused by the coprocessor directly sending the user's operation data to the application processor, and further improving the user experience.
[0063] In a possible application scenario, when a user wants to quickly open the main menu interface by pressing a button on the main interface, the display method of the smart watch provided in this application can be used.
[0064] In another possible application scenario, when the user wants to quickly open the multi-tasking display interface by pressing a button on the main interface, the display method of the smart watch provided in this application can be used.
[0065] In another possible application scenario, when the user wants to quickly turn on the voice call function through touch screen operation in the main interface, the display method of the smart watch provided in this application can be used.
[0066] Before introducing the display control method provided in the embodiment of the present application, the software architecture applicable to the embodiment of the present application is first described in detail. Figure 8 shows a schematic diagram of the software architecture of a smart watch provided in the embodiment of the present application. As shown in Figure 8, the smart watch includes: a touch panel (TP) / TP driver, an input module (i.e., an input framework), a UI module (i.e., a UI framework), a display module (i.e., a display framework), and a hardware display module.
[0067] When the coprocessor is in working state and the application processor is in sleep state, the button function or touch function of the smart watch is switched to the coprocessor. When the user's finger (or the user uses a touch object such as a stylus) touches the TP of the smart watch, the TP in the TP driver collects the user's touch operation on the smart watch, and then the TP driver reports the corresponding touch operation to the Event Hub.
[0068] Alternatively, after the user clicks a button on the smartwatch, the Key driver collects the user's click operation on the smartwatch (single-click operation, double-click operation, or long press operation), and then the Key driver reports the corresponding button operation to the Event Hub.
[0069] As the event center, Event Hub determines the corresponding touch events or key events based on touch operations or key operations.
[0070] The Input module can read touch events or key events from the Event Hub. In this embodiment of the present application, after the coprocessor's Input module reads a touch event or key event, the coprocessor queries the application package name management server to see whether the touch event or key event is executable by the coprocessor.
[0071] One situation is: when the touch event or key event is executable by the coprocessor, the Input module in the coprocessor uploads the touch event or key event to the UI module. The UI module in the coprocessor starts drawing one or more layers corresponding to the touch event or key event. The synthesis thread in the Display module synthesizes the drawn one or more layers to obtain an image frame. The liquid crystal display panel (Liquid Crystal Display, LCD) driver of the hardware display module can receive the synthesized image frame, and the synthesized image frame is displayed by the LCD. After the LCD displays the image frame, the image displayed by the LCD can be perceived by the user.
[0072] For example, FIG9 shows a schematic diagram of the interface display of a smartwatch provided by an embodiment of the present application. As shown in FIG9 , the smartwatch is in the main interface. When the user wants to open the heart rate application on the main interface, they can click the heart rate application icon on the smartwatch display interface. The TP in the TP driver collects the user's touch operation on the heart rate application, and then the TP driver reports the corresponding touch operation to the Event Hub. The Event Hub, as the event center, determines the corresponding touch event based on the touch operation. That is, the Event Hub determines that the application the user wants to open is a heart rate application event based on the user's touch operation. After the input module reads the touch event, it determines whether the touch event is an event that the coprocessor can execute. When the input module determines that the heart rate application event is an event that the coprocessor can process, the input module uploads the heart rate event to the UI module of the coprocessor. The UI module draws one or more layers corresponding to the heart rate event. After the drawing is completed, the display module synthesizes the image frame to be displayed. Finally, the coprocessor controls the LCD to display the synthesized heart rate application interface.
[0073] Referring to FIG9 , when a user clicks the heart rate application icon in the interface shown in FIG9 (a), the coprocessor controls the smartwatch's display interface to switch from the interface shown in FIG9 (a) to the interface shown in FIG9 (b). As shown in FIG9 (b), the interface displays the user's current heart rate index interface. For example, the user's current heart rate is 84 beats per minute.
[0074] Another situation is: if the coprocessor cannot execute the touch event or key event, the coprocessor needs to send a message to the application processor to wake up the application processor. After the application processor wakes up, the coprocessor sends the package name of the touch event or key event read in the Input to the application processor. After the UI module in the application processor receives the package name of the touch event or key event, the UI module in the application processor starts to draw one or more layers corresponding to the touch event or key event. The synthesis thread in the Display framework in the application processor synthesizes the drawn one or more layers to obtain an image frame. Finally, the LCD driver of the hardware display module in the application processor receives the synthesized image frame, and the application processor finally drives the LCD to display the synthesized image frame.
[0075] For example, Figure 10 shows a schematic diagram of the interface display of a smartwatch provided by an embodiment of the present application. As shown in Figure 10 (a), the smartwatch is in the heart rate application interface. When the user wants to open the menu interface, they can double-click the smartwatch's Power button. The Key in the Key driver collects the user's key press on the Power button, and then the Key driver reports the corresponding key press to the Event Hub. The Event Hub, as the event center, determines the corresponding touch event based on the key press. That is, the Event Hub determines that the user wants to open the main menu interface based on the user's key press. After the Input module reads the main menu open event, it determines whether the main menu open event is an event that the coprocessor can execute. When the Input module determines that the main menu open event cannot be processed by the coprocessor, the coprocessor needs to send a message to the application processor to wake up the application processor. After the application processor wakes up, the coprocessor sends the package name of the main menu event read from the Input to the application processor. After the UI module in the application processor receives the package name of the main menu event, the UI module draws one or more layers corresponding to the main menu interface. After the drawing is completed, the Display module synthesizes the image frames to be displayed. Finally, the application processor controls the LCD to display the synthesized main menu interface.
[0076] Referring to Figure 10 , when a user double-clicks the Power button in the interface shown in Figure 10 (a), the smartwatch's display interface switches from the interface shown in Figure 10 (a) to the interface shown in Figure 10 (b) under the control of the application processor. As shown in Figure 10 (b), the interface displays the main menu interface, which includes multiple applications, which will not be described in detail here.
[0077] For another example, FIG11 shows a schematic diagram of the interface of another smartwatch provided by an embodiment of the present application. As shown in FIG11 (a), the smartwatch is in the main interface. When the user wants to quickly open the payment code of the payment software, he or she can long press the payment software application icon on the main interface. The TP in the TP driver collects the user's touch operation on the payment software application icon, and then the TP driver reports the corresponding touch operation to the Event Hub. The Event Hub, as the event center, determines the corresponding touch event based on the touch operation. That is, the Event Hub determines that the user wants to open the payment code of the payment software based on the user's touch operation. After the Input module reads the payment code event of opening the payment software, it determines whether the payment code event of opening the payment software is an event that can be executed by the coprocessor. When the Input module determines that the coprocessor cannot handle the payment code event of opening the payment software, the coprocessor needs to send a message to the application processor to wake up the application processor. After the application processor wakes up, the coprocessor sends the package name of the payment code of the payment software read in the Input to the application processor. After the UI module in the application processor receives the package name of the payment code event of the payment software, the UI module draws one or more layers corresponding to the payment code interface of the payment software. After the drawing is completed, the Display module synthesizes the image frame to be displayed. Finally, the application processor controls the LCD to display the synthesized payment code interface of the payment software.
[0078] The display method of the smart watch provided by the embodiment of the present application will be described in detail below with reference to the accompanying drawings.
[0079] FIG12 is a schematic flow chart of a display method 1200 for a smartwatch according to an embodiment of the present application. As shown in FIG12 , the method 1200 shown in FIG12 may include steps S1210 to S1250. Each step in the method 1200 is described in detail below in conjunction with FIG12 .
[0080] It should be understood that in the embodiments of the present application, a smartwatch is used as an example to illustrate method 1200. As an example and not a limitation, the execution subject of method 1200 may also be a chip used in a smartwatch.
[0081] S1210: When the application processor is in a dormant state, the coprocessor determines a first service corresponding to a first operation of the user.
[0082] In an embodiment of the present application, when the coprocessor of the smart watch is in a working state and the application processor is in a dormant state, the coprocessor determines the service corresponding to the first operation according to the user's first operation.
[0083] Optionally, before determining the first service corresponding to the first operation, the coprocessor first receives input information of the user's first operation, and then the coprocessor determines the user's first operation according to the input information of the user's first operation.
[0084] In some embodiments, the coprocessor may obtain input information of the user's first operation in real time through a touch sensor in the touch screen. The input information may include coordinate information corresponding to one or more target pixel points.
[0085] When the coprocessor obtains coordinate information of multiple target pixel points, the coprocessor may determine that the first operation is a sliding operation or a long press operation. When the coprocessor obtains coordinate information of a single target pixel point, the coprocessor may determine that the first operation is a click operation.
[0086] That is, the first operation of the user may be a touch operation, which is at least one of a click operation, a slide operation, or a long press operation.
[0087] In other embodiments, the coprocessor may obtain input information of the user's first operation in real time by pressing a key, and the input information may include a Down event and an Up event.
[0088] If the coprocessor receives an Up event within a preset first time period after a Down event, the first operation is a single-click operation. If the coprocessor receives two Down events and two Up events within a preset second time period, the first operation is a double-click operation. If the coprocessor receives an Up event within a preset third time period after a Down event, the first operation is a long-press operation.
[0089] Exemplarily, the preset first time period can be 100ms, the preset second time period can be 150ms, and the preset third time period can be 200ms. Of course, the preset first time period, the preset second time period and the preset third time period can also be other values, which are not limited in the embodiments of the present application.
[0090] That is, the first operation of the user may also be a key operation of the user, and the key operation may be a single-click operation, a double-click operation, or a long-press operation.
[0091] After determining the first operation according to the input information of the user's first operation, the coprocessor may determine a service corresponding to the first operation according to the first operation.
[0092] For example, as shown in FIG. 2 (a), after the user clicks the Power key, the coprocessor may determine, based on the operation, that the corresponding service is the main menu opening service as shown in FIG. 2 (b).
[0093] For another example, as shown in FIG. 3 (a), after the user clicks the Function key, the coprocessor may determine, based on the operation, that the corresponding service is the multi-task display service as shown in FIG. 3 (b).
[0094] For another example, as shown in Figure 4 (a), when the user long presses the Function key, the coprocessor can determine that the corresponding service is the voice assistant service as shown in Figure 4 (b) based on the operation.
[0095] For another example, as shown in FIG5 (a), after the user clicks the voice call icon, the coprocessor may determine, based on the operation, that the corresponding service is the voice call service as shown in FIG5 (b).
[0096] For another example, as shown in FIG9 (a), after the user clicks the heart rate detection icon, the coprocessor may determine, based on the operation, that the corresponding service is the heart rate detection service as shown in FIG9 (b).
[0097] For another example, as shown in FIG10 (a), when the user clicks the Power button in the heart rate detection interface, the coprocessor can determine that the corresponding service is the main menu opening service as shown in FIG10 (b) based on the operation.
[0098] For another example, as shown in FIG11 (a), when the user long presses the payment software application icon, the coprocessor can determine that the corresponding service is the payment code service as shown in FIG11 (b) based on the operation.
[0099] S1220: When the first service is a service executable by the coprocessor, the coprocessor executes the first service.
[0100] In an embodiment of the present application, in order to reduce the power consumption of the smart watch and to quickly open the service corresponding to the first operation, when the first operation is an operation executable by the coprocessor, the coprocessor directly executes the first operation.
[0101] In some embodiments, before the coprocessor executes a first operation, the coprocessor may determine whether a service corresponding to the first operation is in a preset list. If the service corresponding to the first operation is in the preset list, the coprocessor determines that the service corresponding to the first operation is a service that the coprocessor can execute; if the service corresponding to the first operation is not in the preset list, the coprocessor determines that the service corresponding to the first operation is a service that the coprocessor cannot execute.
[0102] For example, the coprocessor can determine whether the heart rate detection service in FIG9 is in the preset list. If the heart rate detection service is in the preset list, it means that the heart rate detection service is a service that the coprocessor can execute. Then, the coprocessor can directly execute the heart rate detection service.
[0103] Optionally, the preset list may be a list of service package names corresponding to multiple services pre-stored in a service package name management server.
[0104] S1230: When the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor.
[0105] In an embodiment of the present application, in order to reduce the power consumption of the smart watch, the application processor is generally in a sleep state. When the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor. After waking up the application processor, the coprocessor is used to process the first service.
[0106] As described in step S1220 , when the coprocessor determines that the first service corresponding to the first operation is not in the preset list, indicating that the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor.
[0107] For example, the coprocessor can determine whether the service of opening the main menu as shown in Figure 2 is in the preset list. When the service of opening the main menu is not in the preset list, it means that the service of opening the main menu is a service that the coprocessor cannot execute, and the coprocessor sends a wake-up message to the application processor.
[0108] For another example, the coprocessor can determine whether the multitasking display service shown in Figure 3 is in the preset list. When the multitasking display service is not in the preset list, it means that the multitasking display service is a service that the coprocessor cannot execute, and the coprocessor sends a wake-up message to the application processor.
[0109] For another example, the coprocessor can determine whether the voice assistant service in Figure 4 is in the preset list. When the voice assistant service is not in the preset list, it means that the voice assistant service is a service that the coprocessor cannot execute, and the coprocessor sends a wake-up message to the application processor.
[0110] For another example, the coprocessor can determine whether the payment code service in Figure 11 is in the preset list. When the payment code service is not in the preset list, it means that the payment code service is a service that the coprocessor cannot execute, and the coprocessor sends a wake-up message to the application processor.
[0111] S1240: When the application processor is in the awake state, the coprocessor sends a first instruction to the application processor.
[0112] After the application processor receives the wake-up message from the coprocessor, when the application processor is in the awake state, the coprocessor sends a first instruction to the application processor, where the first instruction is used to instruct the application processor to execute a first service corresponding to the first operation.
[0113] For example, as shown in FIG2 , the coprocessor sends a first instruction to the application processor, where the first instruction instructs the application processor to execute a service of opening a main menu.
[0114] For example, as shown in FIG3 , the coprocessor sends a first instruction to the application processor, where the first instruction instructs the application processor to execute a multi-task display service.
[0115] For another example, as shown in FIG4 , the coprocessor sends a first instruction to the application processor, where the first instruction instructs the application processor to execute a voice assistant service.
[0116] Optionally, as a possible implementation, when the preset list may be a list of service package names corresponding to multiple services pre-stored in a service package name management server, the first instruction may also be used to instruct the application processor to open the package name of the service corresponding to the first operation. In this implementation, the coprocessor directly sends the package name of the service corresponding to the first operation to the application processor, allowing the application processor to quickly execute the first service without performing other operations, further improving the efficiency of executing the service.
[0117] S1250: In response to the first instruction, the application processor executes a first service corresponding to the first operation.
[0118] Based on the first instruction, the application processor executes the first service corresponding to the first operation. When the first instruction instructs the application processor to execute the first service corresponding to the first operation, the application processor searches for the application package name corresponding to the first service according to the first instruction and finally executes the first service corresponding to the first operation.
[0119] Optionally, when the first instruction is a package name instructing the application processor to execute a first service corresponding to the first operation, the application processor directly executes the first service corresponding to the first operation.
[0120] For example, as shown in FIG. 2( a ), in response to the first instruction sent by the coprocessor, the application processor executes the main menu opening service as shown in FIG. 2( b ).
[0121] For another example, as shown in FIG. 3 (a), in response to the first instruction sent by the coprocessor, the application processor executes the multi-tasking display service as shown in FIG. 3 (b).
[0122] For another example, as shown in FIG. 4 (a), in response to the first instruction sent by the coprocessor, the application processor executes the voice assistant service as shown in FIG. 4 (b).
[0123] For another example, as shown in FIG. 5 (a), in response to the first instruction sent by the coprocessor, the application processor executes the voice call service as shown in FIG. 5 (b).
[0124] For another example, as shown in FIG. 9 (a), in response to the first instruction sent by the coprocessor, the application processor executes the heart rate detection service as shown in FIG. 9 (b).
[0125] For another example, as shown in FIG. 10 ( a ), in response to the first instruction sent by the coprocessor, the application processor executes the main menu opening service as shown in FIG. 10 ( b ).
[0126] For another example, as shown in FIG. 11 (a), in response to the first instruction sent by the coprocessor, the application processor executes the payment code service as shown in FIG. 11 (b).
[0127] The present application provides a display method for a smartwatch, which includes an application processor and a coprocessor. When the coprocessor of the smartwatch is in a working state and the application processor is in a dormant state, the coprocessor determines a first service corresponding to a first operation of the user; in order to reduce the power consumption of the smartwatch, when the first service is a service that the coprocessor can execute, the coprocessor executes the first service; when the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor; when the application processor is in a wake-up state, the coprocessor sends a first instruction to the application processor; in response to the first instruction, the application processor executes the first service. The method provided by the present application is that when the coprocessor can execute a service, the coprocessor executes it, and when the coprocessor cannot execute a service, the application processor wakes up and executes it, thereby solving the problem in the related art that all services need to be sent to the application processor before the corresponding service can be executed, resulting in a long time consumption, thereby improving the speed of service execution and further improving the user experience.
[0128] In order to further improve the speed of opening the first service, the present application also provides another example of a display method for a smart watch. In this method, when the first operation is a touch operation, the input information of the first operation includes a Down event and an Up event. When the coprocessor receives the user's Down event, the coprocessor immediately sends a wake-up message to the application processor. At the same time, the coprocessor determines the first service corresponding to the user's first operation based on the user's input information. When the first service is a service that the coprocessor can execute, the coprocessor executes the first service. When the first service is a service that the coprocessor cannot execute, the coprocessor sends a first instruction to the application processor. In response to the first instruction, the application processor executes the first service. In this method, since the application processor has been awakened in advance, when the application processor receives the first instruction sent by the coprocessor, it directly executes the first service. This method improves the efficiency of service execution and further improves the user experience.
[0129] The following will describe in detail another example of a display method for a smart watch provided by an embodiment of the present application in conjunction with FIG13 .
[0130] FIG13 shows a schematic flow chart of a display method 1300 for a smartwatch according to an embodiment of the present application. As shown in FIG13 , the method 1300 shown in FIG13 may include steps S1310 to S1350. Each step in the method 1300 is described in detail below in conjunction with FIG13 .
[0131] It should be understood that in the embodiment of the present application, a smartwatch is used as an example to illustrate method 1300. As an example and not a limitation, the execution subject of method 1300 may also be a chip used in a smartwatch.
[0132] S1310: When the application processor is in a dormant state and the coprocessor receives a Down event in input information of a first operation of the user, the coprocessor sends a wake-up message to the application processor, where the first operation is a key operation and the input information includes a Down event and an Up event.
[0133] In an embodiment of the present application, when the application processor is in a sleep state and the coprocessor is in a working state, after the coprocessor receives a Down event from the user, the coprocessor sends a wake-up message to the application processor to wake up the application processor.
[0134] S1320: The coprocessor determines a first service corresponding to the user's first operation according to input information of the user's first operation.
[0135] S1330: When the first service is a service executable by the coprocessor, the coprocessor executes the first service.
[0136] The description of steps S1320 to S1330 can refer to the description of steps S1210 to S1220 above, which will not be repeated here.
[0137] S1340: When the first service is a service that the coprocessor cannot execute and the application processor is in an awake state, the coprocessor sends a first instruction to the application processor.
[0138] In step S1340, because the application processor is awakened in advance, if the first service is not executable by the coprocessor, the coprocessor can directly send the first instruction to the application processor. This eliminates the need to awaken the application processor after the coprocessor determines that the first service cannot be executed. This saves time and improves service execution efficiency.
[0139] S1350: In response to the first instruction, the application processor executes a first service corresponding to the first operation.
[0140] The description of step S1350 can refer to the description of the above step S1250 and will not be repeated here.
[0141] Another example of a display method for a smart watch provided in the present application is that when the coprocessor receives a Down event from the user, it sends a wake-up message to the application processor and simultaneously receives input information of the user's first operation. According to the first service corresponding to the first operation, when the first service is a service that the coprocessor can execute, since the coprocessor is in a working state, the coprocessor can execute it directly. When the first service is a service that the coprocessor cannot execute, since the application processor has been awakened in advance, when the application processor receives the first instruction sent by the coprocessor, it directly executes the first service. This method improves the efficiency of service execution and further improves the user experience.
[0142] The above description of the display method of the smart watch provided by the embodiment of the present application in combination with Figures 3 to 13 describes an embodiment of the display method of the smart watch provided by the embodiment of the present application. The following describes the smart watch provided by the embodiment of the present application.
[0143] Figure 14 is a schematic diagram of the structure of an example of a smart watch 100 provided in the present application. The smart watch 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0144] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the smartwatch 100. In other embodiments of the present application, the smartwatch 100 may include more or fewer components than illustrated, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0145] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a coprocessor, a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0146] The controller may be the nerve center and command center of the smartwatch 100. The controller may generate an operation control signal based on the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0147] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0148] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0149] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, allowing the processor 110 and the touch sensor 180K to communicate via the I2C bus interface, thereby implementing the touch function of the smart watch 100.
[0150] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.
[0151] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0152] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.
[0153] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the camera function of the smart watch 100. The processor 110 and the display 194 communicate via the DSI interface to enable the display function of the smart watch 100.
[0154] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0155] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the smartwatch 100 and to transfer data between the smartwatch 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other smartwatches, such as AR devices.
[0156] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is only for illustrative purposes and does not constitute a structural limitation on the smart watch 100. In other embodiments of the present application, the smart watch 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0157] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the smartwatch 100. While charging the battery 142, the charging management module 140 can also provide power to the smartwatch via the power management module 141.
[0158] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0159] The wireless communication function of the smart watch 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.
[0160] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in smartwatch 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0161] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the smart watch 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0162] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0163] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the smart watch 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0164] In some embodiments, the antenna 1 of the smart watch 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the smart watch 100 can communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TDSCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0165] Smartwatch 100 implements display functionality through a GPU, display 194, and an application processor. The GPU is a microprocessor for image processing that connects display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and render graphics. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0166] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the smart watch 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0167] The smart watch 100 can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.
[0168] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0169] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the smart watch 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0170] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the smart watch 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0171] Video codecs are used to compress or decompress digital video. Smartwatch 100 can support one or more video codecs. This allows the smartwatch 100 to play or record videos in a variety of encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0172] The NPU is a neural network (NN) computing processor that rapidly processes input information and continuously self-learns by drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain. The NPU enables intelligent cognitive applications such as image recognition, face recognition, voice recognition, and text comprehension in the smartwatch 100.
[0173] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the smartwatch 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0174] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the smart watch 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the smart watch 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0175] The smartwatch 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0176] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0177] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. The smart watch 100 can listen to music or make hands-free calls through the speaker 170A.
[0178] The receiver 170B, also called an "earpiece," is used to convert audio electrical signals into sound signals. When the smartwatch 100 receives a call or voice message, the user can place the receiver 170B close to the ear to hear the voice.
[0179] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The smart watch 100 can be provided with at least one microphone 170C. In other embodiments, the smart watch 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the smart watch 100 can also be provided with three, four or more microphones 170C to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.
[0180] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D can be the USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0181] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. The smartwatch 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, the smartwatch 100 detects the touch intensity based on pressure sensor 180A. The smartwatch 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.
[0182] The gyroscope sensor 180B can be used to determine the motion posture of the smart watch 100. In some embodiments, the angular velocity of the smart watch 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for shooting anti-shake. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the smart watch 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the smart watch 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0183] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the smartwatch 100 uses the air pressure value measured by the air pressure sensor 180C to calculate the altitude to assist in positioning and navigation.
[0184] Magnetic sensor 180D includes a Hall effect sensor. Smartwatch 100 can use magnetic sensor 180D to detect the opening and closing of a flip case. In some embodiments, when smartwatch 100 is a flip-top device, the smartwatch 100 can detect the opening and closing of the flip cover based on magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.
[0185] Accelerometer 180E can detect the magnitude of acceleration of the smartwatch 100 in all directions (generally three axes). When the smartwatch 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the smartwatch's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0186] Distance sensor 180F is used to measure distance. Smartwatch 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, smartwatch 100 can use distance sensor 180F to measure distance for fast focusing.
[0187] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The smart watch 100 emits infrared light outward through the light emitting diode. The smart watch 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the smart watch 100. When insufficient reflected light is detected, the smart watch 100 can determine that there is no object near the smart watch 100. The smart watch 100 can use the proximity light sensor 180G to detect when the user holds the smart watch 100 close to the ear to make a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0188] The ambient light sensor 180L is used to sense ambient light brightness. The smartwatch 100 can adaptively adjust the brightness of the display 194 based on the perceived ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking photos. The ambient light sensor 180L can also work with the proximity light sensor 180G to detect whether the smartwatch 100 is in a pocket to prevent accidental touches.
[0189] The fingerprint sensor 180H is used to collect fingerprints. The smart watch 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0190] Temperature sensor 180J is used to detect temperature. In some embodiments, the smart watch 100 uses the temperature detected by temperature sensor 180J to implement a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, the smart watch 100 reduces the performance of a processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is below another threshold, the smart watch 100 heats the battery 142 to prevent the smart watch 100 from shutting down abnormally due to low temperatures. In other embodiments, when the temperature is below yet another threshold, the smart watch 100 boosts the output voltage of the battery 142 to prevent the smart watch 100 from shutting down abnormally due to low temperatures.
[0191] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied on or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the smart watch 100, in a location different from that of the display screen 194.
[0192] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals from the vibrating bones of the human body. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulse signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bones of the human body obtained by the bone conduction sensor 180M to implement voice functions. The application processor can parse heart rate information based on the blood pressure pulse signals obtained by the bone conduction sensor 180M to implement heart rate detection functions.
[0193] The buttons 190 include a power button, a volume button, etc. The buttons 190 can be mechanical buttons or touch buttons. The smart watch 100 can receive key inputs and generate key signal inputs related to user settings and function control of the smart watch 100.
[0194] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0195] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.
[0196] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and disconnected from the smart watch 100 by inserting or removing it from the SIM card interface 195. The smart watch 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The smart watch 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the smart watch 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the smart watch 100 and cannot be separated from the smart watch 100.
[0197] It should be understood that the specific process of the smart watch 100 executing the above corresponding steps can be referred to the relevant description of the smart watch execution steps described in the various embodiments described above. For the sake of brevity, it is not repeated here.
[0198] This embodiment can also divide the functional modules of the smartwatch according to the above method. For example, each function can be divided into different functional modules, or two or more functions can be integrated into a single processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the module division in this embodiment is schematic and only represents a logical functional division. In actual implementation, other division methods may be used.
[0199] It should be noted that the relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.
[0200] The embodiment of the present application also provides a chip system, as shown in Figure 15, which includes at least one processor 1501 and at least one interface circuit 1502. The processor 1501 and the interface circuit 1502 can be interconnected via lines. For example, the interface circuit 1502 can be used to receive signals from other devices (such as the memory of the above-mentioned smart watch). For another example, the interface circuit 1502 can be used to send signals to other devices (such as the processor 1501). Exemplarily, the interface circuit 1502 can read the instructions stored in the memory and send the instructions to the processor 1501. When the instructions are executed by the processor 1501, the smart watch can execute the various steps executed by the smart watch in the above-mentioned embodiment. Of course, the chip system can also include other discrete components, which is not specifically limited in the embodiment of the present application.
[0201] It should also be understood that the division of units in the above device is merely a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. Moreover, the units in the device can all be implemented in the form of software called through processing elements; or all be implemented in the form of hardware; or some units can be implemented in the form of software called through processing elements, and some units can be implemented in the form of hardware. For example, each unit can be a separately established processing element, or it can be integrated into a certain chip of the device. In addition, it can also be stored in a memory in the form of a program, and called by a certain processing element of the device to execute the function of the unit. Here, the processing element can also be called a processor, which can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each unit above can be implemented by the integrated logic circuit of the hardware in the processor element or in the form of software called through the processing element. In one example, the unit in any of the above devices may be one or more integrated circuits configured to implement the above method, such as one or more application specific integrated circuits (ASICs), or one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms. For another example, when the unit in the device can be implemented in the form of a processing element scheduler, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call a program. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0202] The present application also provides an apparatus, which is included in a smartwatch (e.g., a first smartwatch or a second smartwatch), and has the function of implementing the smartwatch behavior described in any of the above embodiments. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function.
[0203] The present application also provides a smart watch, which includes the device provided in the above-mentioned embodiment of the present application.
[0204] The present application also provides a computer-readable storage medium for storing computer program code, wherein the computer program includes instructions for executing the steps of the smartwatch executing the display interface in any of the embodiments provided above. The readable medium may be a read-only memory (ROM) or a random access memory (RAM), which is not limited in the present application.
[0205] The present application also provides a computer program product, which includes instructions. When the instructions are executed, the smart watch executes the steps of executing or displaying the interface of the smart watch in any of the above embodiments.
[0206] The present application also provides a chip comprising a processing unit and a communication unit. The processing unit may be, for example, a processor, and the communication unit may be, for example, an input / output interface, a pin, or a circuit. The processing unit may execute computer instructions to cause a smartwatch to perform any of the smartwatch display methods provided in the embodiments of the present application.
[0207] Optionally, the computer instructions are stored in a storage unit.
[0208] Optionally, the storage unit is a storage unit within the chip, such as a register, a cache, etc. The storage unit may also be a storage unit located outside the chip within the terminal, such as a ROM or other type of static storage device that can store static information and instructions, random access RAM, etc. The processor mentioned in any of the above may be a CPU, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the display method of the above-mentioned smart watch. The processing unit and the storage unit may be decoupled and respectively provided on different physical devices, and connected by wired or wireless means to implement the respective functions of the processing unit and the storage unit, so as to support the system chip to implement the various functions in the above-mentioned embodiments. Alternatively, the processing unit and the memory may also be coupled on the same device.
[0209] Among them, the smart watch, device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0210] An embodiment of the present application also provides a graphical user interface on a smart watch, the smart watch having a display screen, a camera, a memory, and one or more processors, the one or more processors being used to execute one or more computer programs stored in the memory, the graphical user interface including a graphical user interface displayed when the smart watch executes the steps performed by the smart watch in any of the above embodiments.
[0211] It is understandable that, in order to realize the above functions, the above-mentioned smart watches and the like include hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.
[0212] In the embodiment of the present application, the functional modules of the smartwatch and the like can be divided according to the above-mentioned method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical functional division. In actual implementation, there may be other division methods.
[0213] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0214] The functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0215] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.
[0216] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A display method for a smart watch, characterized in that: The smartwatch includes an application processor and a coprocessor, the power consumption of the coprocessor when running is less than the power consumption of the application processor when running, and the method includes: When the application processor is in a dormant state, the coprocessor determines a first service corresponding to a first operation of a user; When the first service is a service executable by the coprocessor, the coprocessor executes the first service; When the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor; When the application processor is in an awake state, the coprocessor sends a first instruction to the application processor; In response to the first instruction, the application processor executes the first service.
2. A display method for a smart watch, characterized in that: The smartwatch includes a coprocessor, and the method includes: The coprocessor determines a first service corresponding to a first operation of the user; When the first service is a service executable by the coprocessor, the coprocessor executes the first service; When the first service is a service that the coprocessor cannot execute, the coprocessor sends a wake-up message to the application processor; When the application processor is in an awake state, the coprocessor sends a first instruction to the application processor.
3. The display method according to claim 1 or 2, characterized in that: Before the coprocessor determines the first service corresponding to the first operation of the user, the method further includes: The coprocessor receives input information of a first operation of the user; The coprocessor determines a first operation of the user according to input information of the first operation of the user.
4. The display method according to any one of claims 1 to 3, characterized in that: The method further comprises: determining, by the coprocessor, whether a service corresponding to the first operation is in a preset list; If the service corresponding to the first operation is in a preset list, determining that the service corresponding to the first operation is a service executable by the coprocessor; If the service corresponding to the first operation is not in the preset list, it is determined that the service corresponding to the first operation is a service that cannot be executed by the coprocessor.
5. The display method according to any one of claims 1 to 4, characterized in that: The first instruction is used to instruct the application processor to open the package name of the first service corresponding to the first operation.
6. The display method according to claim 3, wherein: When the first operation is a key operation, the input information includes: a Down event and an Up event. After the coprocessor receives the Down event from the user, the coprocessor sends a wake-up message to the application processor.
7. The display method according to any one of claims 1 to 6, characterized in that: The first operation includes a touch operation, and the touch operation includes any one of: clicking, long pressing, and sliding.
8. The display method according to any one of claims 1 to 7, characterized in that: The first operation includes a key operation, and the key operation includes any one of single-click, double-click, and long press.
9. A communication device, characterized in that: The method comprises means for executing the steps of the method according to any one of claims 1 to 8.
10. A smart watch, characterized in that: The smart watch includes an application processor and a coprocessor, the power consumption of the coprocessor when running is less than the power consumption of the application processor when running, the coprocessor is used to execute the method executed by the coprocessor as claimed in any one of claims 1 to 8, and the application processor is used to execute the method executed by the application processor as claimed in any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 8.
12. A chip, characterized in that: include: A processor, configured to call and run a computer program from a memory, so that a communication device equipped with the chip executes the method according to any one of claims 1 to 8.