A display method and related equipment
By using a combination of long and short connections on the cloud side equipment, the playback time is configured according to the time deviation of the terminal equipment, which solves the high cost and large power consumption of multiple terminal equipment synchronously displaying the same screen, and achieves low-cost and low-power consumption Synchronous display and avoid time differences.
Patent Information
- Application Number
- CN202311127306.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-31
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2043-08-31
AI Technical Summary
In the process of implementing the process of multiple terminal devices to display the same screen at the same time, the prior art has high cost and high power consumption, and the display time difference is difficult to solve due to performance and system differences.
Through the cloud-side device, the playback time is configured according to the time deviation of the terminal device, and multiple terminal devices can synchronize the same screen at the system and hardware level, reducing power consumption and cost, and avoiding performance and Time difference caused by system reasons.
It realizes that multiple terminal devices can display the same screen in a low-cost, centralized and controllable manner in different operating systems, reducing power consumption and avoiding the problem of display time differences.
Smart Images

Figure CN117692695B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a display method and related equipment. Background Art
[0002] In some specific scenarios (for example, stores, exhibition counter displays, etc.), terminal devices of various types and different screen sizes will display the same picture at the same time. This is to keep the environment neat and orderly, attract user attention, and facilitate users to compare the differences in screen display of different products.
[0003] At present, the 1+N method is generally used to achieve multiple devices displaying the same screen. That is, one device is used as a control device to control the display of the other N devices. This method requires the purchase of customized hardware as a control device, and the need to load communication software into the control device and N devices, which is costly and complex to deploy. In addition, the control device needs to maintain communication connection with the other N devices for a long time, which will generate high power consumption.
[0004] Therefore, how to enable multiple devices to display the same image simultaneously while controlling power consumption and reducing costs is an urgent problem to be solved. Summary of the invention
[0005] The present application provides a display method and related equipment. The display method can be applied to multiple terminal devices. According to the display method, the cloud-side device uses long connections and short connections to control multiple terminal devices in different scenarios. The multiple terminal devices are configured according to their own time deviations in the system, hardware, etc., so as to determine the time when the terminal devices respectively display the same screen. This method can be applied to multiple terminal devices using different operating systems, with low cost, and is more centralized and controllable. It can also avoid the time difference in displaying the same screen due to performance, system, etc. of multiple terminal devices.
[0006] In a first aspect, the present application provides a display method. The display method can be applied to a first end-side device. The method may include: when the first end-side device establishes a short connection with the cloud-side device, the first end-side device may receive the first activity task information sent by the cloud-side device through the short connection, and obtain the activity material of the first activity based on the first activity task information; when the task type corresponding to the first activity task is the first task type, if the current moment reaches the start time of the first activity, the first end-side device may play the acquired activity material of the first activity. Among them, the first activity task information is the relevant information of the first activity task, the first activity task is the task corresponding to the first activity, and the first activity task information includes the start time of the first activity.
[0007] In the solution provided by the present application, multiple end-side devices can establish a short connection with the cloud-side device at intervals of a certain period of time (such as the preset duration mentioned later) so as to obtain relevant information of the activity task from the cloud-side device in a timely manner. In the case where the end-side device establishes a short connection with the cloud-side device, the end-side device can obtain relevant information of the activity task from the cloud-side device through the short connection, and obtain the corresponding activity material based on the relevant information of the activity task. In the case where the task type corresponding to the activity task is the first task type, if the current moment reaches the start time of the activity corresponding to the activity task (i.e., the start time of the activity), the end-side device can play the corresponding activity material it has obtained. In other words, the end-side device does not have to maintain a communication connection with the cloud-side device all the time. On the one hand, the end-side device can obtain the corresponding information through the short connection, and actively obtain the activity material and determine the playback time based on the corresponding information. On the other hand, for the activity task with the task type of the first task type, the end-side device can play the corresponding activity material when the current moment reaches the start time of the activity corresponding to the activity task. It can be understood that the short connection is short-lived. For each of the multiple end-side devices that receive relevant information of the activity task sent by the cloud-side device, the above method can reduce power consumption and maintenance costs while ensuring that the corresponding activity material is played at the start time of the activity, and can also enable the multiple end-side devices to play the same activity material at the same time.
[0008] In some embodiments of the present application, the first terminal side device may be the terminal side device 100 mentioned below. The first terminal side device may be the first type of terminal side device mentioned below.
[0009] In some embodiments of the present application, the communication connection established between the first terminal-side device and the cloud-side device may be the first type of communication connection mentioned below.
[0010] In some embodiments of the present application, the first activity task information may be the relevant information of the activity task mentioned below (eg Figure 4 and Figure 5 In some embodiments of the present application, the first activity task information may be the related information of the newly created activity task mentioned later (such as Figure 3 shown).
[0011] It can be understood that there is a corresponding relationship between the first activity, the activity material of the first activity, the first activity task and the first activity task information. The activity material of the first activity can also be understood as the activity material corresponding to the first activity task.
[0012] In some embodiments of the present application, the first task type may be a scheduled task mentioned below.
[0013] In some embodiments of the present application, the first terminal device may set a timer reminder to remind the user to play the activity material of the first activity when the start time of the first activity is reached. In a possible implementation, the first terminal device may implement the timer reminder by setting an alarm task.
[0014] It should be noted that the "moment" and "time" mentioned in this application have the same meaning. The "current moment" and "current time" have the same meaning. The "starting moment of the activity", "the starting moment of the activity" and "the starting time of the activity" have the same meaning.
[0015] In combination with the first aspect, in a possible implementation, after the first terminal device obtains the activity material of the first activity based on the first activity task information, the method may further include: when the task type corresponding to the first activity task is the second task type, if the current moment reaches the first moment, the first terminal device may establish a long connection with the cloud device; if the first terminal device receives the broadcast control instruction sent by the cloud device through the long connection, the first terminal device plays the activity material of the first activity. The first moment is earlier than the start moment of the first activity.
[0016] In the solution provided in the present application, when the task type corresponding to the activity task is the second task type, if the current moment reaches a certain moment set by the terminal device that is earlier than the activity start time, the terminal device can establish a long connection with the cloud device and wait for the cloud device to send a broadcast control instruction. After receiving the broadcast control instruction sent by the cloud device, the terminal device can play the corresponding activity material. It can be understood that the terminal device does not have to maintain a communication connection with the cloud device all the time. On the one hand, the terminal device can obtain the corresponding information through a short connection, and actively obtain the activity material and determine the playback time based on the corresponding information. On the other hand, for an activity task with a task type of the first task type, the terminal device can play the corresponding activity material when the current moment reaches the start time of the activity corresponding to the activity task. However, for an activity task with a task type of the second task type, the terminal device can establish a long connection with the cloud device when the activity start time is about to arrive, waiting for the cloud device to send a broadcast control instruction.
[0017] Through the above method, the terminal-side device can adopt a combination of short connection and long connection to achieve communication with the cloud-side device, reducing power consumption and cost. In addition, the terminal-side device can also adopt different ways of playing activity materials for different types of activity tasks. For example, for activity tasks of the first task type, the terminal-side device directly plays the activity material at the start time of the activity, and for activity tasks of the second task type, the terminal-side device waits for the cloud-side device to issue a broadcast control instruction before playing the activity material. For some activities whose start time may change, the latter method can be directly controlled by the cloud-side device, without the need to continuously resend relevant information of the activity task to the terminal to update the start time of the activity, thereby simplifying the process.
[0018] In some embodiments of the present application, the second task type may be a manual task mentioned below.
[0019] In combination with the first aspect, in a possible implementation, the first end-side device plays the acquired activity material of the first activity, which may specifically include: the first end-side device may obtain the current system time of the first end-side device, the start time of the first activity, and the offset factor of the first end-side device, and determine the playback offset duration based on the current system time of the first end-side device, the start time of the first activity, and the offset factor of the first end-side device, and determine the total playback duration of the activity material of the first activity, determine the playback start position of the activity material of the first activity based on the playback offset duration, and jump to the playback start position to start playing the activity material of the first activity. The offset factor is used to represent the time offset caused by different operating systems and / or hardware and / or models of the end-side device.
[0020] In the solution provided by the present application, the terminal device can obtain the offset time caused by the difference in its own system and / or hardware and / or model, and determine the starting position of playing the activity material based on the offset time. This method can avoid the time difference of displaying the same picture on multiple terminal devices due to performance, system and other reasons, so that multiple terminal devices can display the same picture at the same time.
[0021] In combination with the first aspect, in a possible implementation, the offset factor may include any one or more of the following: a device offset factor, a hardware offset factor, and a system platform offset factor. The playback offset duration is the sum of a first value and a second value. The first value is the difference between the current system time of the first end-side device and the start time of the first activity, and the second value is the square root of the sum of the squares of each item in the offset factor. The playback start position is the remainder of the playback offset duration divided by the total playback duration of the activity material of the first activity.
[0022] In the solution provided in the present application, the terminal device may consider any one or more of the three aspects, namely, device model, hardware and system platform, when determining the offset time, and determine the position of the active material to start playing based on the offset time and the current time of the system.
[0023] In combination with the first aspect, in a possible implementation, a first end-side device establishes a communication connection with at least one end-side device. The method may also include: when the first end-side device plays the activity material of the first activity, the at least one end-side device may also play the activity material of the first activity. Wherein, during the process of the first end-side device and the at least one end-side device playing the activity material of the first activity, the first end-side device and the at least one end-side device display the same picture at the same time.
[0024] In the solution provided by the present application, the terminal device can establish a communication connection with one or more other terminal devices, so as to transmit the activity material to the other one or more terminal devices for display. This method can enable the terminal device that cannot establish a communication connection with the cloud device to play the activity material simultaneously with other terminal devices.
[0025] In some embodiments of the present application, the communication connection established between the first terminal device and at least one terminal device may be the second type of communication connection mentioned below. The at least one terminal device may be the second type of terminal device mentioned below.
[0026] In combination with the first aspect, in a possible implementation method, the first end-side device plays the acquired activity material of the first activity, which may specifically include: if the first end-side device completes the playback of the activity material of the first activity, or a problem occurs during the process of the first end-side device playing the activity material of the first activity, resulting in the inability to continue playing, the first end-side device can determine whether the first activity is over; if the first activity is over, the first end-side device can clear the first activity task information and the activity material of the first activity; if a problem occurs during the process of the first end-side device playing the activity material of the first activity, resulting in the inability to continue playing, and the first activity has not ended, the first end-side device can play the activity material of the first activity again; if the first end-side device completes the playback of the activity material of the first activity, and the first activity has not ended, the first end-side device can determine whether the re-play condition is met; if the first end-side device meets the re-play condition, the first end-side device can play the activity material of the first activity again; if the first end-side device does not meet the re-play condition, the first end side can display a default interface.
[0027] In the solution provided by the present application, if the end-side device cannot successfully play the activity material, that is, a problem occurs during the playback of the activity material and the playback cannot continue, the end-side device can try to play the activity material again before the activity ends. If the end-side device successfully plays the activity material, the end-side device can determine whether the replay condition is met before the activity ends, and play the activity material again if the replay condition is met. This method can deal with problems during playback and realize loop playback of activity materials before the activity ends.
[0028] In combination with the first aspect, in a possible implementation, the first end-side device satisfies the replay condition, which may specifically include: the power of the first end-side device is not less than a preset power threshold, and the temperature of the first end-side device is not greater than a preset temperature threshold.
[0029] In the solution provided in the present application, when the power and temperature of the terminal device meet the corresponding conditions, the terminal device can play the activity material again. This method can determine whether to play the activity material again based on the state of the terminal device itself.
[0030] In combination with the first aspect, in a possible implementation method, before the first end-side device obtains the activity material of the first activity based on the first activity task information, the method may also include: the first end-side device may determine that the format of the first activity task information is a preset task format, the format of the activity material of the first activity is a preset material format, and the start time of the first activity is later than the current time, and the first end-side device may determine that before the first end-side device receives the first activity task information, the first end-side device has not received relevant information of the task corresponding to the first activity, or the first end-side device has received relevant information of the task corresponding to the first activity that is different from the first activity task information.
[0031] In the solution provided in the present application, after the terminal-side device receives the relevant information of the activity task sent by the cloud-side device through the short connection, it can determine whether the activity task is a newly created activity task, and whether the activity task meets the preset conditions. For example, whether the format of the relevant information of the activity task is the preset task format, whether the format of the activity material corresponding to the activity task is the preset material format, and whether the start time of the activity corresponding to the activity task is later than the current time. If the terminal-side device determines that the activity task is a newly created activity task, and the activity task meets the preset conditions, the terminal-side device can obtain the corresponding activity material based on the relevant information of the activity task. In this way, the terminal-side device can screen out the relevant information of the activity task that does not meet the requirements in advance, and avoid the waste of computing resources caused by the subsequent acquisition of activity materials due to the relevant information of the activity task not meeting the requirements.
[0032] In some embodiments of the present application, the activity task is a newly created activity task, which may specifically include: before the terminal device receives the relevant information of the first activity task, the terminal device has not received the relevant information of the activity task corresponding to the first activity, or the terminal device has received the relevant information of the task corresponding to the first activity that is different from the first activity task information. It can be understood that the judgment of the newly created activity task can specifically refer to the relevant description of step S203.
[0033] In some embodiments of the present application, the cloud-side device can determine whether there is a newly created activity task, and generate relevant information of the newly created activity task if there is a newly created activity task. In this case, the end-side device does not need to determine whether the information it receives is the relevant information of the newly created activity task.
[0034] In combination with the first aspect, in a possible implementation, the first activity task information may include a first link. The first end-side device obtains the activity material of the first activity based on the first activity task information, which may specifically include: the first end-side device may copy the activity material of the first activity based on the first link; if the first end-side device fails to successfully copy the activity material of the first activity based on the first link, and the number of times the first end-side device copies the activity material of the first activity is not greater than a preset number of copies, the first end-side device may copy the activity material of the first activity again based on the first link.
[0035] In the solution provided by the present application, the terminal device can obtain (download or copy) the corresponding activity material according to the activity material link in the relevant information of the activity task. In addition, if the activity material acquisition fails, the terminal device can obtain the activity material again within a preset number of copies. This method can provide multiple opportunities to obtain activity materials.
[0036] In the second aspect, the present application provides a display method. The display method can be applied to a cloud-side device. The method may include: when the cloud-side device establishes short connections with multiple end-side devices respectively, the cloud-side device may send first activity task information to multiple end-side devices respectively through short connections. Among them, the first activity task information is the relevant information of the first activity task, the first activity task is the task corresponding to the first activity, and the first activity task information includes the start time of the first activity. The first activity task information can be used to instruct multiple end-side devices to obtain activity materials for the first activity, and to play the activity materials of the first activity when the task type corresponding to the first activity task is the first task type and the current time reaches the start time of the first activity.
[0037] In the solution provided by the present application, multiple end-side devices can establish a short connection with the cloud-side device at intervals of a period of time (such as the preset duration mentioned later) so as to obtain relevant information of the activity task from the cloud-side device in a timely manner. In the case where multiple end-side devices establish short connections with the cloud-side device, the cloud-side device can send relevant information of the activity task to the multiple end-side devices through the short connection. The end-side device can obtain the corresponding activity material based on the relevant information of the activity task. In the case where the task type corresponding to the activity task is the first task type, if the current moment reaches the start time of the activity corresponding to the activity task (i.e., the activity start time), the end-side device can play the corresponding activity material it has obtained. In other words, the end-side device does not have to maintain a communication connection with the cloud-side device all the time. On the one hand, the end-side device can obtain the corresponding information through a short connection, and actively obtain the activity material and determine the playback time based on the corresponding information. On the other hand, for an activity task of the first task type, the end-side device can play the corresponding activity material when the current moment reaches the start time of the activity corresponding to the activity task. It can be understood that the short connection is short-lived. For each of the multiple end-side devices that receive relevant information of the activity task sent by the cloud-side device, the above method can reduce power consumption and maintenance costs while ensuring that the corresponding activity material is played at the start time of the activity, and can also enable the multiple end-side devices to play the same activity material at the same time.
[0038] In combination with the second aspect, in a possible implementation, after the cloud-side device sends the first activity task information to multiple terminal-side devices respectively through short connections, the method may also include: when the task type corresponding to the first activity task is the second task type, if the current moment reaches the first moment, the cloud-side device can establish a long connection with the multiple terminal-side devices respectively, and send a broadcast control instruction to the multiple terminal-side devices respectively through the long connection. The broadcast control instruction is used to instruct the multiple terminal-side devices to play the activity material of the first activity. The first moment is earlier than the start time of the first activity.
[0039] In the scheme provided by the present application, when the task type corresponding to the activity task is the second task type, if the current moment reaches a certain moment set by the terminal device earlier than the activity start time, the terminal device can establish a long connection with the cloud device. The cloud device can send a broadcast control instruction to the terminal device through the long connection. After receiving the broadcast control instruction, the terminal device can play the corresponding activity material. Through the above method, the terminal device does not have to maintain a communication connection with the cloud device all the time. It can adopt a combination of short connection and long connection to achieve communication with the cloud device, which reduces power consumption and cost. In addition, the terminal device can also adopt different ways of playing activity materials for different types of activity tasks. For example, for the activity task of the first task type, the terminal device directly plays the activity material at the start time of the activity, and for the activity task of the second task type, the terminal device waits for the cloud device to send the broadcast control instruction before playing the activity material. For some activities whose start time may change, the latter method can be directly controlled by the cloud device, without the need to continuously resend the relevant information of the activity task to the terminal to update the start time of the activity, simplifying the process.
[0040] In a third aspect, the present application provides an end-side device, which includes: a communication module, one or more processors, and one or more memories; the one or more processors are coupled to the one or more memories and the communication module, the communication module is used to communicate with other devices, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the end-side device to perform the method described in the first aspect or any one of the implementations of the first aspect.
[0041] In a fourth aspect, the present application provides a cloud-side device, which includes: a communication module, one or more processors, and one or more memories; the one or more processors are coupled to the one or more memories and the communication module, the communication module is used to communicate with other devices, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the cloud-side device to execute the method described in the second aspect or any one of the implementations of the second aspect.
[0042] In a fifth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an end-side device, the end-side device executes the method described in the first aspect or any one of the implementations of the first aspect.
[0043] In a sixth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on a cloud-side device, the cloud-side device executes the method described in the second aspect or any one of the implementations of the second aspect.
[0044] In the seventh aspect, an embodiment of the present application provides a chip, which can be applied to an end-side device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the end-side device to execute the method described in the first aspect or any one of the implementations of the first aspect.
[0045] In the eighth aspect, an embodiment of the present application provides a chip, which can be applied to a cloud-side device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the cloud-side device to execute the method described in the second aspect or any one of the implementations of the second aspect.
[0046] In a ninth aspect, an embodiment of the present application provides a computer program product comprising instructions. When the computer program product runs on an end-side device, the end-side device executes the method described in the first aspect or any one of the implementations of the first aspect.
[0047] In a tenth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a cloud-side device, enables the cloud-side device to execute the method described in the second aspect or any one of the implementations of the second aspect.
[0048] It can be understood that the terminal side device provided in the third aspect, the computer storage medium provided in the fifth aspect, the chip provided in the seventh aspect, and the computer program product provided in the ninth aspect are all used to execute the method described in the first aspect or any one of the implementations of the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation method in the first aspect above, and will not be repeated here. The cloud side device provided in the fourth aspect, the computer storage medium provided in the sixth aspect, the chip provided in the eighth aspect, and the computer program product provided in the tenth aspect are all used to execute the method described in the second aspect or any one of the implementation methods of the second aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of any possible implementation method in the second aspect above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] Figure 1 A schematic diagram of a display scene provided in an embodiment of the present application;
[0050] Figure 2 An architectural diagram of a display system provided in an embodiment of the present application;
[0051] Figure 3 A flow chart of a display method provided in an embodiment of the present application;
[0052] Figure 4 A processing flow chart of a terminal device 100 after receiving relevant information of an activity task provided in an embodiment of the present application;
[0053] Figure 5 A flow chart of playing activity materials provided in an embodiment of the present application;
[0054] Figure 6 A flowchart of a method for playing activity materials provided in an embodiment of the present application;
[0055] Figure 7 A schematic diagram of the hardware structure of a terminal device 100 provided in an embodiment of the present application;
[0056] Figure 8 A schematic diagram of the software structure of a terminal device 100 provided in an embodiment of the present application;
[0057] Fig. 9 A schematic diagram of software and hardware interaction provided in an embodiment of the present application. DETAILED DESCRIPTION
[0058] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0059] It should be understood that the terms "first", "second", etc. in the specification, claims and drawings of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.
[0060] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.
[0061] In some specific scenarios (for example, stores, exhibition counters, etc.), terminal devices of various types and screen sizes will display the same screen at the same time to keep the environment neat and orderly and to facilitate users to compare the differences in screen display of different products. According to the above, if the 1+N method is used to realize multiple devices displaying the same screen, it will cost a high cost to customize the hardware, and the deployment environment will be complex, and it will also generate high power consumption.
[0062] Based on the above content, the present application provides a display method and related equipment. According to the display method, the cloud-side device uses long connections and short connections in different scenarios to send messages to multiple terminal devices to instruct the multiple terminal devices to play the corresponding activity materials after the activity starts, and before starting to play the corresponding activity materials, the multiple terminal devices are configured according to the time deviation in the system, hardware, etc. to determine the starting position of the corresponding activity materials, so as to achieve the same screen of the activity materials displayed by the multiple terminal devices at the same time. This method can be applied to multiple terminal devices using different operating systems, with low cost, and is more centralized and controllable. It can also avoid the time difference in displaying the same screen caused by multiple terminal devices due to performance, system, etc.
[0063] The following first introduces a display scenario provided by an embodiment of the present application.
[0064] See also Figure 1 , Figure 1 A schematic diagram of a display scene provided in an embodiment of the present application.
[0065] like Figure 1 As shown, when an event venue hosts a corresponding event (for example, a new product display event, a festival event, an opening event, a promotion event, an exhibition, etc.), event materials (such as corresponding event videos) can be displayed both inside and outside the venue through terminal devices (also known as end-side devices).
[0066] On the one hand, one or more end-side devices (e.g., smart screens, tablet computers, smart phones, laptops, etc.) may be deployed inside the event venue. Specifically, before the event starts, the cloud-side device can create an activity task, and can also establish a communication connection with the end-side device at regular intervals. In this case, the communication connection is a short connection. After the cloud-side device creates an activity task, it can send relevant information of the activity task (e.g., activity start time, activity end time, task type, activity material, etc.) to the end-side device through a short connection between it and the end-side device. After the end-side device receives the relevant information of the activity task sent by the cloud-side device, it can set an alarm task based on the relevant information of the activity task. If the task type is a timed task, the end-side device can play the activity material when the current time reaches the specified time of the alarm task (i.e., the alarm task is reminded at the time). If the task type is a manual task, the end-side device can establish a communication connection with the cloud-side device when the current time reaches the specified time of the alarm task (i.e., the alarm task is reminded at the time). In this case, the communication connection is a long connection. After the client device establishes a long connection with the cloud device, the cloud device can send a broadcast control command to the client device. After receiving the broadcast control command, the client device can play the activity material.
[0067] In some embodiments of the present application, the relevant information of the activity task may include an activity material link. After receiving the relevant information of the activity task sent by the cloud side device, the terminal side device may download the activity material based on the activity material link included therein for subsequent playback.
[0068] On the other hand, one or more end-side devices (e.g., LED screens) may also be deployed outside the event venue. Specifically, the end-side device deployed outside the event venue can establish a communication connection with the end-side device deployed inside the event venue. The end-side device deployed inside the event venue can project the event material onto the end-side device deployed outside the event venue for playback based on the communication connection.
[0069] It should be noted that Figure 1 The terminal side devices deployed inside the activity venue shown in the figure can be understood as the first type of terminal side devices mentioned later. Figure 1 The terminal side devices deployed outside the activity venue shown in the figure can be understood as the second type of terminal side devices mentioned later.
[0070] In combination with the above display scenario, a display system architecture provided by an embodiment of the present application is introduced below.
[0071] See also Figure 2 , Figure 2 An architectural diagram of a display system provided in an embodiment of the present application.
[0072] like Figure 2As shown, the display system may include a cloud-side device and several end-side devices. The several end-side devices may include a first type of end-side device and a second type of end-side device. Among them, the first type of end-side device can establish a first type of communication connection with the cloud-side device, and the first type of end-side device can establish a second type of communication connection with the second type of end-side device. Specifically, the cloud-side device can establish a first type of communication connection with the end-side device 100, and the end-side device 100 can establish a second type of communication connection with the end-side device 300. Similarly, the cloud-side device can establish a first type of communication connection with the end-side device 200, and the end-side device 200 can establish a second type of communication connection with the end-side device 400.
[0073] It should be noted that the first type of communication connection is different from the second type of communication connection. In some embodiments of the present application, the two ends of the first type of communication connection can transmit data to each other, while only one of the two ends of the second type of communication connection can transmit data. Taking the terminal device 100 as an example, after the cloud side device and the terminal side device 100 establish a first type of communication connection, the cloud side device and the terminal side device 100 can transmit data to each other. After the second type of communication connection is established between the terminal side device 100 and the terminal side device 300, the terminal side device 100 can transmit data (for example, activity materials) to the terminal side device 300.
[0074] According to the above, in some embodiments of the present application, the first type of communication connection can be a short connection or a long connection.
[0075] It is understandable that the second type of communication connection can be a wired communication connection or a wireless communication connection. In some embodiments of the present application, the second type of communication connection can be a Bluetooth connection (i.e., a communication connection established via Bluetooth), a Wi-Fi connection (i.e., a communication connection established via a Wi-Fi network), etc.
[0076] In some embodiments of the present application, the first type of terminal side device can establish a first type of communication connection with the cloud side device or other first type of terminal side device, and the first type of terminal side device can establish a second type of communication connection with the second type of terminal side device. It can be understood that the first type of terminal side device can be a terminal device with an operating system (for example, Android operating system, Microsoft operating system, IOS operating system, etc.) set up inside, and the second type of terminal side device can be a terminal device with no operating system set up inside or with a simple operating system set up.
[0077] In some embodiments of the present application, the cloud-side device can be respectively connected to multiple first-type terminal-side devices (not limited to Figure 2 The end-side device 100 and the end-side device 200 shown establish a first type of communication connection.
[0078] In some embodiments of the present application, each first-type terminal device may establish a second-type communication connection with a second-type terminal device. Figure 2 As shown, the terminal side device 100 can establish a second type of communication connection with the terminal side device 300, and the terminal side device 200 can establish a second type of communication connection with the terminal side device 400.
[0079] In some other embodiments of the present application, each first-type terminal device may establish a second-type communication connection with multiple second-type terminal devices. For example, the terminal device 100 may establish a communication connection with both the terminal device 300 and the terminal device 400.
[0080] It can be understood that the end-side device refers to a terminal device, which may specifically be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA) or a dedicated camera (for example, a SLR camera, a card camera) and other devices. The embodiments of the present application do not impose any restrictions on the specific type of the end-side device.
[0081] It is understandable that cloud-side devices refer to one or more computing devices deployed in a cloud environment, or one or more computing devices in an edge environment. For example, cloud-side devices may include cloud servers, central servers, etc. Taking cloud servers as an example, cloud servers refer to a cluster of central computing devices used to provide computing, storage, and communication resources. Cloud servers are a type of server with highly distributed and highly virtualized characteristics. Their computing resources are obtained by scheduling from a large number of integrated virtualized physical servers. From the perspective of node scale, such a virtualization scale may be several, dozens, or hundreds of physical servers, or it may be a large cloud virtual resource pool built from thousands of physical hardware across data centers.
[0082] The following is based on Figure 2 The display system shown introduces a display method provided by an embodiment of the present application.
[0083] See also Figure 3 , Figure 3 This is a flow chart of a display method provided in an embodiment of the present application. The display method may include but is not limited to the following steps:
[0084] S101: The terminal-side device 100 establishes a short connection with the cloud-side device at intervals of a preset duration.
[0085] The end-side device 100 can establish a short connection with the cloud-side device at every preset time interval. After the end-side device 100 establishes a short connection with the cloud-side device, if there is a newly created active task in the cloud-side device, the cloud-side device can execute step S102, and disconnect the short connection between it and the end-side device 100 after the cloud-side device executes step S102. However, if there is no newly created active task in the cloud-side device, the short connection between the cloud-side device and the end-side device 100 can be directly disconnected.
[0086] It is understandable that the preset duration can be set according to actual needs, and this application does not impose specific restrictions on this. For example, the preset duration can be 5 minutes. In some embodiments of the present application, the terminal device 100 can adopt different preset durations for different time periods. For example, at night (such as 1 a.m. to 5 a.m.), the preset duration can be 15 minutes, while in other time periods, the preset duration can be 5 minutes.
[0087] It can be understood that a short connection refers to a communication connection that is established each time the two communicating parties exchange data, and the connection is disconnected immediately after the data exchange is completed. In other words, when there is data exchange, the two communicating parties can establish a short connection, and after the data is sent, the short connection is disconnected, that is, each short connection only completes the sending of one business. A short connection is a Transmission Control Protocol (TCP) connection. TCP is a connection-oriented, reliable, byte-stream-based transport layer communication protocol, which is mainly used to establish a virtual connection between hosts to achieve high-reliability data packet exchange.
[0088] S102: When a short connection is established between the cloud-side device and the terminal-side device 100, if there is a newly created active task in the cloud-side device, the cloud-side device sends relevant information of the newly created active task to the terminal-side device 100.
[0089] It is understandable that the cloud-side device can read the activity information, and when the read activity information is updated, it can create a corresponding new activity task based on the read activity information. After the cloud-side device establishes a short connection with the terminal-side device 100, the cloud-side device can determine whether there is a newly created activity task. If there is a newly created activity task in the cloud-side device, the cloud-side device can send relevant information of the newly created activity task to the terminal-side device 100. Accordingly, the terminal-side device 100 can receive relevant information of the newly created activity task sent by the cloud-side device.
[0090] It can be understood that after the cloud-side device sends the relevant information of the newly created active task to the terminal-side device 100, the short connection between it and the terminal-side device 100 can be disconnected.
[0091] In some embodiments of the present application, the cloud-side device can read the activity information uploaded by relevant technical personnel (for example, relevant information of opening activities, promotional activities, exhibitions, etc.), and determine whether there are any activities for which corresponding activity tasks have not been created based on the activity information.
[0092] In some embodiments of the present application, once the activity information is updated, the cloud-side device may receive a corresponding reminder, and the cloud-side device may read the updated activity information and create a new activity task. In some other embodiments of the present application, the cloud-side device may check whether there is updated activity information every certain period of time (for example, 5 minutes). If the cloud-side device finds that there is updated activity information, the cloud-side device may read the updated activity information and create a new activity task.
[0093] In some embodiments of the present application, the cloud-side device creates a new activity task, which may specifically include: the cloud-side device may record the task type, task identifier, activity identifier, activity material link corresponding to the new activity task, and the name, location, playback device, start time and end time of the corresponding activity.
[0094] Among them, the task types corresponding to the activity task may include scheduled tasks and manual tasks. When the task types corresponding to the activity task are different, the ways of triggering the playback of the corresponding activity materials are different. For details, please refer to the following text and will not be explained in detail here. The task identifier can be used to mark the activity task. The activity identifier can be used to mark the activity. The activity material link corresponding to the activity task can be used to download the playback material (for example, video, picture movie, etc.) corresponding to the activity task. The name of the activity corresponding to the activity task can briefly represent the content of the activity. For example, smart home exhibition. The location of the activity corresponding to the activity task is the venue of the event. For example, the first exhibition hall. The playback device of the activity corresponding to the activity task is the device that plays the activity material. For example, the end-side device 100 and the end-side device 300. In some embodiments of the present application, the playback device of the activity corresponding to the activity task can be represented by a corresponding identifier. The start time and end time of the activity corresponding to the activity task can be understood as the start time and end time corresponding to the time period in which the activity material needs to be played by the playback device.
[0095] It is understandable that the terminal device 100 can receive relevant information of several activity tasks with different task identifiers but the same activity identifier.
[0096] In some embodiments of the present application, the relevant information of the activity task may include: task identifier, activity identifier, activity start time, activity end time, task type, and activity material link.
[0097] S103: The terminal device 100 sets a new alarm task according to the relevant information of the newly created activity task, and obtains the activity material corresponding to the newly created activity task.
[0098] It can be understood that after the terminal side device 100 receives the relevant information of the newly created activity task sent by the cloud side device, it can set a new alarm task based on the activity start time, activity end time and task type in the relevant information of the newly created activity task, and can also obtain the corresponding activity material based on the activity material link in the relevant information of the newly created activity task.
[0099] Specifically, if the task type corresponding to the newly created activity task is a scheduled task, the terminal device 100 can set a new alarm task and set the specified time of the new alarm task to the activity start time. However, if the task type corresponding to the newly created activity task is a manual task, the terminal device 100 can set a new alarm task and set the specified time of the new alarm task to before the activity start time. For example, the 5th minute before the activity start time. For another example, the 10th minute before the activity start time.
[0100] It can be understood that the specific setting method of the alarm task can refer to the relevant technical documents, and this application does not elaborate on this. For example, when the operating system in the terminal device 100 is the Android operating system (hereinafter referred to as the Android system), the terminal device 100 can set the alarm task through the alarm service (AlarmManager). AlarmManager can broadcast a specified Intent at a specific time. Simply put, the terminal device 100 can determine a time, and once this time comes, the Alarm Manager can broadcast a set Intent. For example, when the time is up, the terminal device 100 can display an Activity or call a Service. Among them, Activity and Service are the four major components of the Android system, and you can refer to the relevant technical documents for details, and this application does not elaborate on this.
[0101] In some embodiments of the present application, after the terminal device 100 receives the relevant information of the newly created activity task sent by the cloud device, it can download the activity material corresponding to the newly created activity task to the local device based on the activity material link in the relevant information.
[0102] In some embodiments of the present application, after the end-side device 100 receives the relevant information of the newly created activity task sent by the cloud-side device, it can first determine whether the newly created activity task meets the preset conditions. Specifically, the end-side device 100 can determine whether the format of the relevant information of the newly created activity task meets the preset task format, whether the current time is earlier than the activity start time corresponding to the newly created activity task, and whether the format of the activity material corresponding to the newly created activity task is the preset material format. It is understandable that the relevant description of the preset conditions can refer to step S202.
[0103] In some embodiments of the present application, if the newly created activity task meets the preset conditions, the terminal device 100 can execute step S103. Specifically, if the format of the relevant information of the newly created activity task meets the preset task format, and the current time is earlier than the activity start time corresponding to the newly created activity task, and the format of the activity material corresponding to the newly created activity task is the preset material format, the terminal device can set a new alarm task according to the relevant information of the newly created activity task, and obtain the activity material corresponding to the newly created activity task. It can be understood that the relevant description of the preset task format and the preset material format can be referred to later, and this application will not elaborate on it here.
[0104] In some embodiments of the present application, if the newly created activity task meets the preset conditions, the terminal side device 100 can determine whether the activity task corresponding to the relevant information it receives is a newly created activity task (see step S203 for details). This can avoid the cloud side device from making mistakes when judging whether there is a newly created activity task.
[0105] S104: When the task type corresponding to the newly created activity task is a scheduled task, once the current time reaches the specified time of the new alarm task, the terminal device 100 plays the activity material corresponding to the newly created activity task.
[0106] When the task type corresponding to the newly created activity task is a scheduled task, once the current time reaches the specified time of the new alarm task, that is, when the new alarm task expires, the terminal device 100 can play the activity material corresponding to the newly created activity task.
[0107] In some embodiments of the present application, the terminal device 100 can establish a second type of communication connection with a second type of terminal device (for example, the terminal device 300). In this case, if the task type corresponding to the newly created activity task is a timed task, once the current time reaches the specified time of the new alarm task, the terminal device 100 can transmit the corresponding activity material it has obtained (that is, the activity material corresponding to the newly created activity task) to the second type of terminal device (for example, the terminal device 300) with which the second type of communication connection is established. For details, please refer to the relevant description of step S105. It should be noted that step S105 is an optional step.
[0108] S105: When the task type corresponding to the newly created activity task is a scheduled task, once the current time reaches the specified time of the new alarm task, the terminal device 100 projects the activity material corresponding to the newly created activity task onto the terminal device 300 for playback.
[0109] When the terminal device 100 establishes a second type of communication connection with the terminal device 300, if the task type corresponding to the newly created activity task is a scheduled task, once the current time reaches the specified time of the new alarm task, the terminal device 100 can project the activity material corresponding to the newly created activity task to the terminal device 300 for playback.
[0110] S106: When the task type corresponding to the newly created active task is a manual task, once the current time reaches the specified time of the new alarm task, the terminal-side device 100 establishes a long connection with the cloud-side device.
[0111] When the task type corresponding to the newly created active task is a manual task, once the current time reaches the specified time of the new alarm task, the terminal device 100 can establish a long connection with the cloud device to wait for the cloud device to issue a broadcast control instruction.
[0112] It can be understood that a long connection means that the two communicating parties first establish a communication connection, which does not need to be disconnected after it is established, and then send and receive messages. In this way, the communication connection will be maintained, unlike a short connection, which disconnects the communication connection immediately after a data exchange. A long connection is also a TCP connection.
[0113] S107: Once the current time reaches the activity start time corresponding to the newly created activity task, the cloud-side device sends a broadcast control instruction to the terminal-side device 100.
[0114] After the end-side device 100 establishes a long connection with the cloud-side device, the cloud-side device can monitor the activity start time corresponding to the newly created activity task. Once the current time reaches the activity start time corresponding to the newly created activity task, the cloud-side device can send a play control instruction to the end-side device 100 based on the long connection established between it and the end-side device 100. The play control instruction is used to notify the end-side device 100 to play the activity material corresponding to the newly created activity task.
[0115] Correspondingly, the terminal-side device 100 can receive the broadcast control instructions sent by the cloud-side device.
[0116] S108: The terminal device 100 plays the activity material corresponding to the newly created activity task.
[0117] After receiving the broadcast control instruction sent by the cloud-side device, the terminal-side device 100 can play the activity material corresponding to the newly created activity task.
[0118] In some embodiments of the present application, after the terminal device 100 receives the broadcast control instruction sent by the cloud device, it can first determine whether the format of the broadcast control instruction meets the preset task format, whether the current time is between the activity start time and the activity end time corresponding to the activity task, and whether the terminal device 100 is in the demonstration scene (or determine whether the terminal device 100 is in use). If the format of the broadcast control instruction meets the preset task format, and the current time is between the activity start time and the activity end time corresponding to the activity task, and the terminal device 100 is in the demonstration scene (or determine that the terminal device 100 is not in use), the terminal device can play the activity material corresponding to the newly created activity task.
[0119] It is understandable that the relevant description of the preset task format can be found in the following text, and this application will not elaborate on it here.
[0120] It is understood that the end-side device 100 in the demonstration scenario can be expressed as: the end-side device 100 displays a default interface. It is understood that the relevant description of the default interface can be referred to later, and this application does not expand the description here. In addition, the end-side device 100 in the demonstration scenario can mean that: the end-side device 100 is not in use, that is, no one is using the end-side device 100.
[0121] In some embodiments of the present application, if the terminal device 100 changes from a used state to an unused state, that is, from never being in a demonstration scene to being in a demonstration scene, the terminal device 100 can first determine whether there is an ongoing activity, that is, determine whether the current time is within the activity start time and activity end time corresponding to a certain activity task. If there is an ongoing activity, the terminal device 100 can play the activity material corresponding to the activity task. If there is no ongoing activity, the terminal device 100 continues to be in the demonstration scene.
[0122] In some embodiments of the present application, the terminal device 100 can establish a second type of communication connection with a second type of terminal device (for example, the terminal device 300). In this case, if the task type corresponding to the newly created activity task is a manual task, once the terminal device 100 receives the broadcast control instruction sent by the cloud device, the terminal device 100 can transmit the corresponding activity material it has obtained (that is, the activity material corresponding to the newly created activity task) to the second type of terminal device (for example, the terminal device 300) with which the second type of communication connection is established. For details, please refer to the relevant description of step S109. It should be noted that step S109 is an optional step.
[0123] S109: The terminal device 100 projects the activity material corresponding to the newly created activity task onto the terminal device 300 for playback.
[0124] When the terminal device 100 establishes the second type of communication connection with the terminal device 300, after the terminal device 100 receives the broadcast control instruction sent by the cloud device, the activity material corresponding to the newly created activity task can be projected onto the terminal device 300 for playback.
[0125] Combine the following Figure 4 and Figure 5 A specific implementation of the above embodiment is introduced.
[0126] After the terminal device 100 executes step S101, it can execute the following steps: Figure 4 Steps S201 to S210 are shown, and then steps S105 to S109 can be continued. When executing steps S104 and S108, the following can be performed: Figure 5 Steps S301 to S310 are shown.
[0127] 1. Specific processing flow after the terminal device 100 receives relevant information of the activity task (including setting the alarm task and obtaining the activity material)
[0128] See also Figure 4 , Figure 4A flowchart of a process after a terminal device 100 receives relevant information of an activity task provided in an embodiment of the present application. The process may specifically include the following steps:
[0129] S201: When a short connection is established between the terminal device 100 and the cloud device, the terminal device 100 receives relevant information of the active task sent by the cloud device.
[0130] The end-side device 100 can establish a short connection with the cloud-side device at a preset interval. When the end-side device 100 establishes a short connection with the cloud-side device, the cloud-side device can send relevant information of the activity task to the end-side device 100, and correspondingly, the end-side device 100 can receive relevant information of the activity task.
[0131] In some embodiments of the present application, as shown in step S101, the cloud-side device may send relevant information of the newly created activity task to the terminal-side device 100 when detecting the presence of a newly created activity task. In other words, Figure 4 The active tasks shown can refer to Figure 3 The newly created activity task is shown.
[0132] It can be understood that the relevant description of the relevant information of short connections and active tasks can be referred to above, and this application will not repeat them here.
[0133] S202: The terminal device 100 detects whether the activity task meets a preset condition.
[0134] After the end-side device 100 receives the relevant information of the activity task sent by the cloud-side device, it can detect whether the activity task meets the preset conditions. If the activity task meets the preset conditions, the end-side device 100 can execute step S203. However, if the activity task does not meet the preset conditions, the end-side device 100 can execute step S210, that is, the end-side device 100 can determine the feedback information and send the feedback information to the cloud-side device. In this case, the feedback information may include the specific reasons why the activity task does not meet the preset conditions. For example, the format of the relevant information of the activity task is not the preset task format. For example, the activity start time corresponding to the activity task is not later than the current time. For another example, the format of the activity material corresponding to the activity task is not the preset material format.
[0135] In some embodiments of the present application, the terminal device 100 detects whether the activity task meets the preset conditions, which may specifically include: the terminal device 100 detects whether the format of the relevant information of the activity task is the preset task format, whether the activity start time corresponding to the activity task is later than the current time, and whether the format of the activity material corresponding to the activity task is the preset material format. In this case, the activity task meets the preset conditions, which may specifically include: the format of the relevant information of the activity task is the preset task format, the activity start time corresponding to the activity task is later than the current time, and the format of the activity material corresponding to the activity task is the preset material format.
[0136] It is understandable that the terminal device 100 can obtain the activity start time from the relevant information of the activity task. For details, please refer to the relevant description of the activity start time above, and this application will not go into details here.
[0137] It is understandable that the preset task format and the preset material format can be set according to actual needs, and this application does not impose any specific restrictions on this.
[0138] In some embodiments of the present application, the preset task format may be provided with the content that the relevant information of the active task needs to include, and the representation form of the content. In some other embodiments of the present application, the preset task format may also be provided with the arrangement order of the content that the relevant information of the active task needs to include. In this case, the terminal-side device 100 detects whether the format of the relevant information of the active task is the preset task format, which may specifically include: the terminal-side device 100 detects whether the content included in the relevant information of the active task is the content specified in the preset task format, and whether the arrangement order and specific form of the content included in the relevant information of the active task are the representation form of the content specified in the preset task format.
[0139] Exemplarily, the preset task format includes the activity start time and activity end time corresponding to the activity task, and the preset task format stipulates that the activity start time and activity end time need to be represented by millisecond timestamps. In some embodiments of the present application, the millisecond timestamp can be represented by 13 digits.
[0140] In some embodiments of the present application, the preset material format may be a specific video format, such as Mpeg-4 video format, AVI video format, WMV video format, RealVideo video format, etc.
[0141] S203: The terminal device 100 detects whether the active task is a newly created active task.
[0142] If the end-side device 100 detects that the active task meets the preset conditions, the end-side device 100 can detect whether the active task is a newly created active task. If the active task is a newly created active task, the end-side device 100 can execute step S204, however, if the active task is not a newly created active task, the end-side device 100 can execute step S210, that is, the end-side device 100 can determine the feedback information and send the feedback information to the cloud-side device. In this case, the feedback information can be used to indicate that the active task is not a newly created active task. For example, the feedback information may include the following text: The active task is not a newly created active task. For another example, the feedback information may include error-0. Error-0 means that the active task is not a newly created active task.
[0143] In some embodiments of the present application, the newly created activity task may include: an activity task corresponding to the new activity, and an updated activity task corresponding to the old activity that has not yet started. It can be understood that the "new activity" and "old activity" mentioned here are distinguished according to whether the terminal device 100 has previously received relevant information of the activity task containing the same activity identifier, rather than whether the activity has started. Specifically, if the terminal device 100 has not previously received relevant information of the activity task containing the same activity identifier, the relevant information of the activity task received by the terminal device 100 this time is the relevant information of the activity task corresponding to the new activity. If the terminal device 100 has previously received relevant information of the activity task containing the same activity identifier and different task identifiers, and the activity corresponding to the activity identifier has not yet started, the relevant information of the activity task received by the terminal device 100 this time is the relevant information of the updated activity task corresponding to the old activity that has not yet started. In this case, the content of the relevant information of the activity task containing the same activity identifier previously received by the terminal device 100 is not completely the same as the content of the relevant information of the activity task received by the terminal device 100 this time.
[0144] S204: The client device 100 copies the activity material corresponding to the activity task based on the activity material link in the relevant information of the activity task.
[0145] The end-side device 100 can copy the corresponding activity material based on the activity material link in the relevant information of the newly created activity task. It can be understood that the "copy" mentioned here can also be understood as "download". In other words, the end-side device 100 copies the activity material, which can specifically include: the end-side device 100 copies the activity material in the server to the end-side device 100 based on the activity material link (that is, the "download to local" mentioned above).
[0146] It is understandable that the specific implementation of step S204 can refer to the relevant description of step S103, and this application will not go into details here.
[0147] S205: Whether the terminal device 100 successfully copies the activity material.
[0148] After the end-side device 100 copies the activity material corresponding to the activity task, it can determine whether the activity material corresponding to the activity task is copied successfully, that is, whether a problem occurs during the copying of the activity material, resulting in the inability to copy the activity material. If the end-side device 100 successfully copies the activity material, the end-side device 100 can execute step S207; if the end-side device 100 fails to copy the activity material, the end-side device 100 can execute step S206.
[0149] S206: The terminal device 100 determines whether the number of copies of the activity material is not greater than a preset number of copies.
[0150] If the terminal device 100 fails to successfully copy the activity material corresponding to the activity task, the terminal device 100 may determine whether the number of copies of the activity material corresponding to the activity task is not greater than the preset number of copies. If the number of copies of the activity material is not greater than the preset number of copies, the terminal device 100 may execute step S204 again, i.e., copy the activity material again. However, if the number of copies of the activity material is greater than the preset number of copies, the terminal device 100 may execute step S207.
[0151] It is understandable that the preset number of copies can be set according to actual needs, and this application does not impose any specific restrictions on this. For example, the preset number of copies can be 3.
[0152] S207: The terminal device 100 determines whether the copied activity material can be played.
[0153] When the end-side device 100 successfully copies the activity material corresponding to the activity task, or the number of times the end-side device 100 copies the activity material corresponding to the activity task is greater than the preset number of copies, the end-side device 100 can determine whether the activity material corresponding to the copied activity task can be played. If the activity material copied by the end-side device 100 can be played, the end-side device 100 can execute step S208. However, if the activity material copied by the end-side device 100 cannot be played, the end-side device 100 can execute step S210, that is, the end-side device 100 can determine the feedback information and send the feedback information to the cloud-side device. In this case, the feedback information can be used to indicate that the activity material corresponding to the activity task cannot be played. For example, the feedback information may include the following text: The activity material cannot be played. For another example, the feedback information may include error-1. Error-1 means that there is an error in the playback of the activity material.
[0154] S208: The client device 100 saves the relevant information of the activity task and the copied activity material.
[0155] If the terminal device 100 determines that the activity material corresponding to the copied activity task can be played, the terminal device 100 can save the relevant information of the activity task and the activity material corresponding to the copied activity task. It can be understood that the terminal device 100 can store the activity material corresponding to the copied activity task in its internal memory (such as Fig. 9 shown).
[0156] S209: The terminal device 100 sets an alarm task based on the task type in the relevant information of the activity task.
[0157] The relevant information of the activity task may include the task type corresponding to the activity task. The terminal device 100 may set the alarm task based on the task type corresponding to the activity task. It is understandable that the specific setting method of the alarm task can refer to step S103, and this application will not be repeated here.
[0158] In some embodiments of the present application, after the end-side device sets the alarm task, it can send feedback information to the cloud-side device. The feedback information can be used to indicate that the end-side device 100 has completed the preparations before the activity starts.
[0159] S210: The terminal-side device 100 determines feedback information and sends the feedback information to the cloud-side device.
[0160] In some embodiments of the present application, if the terminal-side device 100 detects that the active task does not meet the preset conditions, the terminal-side device 100 may determine feedback information and send the feedback information to the cloud-side device.
[0161] In some embodiments of the present application, if the activity material corresponding to the activity task copied by the terminal device 100 cannot be played, the terminal device 100 can determine feedback information and send the feedback information to the cloud device.
[0162] In some embodiments of the present application, if the terminal-side device 100 determines that the active task is not a newly created active task, the terminal-side device 100 may determine feedback information and send the feedback information to the cloud-side device.
[0163] In some embodiments of the present application, if the terminal device 100 successfully copies the activity material corresponding to the activity task, and the activity material can be played, the terminal device 100 can determine feedback information after saving the relevant information of the activity task and the copied activity material, and send the feedback information to the cloud device. The feedback information can be used to indicate that the terminal device 100 has successfully obtained the activity material.
[0164] It should be noted that the feedback information determined by the terminal device 100 in the above different situations may be different. For details, please refer to the relevant descriptions of step S202, step S203, step S207 and step S209. In some embodiments of the present application, the feedback information sent by the terminal device 100 to the cloud device may include a code. Each code can represent a feedback content. For example, error-0 and error-1 are two different codes, which represent different feedback contents.
[0165] 2. Specific process of playing activity materials by the terminal device 100
[0166] See also Figure 5 , Figure 5 A flow chart of activity material playback provided in an embodiment of the present application. The playback process may specifically include the following steps:
[0167] S301: When the playback conditions are met, the terminal device 100 starts to play the activity material corresponding to the activity task.
[0168] When the playback condition is met, the terminal device 100 can start playing the activity material corresponding to the activity task that it has copied. Figure 5 The active tasks shown can refer to Figure 3 The newly created activity task is shown.
[0169] In some embodiments of the present application, the task type corresponding to the activity task is a timed task. In this case, the playback condition may include: the current time reaches the specified time of the alarm task corresponding to the activity task. Exemplarily, as shown in step S104, when the task type corresponding to the newly created activity task is a timed task, the playback condition that needs to be met to play the activity material corresponding to the newly created activity task can be understood as: the current time reaches the specified time of the new alarm task.
[0170] In some embodiments of the present application, the task type corresponding to the activity task is a manual task. In this case, the playback condition may include: the terminal device 100 receives a broadcast control instruction sent by the cloud device to instruct the playback of the activity material corresponding to the activity task. Exemplarily, as shown in step S106 and step S107, when the task type corresponding to the newly created activity task is a manual task, the playback conditions that need to be met to play the activity material corresponding to the newly created activity task can be understood as: the terminal device 100 receives a broadcast control instruction to instruct the playback of the activity material corresponding to the newly created activity task.
[0171] For an activity task whose task type is a manual task, the playback conditions may also include: the format of the broadcast control instruction meets the preset task format, and the current time is between the activity start time and activity end time corresponding to the activity task, and the terminal side device 100 is in the demonstration scene (or it is determined that the terminal side device 100 is not in use).
[0172] S302: If a problem occurs before the activity material is completely played and the playback cannot be continued, the terminal device 100 determines whether the activity corresponding to the activity task is finished.
[0173] After the end-side device 100 starts playing the activity material corresponding to the activity task, if a problem occurs before the activity material corresponding to the activity task is played and the playback cannot continue, the end-side device 100 can determine whether the activity corresponding to the activity task has ended, that is, determine whether the current time has reached the activity end time corresponding to the activity task. If the activity corresponding to the activity task has not ended, the end-side device 100 can execute step S303. However, if the activity corresponding to the activity task has ended, that is, the current time has reached or is later than the activity end time corresponding to the activity task, the end-side device 100 can execute step S310.
[0174] S303: The terminal device 100 plays the activity material again.
[0175] If a problem occurs before the activity material is completely played and the playback cannot continue, and the activity corresponding to the activity task has not ended, the terminal device 100 can play the activity material corresponding to the activity task again (or replay).
[0176] S304: The terminal device 100 determines whether the activity material has been successfully played.
[0177] After the end-side device 100 replays the activity material corresponding to the activity task, it can monitor whether the activity material is successfully played, that is, detect whether there is a problem with the activity material during the playback process that makes it impossible to continue playing. If the activity material is successfully played, the end-side device 100 can execute step S305. However, if the activity material is not successfully played, that is, there is a problem with the activity material during the playback process that makes it impossible to continue playing, the end-side device 100 can execute step S310.
[0178] S305: The terminal device 100 determines whether the activity corresponding to the activity task is finished.
[0179] After the end-side device 100 determines that the activity material corresponding to the activity task has been successfully played, it can determine whether the activity corresponding to the activity task has ended, that is, whether the current time has reached the activity end time corresponding to the activity task. If the activity corresponding to the activity task has ended, that is, the current time has reached or is later than the activity end time corresponding to the activity task, the end-side device 100 can execute step S310. However, if the activity corresponding to the activity task has not ended, the end-side device 100 can execute step S306.
[0180] S306: The terminal device 100 determines whether a replay condition is met.
[0181] When the terminal device 100 determines that the activity corresponding to the activity task has not ended, the terminal device 100 can determine whether the terminal device 100 meets the replay condition. If the terminal device 100 meets the replay condition, the terminal device 100 can execute step S308, that is, the terminal device 100 can replay the activity material corresponding to the activity task, however, if the terminal device 100 does not meet the replay condition, the terminal device 100 can execute step S307, that is, the terminal device 100 can display the default interface.
[0182] In some embodiments of the present application, the replay condition may specifically include: the power level of the terminal device 100 is not less than a preset power threshold, and the temperature of the terminal device 100 is not greater than a preset temperature threshold. It is understood that the temperature of the terminal device 100 may refer to the temperature of the entire terminal device 100, or the temperature of the back shell, or the temperature of the chip, etc., and the present application does not limit this.
[0183] It is understandable that the preset power threshold and the preset temperature threshold can be set according to actual needs, and this application does not impose specific restrictions on this. For example, the preset power threshold can be 45% of the total power, and the preset temperature threshold can be 42 degrees Celsius.
[0184] S307: The terminal device 100 displays a default interface.
[0185] When the activity material corresponding to the activity task is successfully played and the activity corresponding to the activity task is not ended, if the terminal device 100 does not meet the replay condition, the terminal device 100 will not play the activity material again, but display the default interface. It can be understood that the default interface can be the default screen displayed when the terminal device 100 does not start playing the activity material (for example, the lock screen screen, the screen of the demonstration video).
[0186] S308: The terminal device 100 plays the activity material again.
[0187] When the activity material corresponding to the activity task is successfully played and the activity corresponding to the activity task has not ended, if the terminal device 100 meets the replay condition, the terminal device 100 can play the activity material again. It can be understood that after the terminal device 100 starts to play the activity material again, it can determine whether to execute step S302 or step S310 according to the actual situation. Specifically, if a problem occurs during the replay of the activity material and it cannot be played again, the terminal device 100 can execute step S302. If the activity material is successfully played again, the terminal device 100 can execute step S310.
[0188] S309: If the activity material is successfully played, the terminal device 100 determines whether the activity corresponding to the activity task is finished.
[0189] After the end-side device 100 starts playing the activity material corresponding to the activity task, if the activity material is successfully played, the end-side device 100 can determine whether the activity corresponding to the activity task is finished, that is, whether the current time reaches the activity end time corresponding to the activity task. If the activity corresponding to the activity task has not ended, the end-side device 100 can execute step S306. However, if the activity corresponding to the activity task has ended, that is, the current time has reached or is later than the activity end time corresponding to the activity task, the end-side device 100 can execute step S310.
[0190] S310: The terminal device 100 cleans up the relevant information of the activity task and the activity material corresponding to the activity task.
[0191] If the terminal device 100 determines that the activity corresponding to the activity task is finished, the terminal device 100 can clean up the relevant information of the activity task and the activity material corresponding to the activity task. In other words, the terminal device 100 can delete the previously saved relevant information of the activity task and the copied activity material (as shown in step S208).
[0192] Step S104, step S105, step S108, step S109, step S301, step S303 and step S308 in the aforementioned embodiment involve the playing of activity materials. A method for playing activity materials is specifically introduced below.
[0193] The following is a specific description using the end-side device 100 playing the activity material as an example. Figure 6 , Figure 6 This is a flow chart of a method for playing an activity material provided in an embodiment of the present application. The method for playing an activity material may include but is not limited to the following steps:
[0194] S401: When the playback conditions are met, the terminal device 100 obtains the current system time, the activity start time and the offset factor.
[0195] It is understandable that the specific playback conditions can refer to the relevant description of step S301, and this application will not go into details here.
[0196] It is understandable that the system current time is the current time obtained by the terminal device 100 based on its operating system, and the terminal device 100 can obtain the system current time based on its operating system. In some embodiments of the present application, the system current time obtained by different terminal devices may be different.
[0197] It is understandable that the terminal side device 100 can obtain the activity start time corresponding to the activity task from the relevant information of the activity task.
[0198] It is understandable that the offset factor can be used to represent the time offset. In some embodiments of the present application, the offset factor may include any one or more of the following: a device offset factor, a hardware offset factor, and a system platform offset factor. Among them, the device offset factor may represent the time offset caused by different device models on the end side, the hardware offset factor may represent the time offset caused by different device hardware (for example, chips) on the end side, and the system platform offset factor may represent the time offset caused by different operating systems on the end side device. Exemplarily, the device offset factor may be set to 10 milliseconds (ms), and the hardware offset factor and the system platform offset factor may both be set to 0.
[0199] It is understandable that the offset factor may also include other types of time offsets (eg, the estimated duration required to perform corresponding calculations), and the present application does not impose any limitation on this.
[0200] S402: The client device 100 determines the playback offset duration based on the current system time, the activity start time, and the offset factor.
[0201] For ease of description, this application records the current system time as time, the activity start time as startTime, the device offset factor as deviceOffset, the hardware offset factor as hardOffset, the system platform offset factor as systemOffset, and the playback offset duration as offset.
[0202] In some embodiments of the present application, the offset factor may only include the device offset factor. In this case, the end-side device 100 may determine the play offset duration based on the following formula: offset=time-startTime+deviceOffset.
[0203] Similarly, in some embodiments of the present application, the offset factor may only include a hardware offset factor. In this case, the end-side device 100 may determine the play offset duration based on the following formula: offset = time - startTime + hardOffset.
[0204] Similarly, in some embodiments of the present application, the offset factor may only include the system platform offset factor. In this case, the terminal device 100 may determine the play offset duration based on the following formula: offset = time - startTime + systemOffset.
[0205] In some embodiments of the present application, the offset factor may include only the device offset factor and the hardware offset factor. In this case, the end-side device 100 may determine the playback offset duration based on the following formula:
[0206] Similarly, in some embodiments of the present application, the offset factor may only include the device offset factor and the system platform offset factor. In this case, the end-side device 100 may determine the playback offset duration based on the following formula:
[0207] Similarly, in some embodiments of the present application, the offset factor may include only the hardware offset factor and the system platform offset factor. In this case, the end-side device 100 may determine the playback offset duration based on the following formula:
[0208] In some embodiments of the present application, the offset factor may include a device offset factor, a hardware offset factor, and a system platform offset factor. In this case, the end-side device 100 may determine the playback offset duration based on the following formula:
[0209] For example, time is 9:05:03 AM on August 28, 2023, startTime is 9:05:02 AM on August 28, 2023, deviceOffset is 10ms, and hardOffset and systemOffset are both 0. In this case, offset = 100ms + 10ms = 110ms. It can be understood that, according to the above, time and startTime can be expressed according to millisecond timestamps.
[0210] For example, time is 9:05:01 am on August 30, 2023, startTime is 9:05:02 am on August 28, 2023, deviceOffset is 10 ms, and hardOffset and systemOffset are both 0. In this case, offset = -100 ms + 10 ms = -90 ms.
[0211] S403: The terminal device 100 determines the total playback duration of the activity material, and determines the playback start position based on the playback offset duration.
[0212] The terminal device 100 can determine the total playback duration of the activity material to be played. After determining the playback offset duration, the terminal device 100 can determine the playback start position of the activity material based on the total playback duration and the playback offset duration of the activity material.
[0213] In some embodiments of the present application, when the terminal device 100 downloads the activity material based on the activity material link in the relevant information of the activity task, the total playback time of the activity material can be obtained. Specifically, the terminal device 100 can call the system codec capability to obtain the total playback time of the activity material.
[0214] For the convenience of description, this application records the total playback duration of the activity material as duration, and records the playback start position of the activity material as seekOffset.
[0215] It is understandable that the client device 100 may determine the remainder of the playback offset duration divided by the total playback duration, and determine the remainder to be played as the playback start position, that is, seekOffset = offset%duration.
[0216] It is understandable that if the total playback duration of the activity material is greater than the playback offset duration, the terminal device 100 can determine that the playback start position of the activity material is the offset time of the activity material. For example, if the total playback duration (i.e., duration) of the activity material is 12000ms and the playback offset duration (i.e., offset) is 11000ms, then the playback start position of the activity material is the 11000ms of the activity material.
[0217] It is understandable that if the total playback duration of the activity material is less than the playback offset duration, the terminal device 100 can determine the playback start position of the activity material as the remainder of the playback offset duration divided by the total playback duration. For example, if the total playback duration of the activity material is 10000ms and the playback offset duration (i.e., offset) is 11000ms, then the playback start position of the activity material is the 1000ms of the activity material.
[0218] S404: The terminal device 100 jumps to the playback start position and starts playing the activity material.
[0219] After the terminal device 100 determines the playback start position, it can directly jump to the playback start position to start playing the activity material.
[0220] Exemplarily, the total playing time of the activity material is 20000 ms, and the playing start position is the 11000 ms of the activity material, then the terminal device 100 can jump to the 11000 ms of the activity material to start playing.
[0221] It is understandable that the specific methods for other first-category terminal devices to play activity materials can be referred to above, and this application will not go into details here.
[0222] It should be noted that the second type of terminal side device that establishes the second type of communication connection with the first type of terminal side device such as the terminal side device 100 can play the corresponding activity material based on the above-mentioned activity material playback method. Taking the terminal side device 300 as an example, when the playback conditions are met, the terminal side device 100 can execute the above steps S401-step S403 to determine the playback start position, and transmit the image data corresponding to the activity material starting from the playback start position to the terminal side device 300. In some embodiments of the present application, the terminal side device 100 can also determine which frame image of the activity material to start transmission from in combination with the transmission delay between the terminal side device 100 and the terminal side device 300. Exemplarily, the total playback time of the activity material is 20000ms, the playback start position is the 110ms of the activity material, and the terminal side device 100 estimates that the transmission time between the terminal side and the terminal side device 300 is 10ms, then the terminal side device 100 can start transmitting the image data corresponding to the 120ms of the activity material to the terminal side device 300.
[0223] It should also be noted that when the terminal device 100 performs steps S303 and S308, there is a difference between the execution of steps S104 and S108. When the terminal device 100 performs steps S104 and S108, reference can be made to the following. Figure 4 The steps shown are performed, and when the terminal side device 100 executes step S308, the active material can be played directly from the beginning. When the terminal side device 100 executes step S303, the starting position of playback when it is played again can be determined based on the historical playback position. That is, the terminal side device 100 needs to determine at which time point in the last playback of the active material a problem occurred, resulting in the inability to continue playing, and add the time difference when the terminal side device 100 executes step S302 to this time point, and finally obtain the starting position of playback when it is played again.
[0224] The following is an introduction to the device involved in the embodiments of the present application.
[0225] Figure 7 A schematic diagram of the hardware structure of a terminal device 100 provided in an embodiment of the present application.
[0226] like Figure 7 As shown, the terminal device 100 may include: a processor, an external memory interface, an internal memory, a Universal Serial Bus (USB) interface, a charging management module, a power management module, a battery, a communication module, a sensor module, a button, a motor, an indicator, a camera, a display screen, and a Subscriber Identity Module (SIM) card slot, etc. Among them, the communication module may include an antenna 1, an antenna 2, a mobile communication module and a wireless communication module, etc. The audio module may include a speaker, a receiver, a microphone, an earphone interface, etc. The sensor module may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
[0227] The structure illustrated in the embodiments of the present application does not constitute a specific limitation on the terminal device 100. In some embodiments of the present application, the terminal device 100 may include more components than shown in the figure. For example, the terminal device 100 may also include other types of sensors. In some embodiments of the present application, the terminal device 100 may include fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device 100.
[0228] The end-side device 100 can realize the display function through a graphics processing unit (GPU), a display screen, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor may include one or more GPUs, which execute program instructions to generate or change display information. The display screen is used to display images, videos, etc. In some embodiments of the present application, the end-side device 100 may include one or more display screens.
[0229] The terminal device 100 can realize the communication function with other devices through the communication module, that is, the communication module can provide the terminal device 100 with the ability to establish a communication connection with other devices.
[0230] The mobile communication module can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the terminal device 100 .
[0231] The wireless communication module can provide wireless communication solutions including wireless local area network (WLAN) (for example, wireless fidelity network, referred to as Wi-Fi network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc., which are applied on the terminal device 100. The wireless communication module can be one or more devices integrating at least one communication processing module. The wireless communication module can receive electromagnetic waves via antenna 2, or convert signals into electromagnetic waves for radiation.
[0232] In some embodiments of the present application, the terminal-side device 100 may establish a wireless connection with other devices (eg, cloud-side devices) via a mobile communication module or a wireless communication module.
[0233] In some embodiments of the present application, antenna 1 can be coupled to a mobile communication module, and antenna 2 can be coupled to a wireless communication module, so that the terminal side device 100 can communicate with the network and other devices (for example, cloud side devices) through wireless communication technology.
[0234] The power management module can be used to connect the battery, the charging management module and the processor 110. The power management module receives input from the battery and / or the charging management module to power the processor, internal memory, external memory, display, camera and communication module. The power management module can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some embodiments of the present application, the terminal device 100 can obtain the current remaining power of the terminal device 100 through the power management module.
[0235] The temperature sensor can be used to detect temperature. In some embodiments of the present application, the terminal device 100 can detect its own temperature through a temperature sensor.
[0236] It is understandable that the terminal side device 300 may include a display screen and one or more interfaces (eg, a USB interface). For details, please refer to the above and will not be repeated here.
[0237] It is understandable that the hardware structure of other first-type terminal devices can refer to the hardware structure of the terminal device 100. The hardware structure of other second-type terminal devices can refer to the hardware structure of the terminal device 300.
[0238] Figure 8 A schematic diagram of the software structure of a terminal device 100 provided in an embodiment of the present application.
[0239] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes the Android system of a layered architecture as an example to exemplify the software structure of the terminal device 100.
[0240] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. Figure 8 As shown, the software framework of the terminal device 100 may include an application layer, an application framework layer, a system library, a runtime (Runtime), a hardware abstraction layer (HAL) and a kernel layer.
[0241] The application layer may include a series of application packages. Generally speaking, the application layer may include system applications and third-party applications. System applications are a series of core applications that come with the Android system. For example, system applications may include applications such as gallery, calendar, Bluetooth, and WLAN. Third-party applications are applications that users can choose to install. In some embodiments of the present application, users can download and install third-party applications in the application store.
[0242] In some embodiments of the present application, the application layer may include communication applications and demonstration applications. Among them, the communication application can be used for the end-side device 100 to establish a communication connection (for example, a long connection or a short connection) with the cloud-side device, that is, to provide a data transmission channel. The demonstration application can be used to control the playback of active materials. Specifically, the demonstration application can be used to control the start / interrupt / resume playback of active materials. In one possible implementation, the communication application and the demonstration application are both system applications. It is worth noting that the communication application and the demonstration application are applications developed to implement this solution (that is, multiple end-side devices play active materials at the same time, and combine short connections and long connections to communicate with cloud-side devices).
[0243] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer can include a series of system services. System services are modular components that focus on specific functions. The functions provided by the application framework API can communicate with system services to access the underlying hardware.
[0244] like Figure 8As shown, the application framework layer may also include an alarm service. The relevant description of the alarm service can be referred to above, and this application will not repeat it here.
[0245] The application framework layer may also include a content provider, a window manager, a resource manager, a phone manager, a notification manager, and a view system. The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions for the terminal device. For example, the management of call status (including connected, hung up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.
[0246] The system library can include multiple functional modules. For example: Surface Manager, Media Libraries, 3D graphics processing library (for example, OpenGL ES), 2D graphics engine (for example, SGL), etc. The specific meanings and functions of these functional modules can be referred to in the relevant technical documents, which will not be described in detail here. The specific meanings and functions of these functional modules can be referred to in the relevant technical documents, which will not be described in detail here.
[0247] The runtime is responsible for the scheduling and management of the system. The runtime includes the core library and the virtual machine.
[0248] The Hardware Abstraction Layer (HAL) is an interface layer between the operating system kernel and the upper-level software, and its purpose is to abstract the hardware. The hardware abstraction layer is an abstract interface driven by the device kernel, which is used to implement the application programming interface that provides access to the underlying device to the higher-level Java API framework. HAL can provide a standard interface to display the device hardware functions to the higher-level Java API framework. HAL contains multiple library modules, such as camera HAL, audio HAL, etc. Each library module implements an interface for a specific type of hardware component. When the system framework layer API requires access to the hardware of a portable device, the operating system will load the library module for the hardware component.
[0249] The kernel layer is the layer between hardware and software. The kernel layer is the foundation of the Android system. The kernel layer is responsible for hardware drivers, networking, power, system security, and memory management. The kernel layer is an intermediate layer between hardware and software, and its role is to pass application requests to the hardware. The kernel layer can include display drivers, camera drivers, audio drivers, and sensor drivers.
[0250] It should be noted that the application provides Figure 8 The software architecture diagram of the terminal device 100 shown is only an example and does not limit the specific module division in different layers of the Android system. For details, please refer to the introduction of the Android system software architecture in conventional technology. In addition, the display method provided by this application can also be implemented based on other operating systems, and this application will not give examples one by one.
[0251] It is understandable that the software structure of other first-category terminal-side devices may refer to the software structure of the terminal-side device 100 .
[0252] The following is based on Figure 8 The software structure of the terminal device 100 shown introduces a specific implementation method of the aforementioned embodiment from the perspective of software-hardware interaction.
[0253] See also Fig. 9 , Fig. 9 A schematic diagram of software and hardware interaction provided in an embodiment of the present application.
[0254] The terminal device 100 can establish a short connection with the cloud device at a preset interval. The terminal device 100 can establish a short connection with the cloud device through a communication application and a communication module. Fig. 9As shown, the communication application in the terminal device 100 can send a short connection establishment request to the communication module in the terminal device 100, and the communication module in the terminal device 100 then sends the short connection establishment request to the cloud device. Correspondingly, the cloud device can receive the short connection establishment request sent by the communication module in the terminal device 100, thereby successfully establishing a short connection request with the terminal device 100.
[0255] In some embodiments of the present application, the terminal device 100 needs to go through a three-way handshake to successfully establish a short connection request with the cloud device. In this case, the three-way handshake can be understood as a short connection establishment request, and the present application does not provide a specific description of the three-way handshake.
[0256] After the end-side device 100 successfully establishes a short connection with the cloud-side device, the cloud-side device can determine whether there is a newly created activity task. If there is a newly created activity task, the cloud-side device sends the relevant information of the activity task to the communication module in the end-side device 100, and then the communication module in the end-side device 100 transmits it to the demonstration application in the end-side device 100 through broadcast. After the demonstration application in the end-side device 100 receives the relevant information of the activity task, it can download the activity material corresponding to the activity task based on the relevant information of the activity task, and store the downloaded activity material corresponding to the activity task in the internal memory. After the demonstration application in the end-side device 100 receives the relevant information of the activity task, it can also instruct the alarm service in the end-side device 100 to set an alarm task based on the task type included in the relevant information of the activity task. When the alarm task set by the alarm service reaches the specified time, the alarm service can remind, that is, the alarm service can make a timed reminder based on the alarm task it sets.
[0257] According to the above, in some embodiments of the present application, the terminal side device may also determine whether the received information is related to a newly created activity task. In addition, the terminal side device may also determine whether the activity task corresponding to the received information meets a preset condition.
[0258] It can be understood that message transmission between the communication application and the presentation application in the terminal device 100 can be carried out through broadcasting.
[0259] When the task type corresponding to the activity task is a scheduled task, the alarm service in the terminal device 100 can broadcast a set Intent, which can trigger the demonstration application in the terminal device 100 to obtain the activity material corresponding to the activity task from the internal memory, and transmit the activity material corresponding to the activity task to the display screen in the terminal device 100 for display.
[0260] In the case where the task type corresponding to the activity task is a manual task, the alarm service in the terminal device 100 can broadcast the set Intent, which can trigger the communication application in the terminal device 100 to establish a long connection with the cloud device. Specifically, similar to the process of establishing a short connection, the communication application in the terminal device 100 can send a long connection establishment request to the communication module in the terminal device 100, and the communication module in the terminal device 100 then sends the long connection establishment request to the cloud device. Correspondingly, the cloud device can receive the long connection establishment request sent by the communication module in the terminal device 100, thereby successfully establishing a long connection request with the terminal device 100. After the terminal device 100 successfully establishes a long connection with the cloud device, the cloud device can send a broadcast control instruction to the communication module in the terminal device 100 to instruct the terminal device 100 to play the corresponding activity material. Correspondingly, the communication module in the terminal device 100 can receive the broadcast control instruction. After receiving the broadcast control instruction, the communication module in the terminal device 100 may send the broadcast control instruction to the communication application in the terminal device 100, and the communication application in the terminal device 100 may send the broadcast control instruction to the demonstration application in the terminal device 100. After receiving the broadcast control instruction, the demonstration application in the terminal device 100 may obtain the activity material corresponding to the activity task from the internal memory, and transmit the activity material corresponding to the activity task to the display screen in the terminal device 100 for display.
[0261] In some embodiments of the present application, the terminal device 100 needs to go through a three-way handshake to successfully establish a long connection request with the cloud device. In this case, the three-way handshake can be understood as a long connection establishment request, and the present application does not provide a specific description of the three-way handshake.
[0262] In some embodiments of the present application, the terminal device 100 can establish a communication connection (for example, a second type of communication connection) with the terminal device 300 through the communication application and the communication module therein. In this case, when the terminal device 100 is ready to start playing the activity material, it can also send the activity material to the terminal device 300, so that the terminal device 300 and the terminal device 100 can display the same screen at the same time. According to the above, the demonstration application in the terminal device 100 can obtain the activity material corresponding to the activity task from the internal memory. After the demonstration application in the terminal device 100 obtains the activity material, it can transmit the activity material to the communication application in the terminal device 100, and the communication application in the terminal device 100 transmits it to the communication module in the terminal device 100, and the communication module in the terminal device 100 transmits the activity material to the communication module in the terminal device 300. After the communication module in the terminal device 300 receives the activity material, it can send the activity material to the display screen for display.
[0263] In some embodiments of the present application, the terminal device 100 may consider the delay in transmitting the active material to the terminal device 300, and determine which frame of image data of the active material to start transmitting to the terminal device 300 based on the delay and the start position of the playback of the active material determined by it.
[0264] It is understood that the "simultaneous display" mentioned in this application may specifically refer to the time difference of displaying the same frame of image being less than the preset time difference. It is understood that the preset time difference may be set according to actual needs, and this application does not limit this.
[0265] It should be noted that when the demonstration application in the terminal device 100 stores activity materials and obtains activity materials from the internal memory, it is necessary to utilize the system encoding and decoding capabilities of the terminal device 100. Specifically, when the demonstration application in the terminal device 100 stores activity materials, it is necessary to encode the activity materials and then store the encoded activity materials in the internal memory. Correspondingly, when the demonstration application in the terminal device 100 obtains activity materials from the internal memory, it is necessary to decode the activity materials and then send the decoded activity materials to the display screen for display. The demonstration application in the terminal device 100 can send the activity materials obtained from the internal memory to the terminal device 300 through the communication application and the communication module. After the communication module in the terminal device 300 receives the activity materials sent by the terminal device 100, it can display them through the display screen without decoding the activity materials.
[0266] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A display method, characterized in that: Applied to a first terminal device; the method comprises: The first end-side device establishes a short connection with the cloud-side device at a preset time interval; In the case where the first terminal device establishes a short connection with the cloud device, the first terminal device receives first activity task information sent by the cloud device through the short connection; the first activity task information is related information of the first activity task; the first activity task is a task corresponding to the first activity; the first activity task information includes the start time of the first activity; The first terminal side device acquires the activity material of the first activity based on the first activity task information; In a case where the task type corresponding to the first activity task is the first task type, if the current time reaches the start time of the first activity, the first terminal-side device plays the acquired activity material of the first activity; In the case that the task type corresponding to the first activity task is the second task type, if the current moment reaches the first moment, the first end-side device establishes a long connection with the cloud-side device, and the first moment is earlier than the start time of the first activity; if the first end-side device receives the broadcast control instruction sent by the cloud-side device through the long connection, the first end-side device plays the acquired activity material of the first activity.
2. The method according to claim 1, characterized in that The first terminal side device plays the acquired activity material of the first activity, specifically including: The first end-side device obtains the current system time of the first end-side device, the start time of the first activity, and the offset factor of the first end-side device; the offset factor is used to represent the time offset caused by different operating systems and / or hardware and / or models of the end-side device; The first end-side device determines the playback offset duration based on the current system time of the first end-side device, the start time of the first activity, and the offset factor of the first end-side device; The first terminal-side device determines a total playback duration of the activity material of the first activity, and determines a playback start position of the activity material of the first activity based on the playback offset duration; The first terminal-side device jumps to the playback start position and starts playing the activity material of the first activity; Among them, if the total playback time of the activity material of the first activity is greater than the playback offset time, the playback start position is the position when the activity material of the first activity has been played to the playback offset time; if the total playback time of the activity material of the first activity is less than the playback offset time, the playback start position is the remainder of the playback offset time divided by the total playback time of the activity material of the first activity.
3. The method according to claim 2, characterized in that The offset factor includes any one or more of the following: a device offset factor, a hardware offset factor, and a system platform offset factor; the playback offset duration is the sum of a first value and a second value; the first value is the difference between the current system time of the first end-side device and the start time of the first activity, and the second value is the square root of the sum of the squares of each item in the offset factor; the playback starting position is the remainder of the playback offset duration divided by the total playback duration of the activity material of the first activity.
4. The method according to any one of claims 1 to 3, characterized in that The first end-side device establishes a communication connection with at least one end-side device; and the method further includes: In a case where the first end-side device plays the activity material of the first activity, the at least one end-side device plays the activity material of the first activity; In which, during the process of the first end-side device and the at least one end-side device playing the activity material of the first activity, the first end-side device and the at least one end-side device display the same picture at the same time.
5. The method according to any one of claims 1 to 3, characterized in that The first terminal side device plays the acquired activity material of the first activity, specifically including: If the first terminal side device completes playing of the activity material of the first activity, or a problem occurs during the process of the first terminal side device playing the activity material of the first activity, so that the first terminal side device cannot continue playing, the first terminal side device determines whether the first activity is ended; If the first activity ends, the first terminal device clears the first activity task information and the activity materials of the first activity; If a problem occurs during the process of the first end-side device playing the activity material of the first activity, resulting in inability to continue playing, and the first activity has not ended, the first end-side device plays the activity material of the first activity again; If the first end-side device completes the playback of the activity material of the first activity and the first activity has not ended, the first end-side device determines whether a re-play condition is met; if the first end-side device meets the re-play condition, the first end-side device plays the activity material of the first activity again; if the first end-side device does not meet the re-play condition, the first end-side displays a default interface.
6. The method according to claim 5, characterized in that The first end-side device satisfies the replay condition, which specifically includes: the power of the first end-side device is not less than a preset power threshold, and the temperature of the first end-side device is not greater than a preset temperature threshold.
7. The method according to any one of claims 1 to 3, characterized in that Before the first terminal side device acquires the activity material of the first activity based on the first activity task information, the method further includes: The first terminal device determines that the format of the first activity task information is a preset task format, the format of the activity material of the first activity is a preset material format, and the start time of the first activity is later than the current time; The first end-side device determines that before the first end-side device receives the first activity task information, the first end-side device has not received relevant information about the task corresponding to the first activity, or the first end-side device has received relevant information about the task corresponding to the first activity that is different from the first activity task information.
8. The method according to any one of claims 1 to 3, characterized in that The first activity task information includes a first link; The first terminal side device acquires the activity material of the first activity based on the first activity task information, specifically including: The first terminal device copies the activity material of the first activity based on the first link; If the first end-side device fails to successfully copy the activity material of the first activity based on the first link, and the number of times the first end-side device has copied the activity material of the first activity is not greater than a preset number of copies, the first end-side device copies the activity material of the first activity again based on the first link.
9. A display method, characterized in that: Applied to a cloud-side device; the method comprises: In a case where the cloud-side device establishes short connections with the multiple end-side devices respectively, the cloud-side device sends the first activity task information to the multiple end-side devices respectively through the short connections; In the case where the task type corresponding to the first activity task is the second task type, if the current moment reaches the first moment, the cloud-side device establishes a long connection with the multiple terminal-side devices respectively, and the first moment is earlier than the start time of the first activity; the cloud-side device sends a broadcast control instruction to the multiple terminal-side devices respectively through the long connection; the broadcast control instruction is used to instruct the multiple terminal-side devices to play the activity material of the first activity; Among them, each of the multiple terminal-side devices establishes a short connection with the cloud-side device once at a preset time interval, and the first activity task information is the relevant information of the first activity task; the first activity task is the task corresponding to the first activity; the first activity task information includes the start time of the first activity; the first activity task information is used to instruct the multiple terminal-side devices to obtain the activity material of the first activity, and play the activity material of the first activity when the task type corresponding to the first activity task is the first task type and the current time reaches the start time of the first activity.
10. A terminal side device, characterized in that: include: A communication module, one or more memories, and one or more processors; the one or more processors are coupled to the communication module and the one or more memories, the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the end-side device executes the method as described in any one of claims 1 to 8.
11. A cloud-side device, characterized in that: include: A communication module, one or more memories, and one or more processors; the one or more processors are coupled to the communication module and the one or more memories, the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the cloud-side device executes the method as claimed in claim 9.
12. A computer storage medium, characterized in that: include: Computer instructions; when the computer instructions are executed on an end-side device, the end-side device executes the method as described in any one of claims 1-8.
13. A computer storage medium, characterized in that: include: Computer instructions; when the computer instructions are executed on a cloud-side device, the cloud-side device executes the method as described in claim 9.
