Multimedia management system and method for a domestic appliance

Abstract

This application discloses a multimedia management system and method for home appliances, relating to the field of home appliance technology. The multimedia management platform includes: at least two multimedia applications; a multimedia management platform connected to the multimedia applications; and the multimedia management platform controlling the multimedia applications to execute multimedia tasks in a set order through the operating system of the home appliance. In other words, the various multimedia applications in this application do not play out of order, but are uniformly scheduled by the multimedia management platform according to certain rules. This avoids simultaneous playback and sound mixing when multiple multimedia applications need to perform multimedia tasks, thus preventing users from missing useful information in a timely manner. This makes multimedia playback more planned and improves the user experience.

Description

Technical Field

[0001] This application belongs to the field of smart home technology, and more specifically, relates to a multimedia management system and method for home appliances. Background Technology

[0002] With the development of smart home appliances, more and more appliances can play multimedia to remind users of their status. However, due to the lack of a unified coordination mechanism, multiple applications may play audio simultaneously, resulting in mixed sounds that fail to convey key information to the user. For example, if the washing machine finishes its cycle and the user interacts with the machine simultaneously, the mixed sounds will make it difficult for the user to hear clearly, making it impossible to obtain the appliance's status and reducing the user experience. Summary of the Invention

[0003] The technical problem to be solved by this application is to overcome the shortcomings of the prior art and provide a multimedia management system and method for home appliances, so as to solve the problem of lack of unified scheduling for multimedia playback of home appliances in the prior art.

[0004] To solve the above-mentioned technical problems, the basic concept of the technical solution adopted in this application is as follows:

[0005] A multimedia management system, comprising,

[0006] At least two multimedia applications; a multimedia management platform connected to the multimedia applications; the multimedia management platform controls the multimedia applications to execute multimedia tasks in a set order through the operating system of the home appliance.

[0007] Furthermore, the multimedia management platform creates different media streams according to the multimedia task type, and the multimedia management platform controls the multimedia application to control the media streams in a set order through the operating system of the home appliance to execute the multimedia task.

[0008] Furthermore, the multimedia management platform sends active focus to the media stream according to the set order, and the multimedia management platform controls the multimedia application to execute the multimedia task on the media stream holding the active focus through the operating system of the home appliance; the active focus is used to represent the priority of the media stream.

[0009] Furthermore, the multimedia management platform sets the priority of the media stream according to the multimedia task type, determines the set order according to the priority of the media stream, and sends the activity focus to the media stream with the highest priority.

[0010] Furthermore, the multimedia task types include at least one of the following: interaction, status announcement, and background music; different task types correspond to different priorities.

[0011] Furthermore, the multimedia management platform sends the activity focus to the media stream with the highest priority based on the execution request of the media stream corresponding to the multimedia task sent by the multimedia application.

[0012] Furthermore, the multimedia management platform locks the activity focus onto the media stream and prevents other media streams from acquiring the activity focus.

[0013] Furthermore, the multimedia management platform obtains the type of focus lock based on the execution request; when the focus lock is a forced lock, the multimedia management platform controls each media stream to release all currently active focus and locks the active focus to the media stream.

[0014] Furthermore, the multimedia management platform locks the activity focus onto the media stream within a preset time range.

[0015] Furthermore, this application also provides a multimedia management method for home appliances, the method comprising: a multimedia application sending an execution request to a multimedia management platform; the multimedia management platform determining a set order based on the execution request; and the multimedia management platform controlling the multimedia application to execute multimedia tasks according to the set order.

[0016] By adopting the above technical solution, this application has the following beneficial effects compared with the prior art: This application manages multiple multimedia applications to execute multimedia tasks according to a set order by setting a multimedia management platform in home appliances. In other words, the multimedia applications do not play randomly, but are uniformly scheduled by the multimedia management platform according to certain rules. This avoids simultaneous playback and sound mixing when multiple multimedia applications need to perform multimedia tasks, thus preventing users from missing useful information in a timely manner. This makes multimedia playback more planned and improves the user experience. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of a multimedia management system provided in an embodiment of this application;

[0020] Figure 2 This is a schematic diagram of another multimedia management system provided in an embodiment of this application;

[0021] Figure 3 This is a schematic diagram illustrating the interaction between an external application and a media stream, as provided in an embodiment of this application.

[0022] Figure 4 This is a schematic diagram of a process for obtaining active focus in a media stream, provided in an embodiment of this application.

[0023] Figure 5 This is a schematic diagram of another process for obtaining active focus in a media stream, provided in an embodiment of this application.

[0024] Figure 6 This is a schematic diagram of a media stream focus locking process provided in an embodiment of this application;

[0025] Figure 7 This is a schematic diagram of another media stream focus locking process provided in an embodiment of this application. Detailed Implementation

[0026] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0027] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0028] To facilitate understanding, some of the terms used in the embodiments of this application will be introduced below.

[0029] With the development of technology, many home appliances with screens can display content and play audio and video. However, these appliances lack a unified audio and video focus management mechanism. Therefore, when multiple applications or devices play audio and video simultaneously, sound mixing can occur, making it difficult for users to hear certain audio or video clearly.

[0030] For example, in a washing machine with intelligent voice interaction, if another app suddenly announces "The clothes are done" while the voice interaction app is playing its dialogue response, the washing machine's response and the wash completion notification will be mixed up, making it difficult for the user to hear the conversation clearly. Similarly, if another app plays "The clothes are done" while the washing machine is "listening" to a recorded user speech, resulting in an unclear recording, the voice interaction app may not be able to correctly recognize what the user is saying. All of this slows down the normal operation of the voice interaction function, reduces interaction efficiency, and negatively impacts the user experience.

[0031] To address the aforementioned problems, this application provides a multimedia management system that offers unified multimedia management for home appliances, thereby preventing sound mixing. Please refer to the following for details. Figure 1 ,like Figure 1 As shown, the system includes:

[0032] At least two multimedia applications.

[0033] Multimedia management platform: Connected to multimedia applications; the multimedia management platform controls the multimedia applications to execute multimedia tasks in a set order through the operating system of home appliances.

[0034] This system can be applied to household appliances, including but not limited to: refrigerators, washing machines, and water heaters.

[0035] Specifically, the system may include at least two multimedia applications. It should be understood that, in practice, multimedia applications can generate multimedia tasks, and this application does not specifically limit the number of multimedia applications in the system; it can be any number greater than two.

[0036] The multimedia tasks here include, but are not limited to, at least one of the following: video, audio, and text.

[0037] The multimedia management platform can connect with various multimedia applications. For example, the multimedia management platform can communicate with various multimedia applications via the Internet, thereby controlling the various media streams to execute multimedia tasks in a set order.

[0038] The multimedia management platform can control various multimedia applications to execute multimedia tasks in a set order. This set order can include, but is not limited to, the order in which multiple multimedia applications execute multimedia tasks, or the order in which any single multimedia application executes multimedia tasks. For example, a first application in a water heater can generate tasks A and B, and a second application can generate task C. The multimedia management platform can determine, based on a certain mechanism (e.g., multimedia task type classification), that the first application needs to execute tasks A and C, and the second application needs to execute task B. The set order includes not only the order in which the first and second applications execute tasks, but also whether the first application executes task A or task C first. Please refer to [reference needed] for details. Figure 2 ,like Figure 2 As shown, multimedia applications may include voice interaction applications, audio playback applications, video playback applications, and other applications. In this case, the multimedia application can send an execution request to the multimedia management platform. This request is used to request the execution of multimedia tasks. The multimedia management platform can control the multimedia application to execute multimedia tasks through the operating system (such as Linux or RTOS).

[0039] Optionally, the execution request can carry the playback requirements of each application. Furthermore, the request can also carry the focus type (detailed below). Based on the focus type required by the multimedia application, the multimedia management platform can assign the corresponding type of active focus. The multimedia management platform can classify and sort multimedia tasks of different multimedia applications according to a certain mechanism, grouping multimedia tasks with the same characteristics (e.g., urgency) into one category, and creating media streams according to task type. The multimedia management platform controls the multimedia applications through the operating system of the home appliance to control the media streams in a set order to execute the multimedia tasks. In other words, multimedia tasks of the same category will be assigned to the same media stream for execution.

[0040] Please refer to the details. Figure 3 ,like Figure 3 As shown, external application 1, external application 2 and external application 3 can control the interface interactive media stream, voice interactive media stream and status broadcast media stream respectively through the multimedia management platform (not shown in the figure), and the media stream player controls the speaker or microphone to perform multimedia tasks.

[0041] This application does not specifically limit the interaction method between external applications and the multimedia management platform, including but not limited to at least one of the following: inter-process communication and remote procedure call.

[0042] This application does not specifically limit the method of multimedia task classification. For example, multimedia tasks can be classified according to their purpose, including but not limited to at least one of the following: interaction (e.g., interface interaction and voice interaction), device status announcements, background music / audio, and video / audio. Interface interaction audio can be the response sound when interacting with a display screen or pressing buttons. Voice interaction can be the sound played by a voice assistant when interacting with a voice assistant, as well as the user's recorded voice. Status announcements can be status notification sounds from smart home appliances. Music / audio can be background music. Video / audio can be sound from a video.

[0043] In summary, this application establishes a multimedia management platform within home appliances to manage multiple multimedia applications that execute multimedia tasks in a pre-defined order. This means that the multimedia applications do not play randomly; instead, the multimedia management platform schedules them according to certain rules. This prevents simultaneous playback and sound mixing when multiple applications need to perform multimedia tasks, ensuring that users can access useful information promptly. This more planned multimedia playback enhances the user experience.

[0044] It should be noted that this application does not specifically limit the way the multimedia management platform obtains the setting order.

[0045] Optionally, the multimedia management platform can also determine the setting order of multimedia applications according to a certain mechanism.

[0046] As described above, different multimedia tasks have clear priority relationships. For example, the execution priority of device status announcements should be higher than that of background music. This application allocates different media streams to different types of multimedia tasks, meaning that each media stream also has a priority relationship at the execution level. Correspondingly, the media stream responsible for playing device status information has a higher execution priority than the media stream responsible for playing background music. Thus, based on the priority of each media stream, the highest-priority media stream among those required to perform multimedia tasks can be determined.

[0047] For example, the multimedia management platform determines a set order based on the multimedia task type and the priority of the media streams, and sends the active focus to the media stream with the highest priority. The active focus can be understood as a multimedia management mechanism where only the media stream holding the active focus can execute a multimedia task. That is, when multiple media streams in the system want to execute a multimedia task, only the media stream holding the active focus can play, while other media streams need to wait. When the multimedia management platform detects that the media stream holding the active focus has released its active focus, it can send the active focus to the next highest-priority media stream according to the set order.

[0048] Optionally, the multimedia management platform can send the activity focus to the media stream with the highest priority based on the execution request of the media stream corresponding to the multimedia task sent by the multimedia application. In other words, the multimedia management platform will only create or control the corresponding media stream after the multimedia application sends an execution request to it.

[0049] To facilitate understanding, the following explanation will be provided with specific examples. Please refer to... Figure 4 ,like Figure 4 As shown, a media stream can send an execution request to a multimedia service (i.e., a multimedia management platform). The multimedia service can determine whether the media can obtain active focus based on a certain mechanism. If the media has the highest priority, active focus is sent to the media, and then `play` can be called to start executing the multimedia task. If the media's priority is not high enough, `AddToPlayList` needs to be called, which adds the multimedia task to the playback queue and sets the `Play On Focus` property, meaning that execution will only begin when the media has active focus.

[0050] There are several types of active focus. That is, when a multimedia application sends an execution request to the multimedia management platform, it can include the type of active focus. The multimedia management platform can obtain the focus type by reading the execution request. Focus types include, but are not limited to, at least one of the following: long-term focus, short-term exclusive focus, and short-term parallel focus.

[0051] For example, when the type of active focus in the execution request is long-lasting focus, the multimedia management platform controls other media streams, except those that issued the request and have a lower priority than the media stream corresponding to the multimedia application that issued the request, to clear the multimedia task and send the active focus to the media stream that issued the request.

[0052] For example, when the active focus is a short-term exclusive focus, and the media stream currently holding the active focus is different from the media stream that issued the request, the multimedia management platform controls the media stream holding the active focus to release the active focus and send the active focus to the target media stream, that is, to pause the playback of the media stream with lower priority.

[0053] For example, when the activity focus is a short-term parallel focus, the multimedia management platform will reduce the playback volume of media streams with lower priority in order to execute multimedia tasks simultaneously.

[0054] In summary, such as Figure 5As shown, the execution process of each media stream and the multimedia management platform can be as follows: S1, after receiving the request, the multimedia management platform determines whether any media stream currently holds active focus. If not, proceed to S2, whereby the media stream that initiated the request obtains the active focus. If a media stream currently holds active focus, proceed to S3, where the multimedia management platform determines whether the media stream that initiated the request holds active focus. If so, proceed to S4, whereby the focus result is returned. If not, proceed to S5, whereby the media stream that initiated the request has a higher priority than the media stream that holds active focus. If so, proceed to S6, whereby the multimedia management platform controls the media stream that holds active focus to lose active focus. The media stream that loses active focus can then proceed to S7, whereby the media stream that lost active focus performs a response operation based on the focus request type of the media stream that initiated the request, until S2, where it regains active focus. If the media stream that initiated the request has a lower priority than the media stream that holds the active focus, then S8 is executed, that is, the media stream that initiated the request enters the focus waiting queue until S9, that is, the higher priority media stream releases the focus. After the multimedia management platform detects that a media stream has released the focus, it can send the active focus to the media stream that initiated the request.

[0055] In certain scenarios, such as continuous dialogue in voice interaction, media streams need to maintain active focus for a period of time to ensure the continuity of the conversation. In this case, a media stream or multimedia application can request focus locking, meaning that other media streams are not allowed to request and obtain focus. When the multimedia management platform receives a focus locking request, it releases all currently active focuses and locks the active focus to the requesting media stream, or the media stream corresponding to the requesting multimedia application.

[0056] If multiple media streams or multimedia applications simultaneously request focus locking for different media streams, the multimedia management platform can first determine if focus locking already exists. If not, it can send active focus to the media stream with the highest priority that initiated the focus locking request, and then lock the focus. If a media stream is already locking focus, it needs to further determine whether the media stream holding the active focus is the one that initiated the request. If it is, then that media stream is the target media stream; if they are different, focus locking cannot be performed.

[0057] Optionally, if focus locking succeeds or fails, the multimedia management platform can return the locking result to the media stream or multimedia application that sent the request.

[0058] To prevent situations where external applications cannot unlock focus after requesting focus lock due to certain reasons (such as process crashes), resulting in other applications being unable to obtain focus for a long time, focus lock requests can only be made for a certain lease period. If the media stream is not renewed within the lease period, the multimedia management platform will automatically unlock the focus.

[0059] For easier understanding, please refer to Figure 6 ,like Figure 6 As shown, media streams or multimedia applications need to apply to the multimedia management platform for focus locking. Once the application is successful, the media stream or application corresponding to the requesting media stream or multimedia application can hold the active focus within a preset time range. When the lease expires, the requesting media stream or multimedia application can, based on its actual situation (e.g., determining whether the user's call has ended), if it hasn't ended, it needs to renew the lock, and the requesting media stream or multimedia application needs to resend the request. If the call has ended, the active focus can be automatically released. Alternatively, if the lease hasn't expired, the requesting media stream or multimedia application can send a request to the multimedia management platform to unlock the active focus.

[0060] It should be noted that this application does not specifically limit the exact value of the preset time range, which can be determined according to the actual situation.

[0061] Optionally, when a media stream is focusing, a higher-priority media stream may hold the active focus. If the media stream or multimedia application specifies "forced focus lock" when requesting focus locking, the multimedia management platform will directly release the active focus of the higher-priority media stream, allowing the requesting media stream or the media stream corresponding to the multimedia application to directly gain focus. If the media stream or multimedia application does not specify "forced focus lock" when requesting focus locking, the multimedia management platform will wait for the higher-priority media stream to release its active focus before allowing the requesting media stream or the media stream corresponding to the multimedia application to directly gain focus. To prevent the requesting media stream from being stuck in a waiting state due to a higher-priority media stream not releasing its active focus for an extended period, the multimedia management platform will monitor the holding time of the active focus. If the waiting time exceeds a preset threshold, a request failure message will be sent to the requesting media stream.

[0062] This application does not specifically limit the way in which the focus of the monitoring activity is held for the multimedia platform, including but not limited to at least one of the following: setting a timer (e.g., a real-time clock timer, a software timer, or a network timer) and a TimeOut parameter.

[0063] For ease of understanding, this application provides an example; please refer to the following for details. Figure 7 ,like Figure 7As shown: When a media stream sends a focus request, the multimedia management platform first determines if there is currently a focus lock. If not, it further determines if the requesting media stream holds an active focus. If not, it determines if the focus type carried in the focus request is a forced lock. If so, the multimedia management platform can directly execute focus locking. If not, it can request focus. If it acquires focus within a preset time range, focus locking can be executed, and a lock success result is returned to the media stream. If it does not acquire focus within the preset time range, a lock failure message is returned to the media stream. If the focus type carried in the focus request is a forced lock, the multimedia management platform releases all media streams holding active focus, sends the active focus to the requesting media stream, and performs focus locking. If there is currently a focus lock, it needs to further determine if the focus lock is being performed by the currently requesting media stream. If so, the focus lock is successful; otherwise, the focus lock fails.

[0064] The above is a multimedia management system provided by this application. The above examples can be combined with other systems according to actual conditions. This application does not impose any specific restrictions on them.

[0065] It is important to note that the multimedia management platform of this application can also manage the multimedia playback of different home appliances. In other words, the multimedia management platform can not only manage the playback order of individual home appliances, but also manage the playback order of multiple home appliances in a home. For example, when a water heater and a washing machine simultaneously intend to play multiple audio clips, the multimedia management platform can determine the priority of the audio clips they intend to play, prioritizing the device with the highest audio priority. If the water heater and washing machine intend to play audio clips with the same priority, a certain mechanism (e.g., device priority) will determine which device will play first. If the water heater has a higher priority than the washing machine, the water heater will play the audio clip with priority x first. After the water heater finishes playing its audio clip with priority x, the washing machine will then play its audio clip with priority x.

[0066] In addition, this application also provides a multimedia management method, the method comprising: a multimedia application sending an execution request to a multimedia management platform; the multimedia management platform determining a set order based on the execution request; and the multimedia management platform controlling the multimedia application to execute multimedia tasks according to the set order.

[0067] Furthermore, the multimedia management platform creates different media streams according to the multimedia task type, and the multimedia management platform controls the multimedia application to control the media streams in a set order through the operating system of the home appliance to execute the multimedia task.

[0068] Furthermore, the multimedia management platform sends active focus to the media stream according to the set order, and the multimedia management platform controls the multimedia application to execute the multimedia task on the media stream holding the active focus through the operating system of the home appliance; the active focus is used to represent the priority of the media stream.

[0069] Furthermore, the multimedia management platform sets the priority of the media stream according to the multimedia task type, determines the set order according to the priority of the media stream, and sends the activity focus to the media stream with the highest priority.

[0070] Furthermore, the multimedia task types include at least one of the following: interaction, status announcement, and background music; different task types correspond to different priorities.

[0071] Furthermore, the multimedia management platform sends the activity focus to the media stream with the highest priority based on the execution request of the media stream corresponding to the multimedia task sent by the multimedia application.

[0072] Furthermore, the multimedia management platform locks the activity focus onto the media stream and prevents other media streams from acquiring the activity focus.

[0073] Furthermore, the multimedia management platform obtains the type of focus lock based on the execution request; when the focus lock is a forced lock, the multimedia management platform controls each media stream to release all currently active focus and locks the active focus to the media stream.

[0074] Furthermore, the multimedia management platform locks the activity focus onto the media stream within a preset time range.

[0075] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention in any way. Although the present invention has been disclosed above with reference to preferred embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications or alterations to the above-described technical content to create equivalent embodiments without departing from the scope of the present invention. The implementation schemes in the above embodiments can also be further combined or replaced. Any simple modifications, equivalent changes and alterations made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the scope of the present invention.

Claims

1. A multimedia management system for home appliances, characterized in that, include, At least two multimedia applications; Multimedia management platform: connects to multimedia applications; The multimedia management platform controls multimedia applications to execute multimedia tasks in a set sequence through the operating system of home appliances.

2. A multimedia management system for home appliances as described in claim 1, characterized in that, The multimedia management platform creates different media streams according to the multimedia task type. The multimedia management platform controls the multimedia application to control the media streams in a set order through the operating system of the home appliance to execute the multimedia task.

3. A multimedia management system for home appliances as described in claim 1 or 2, characterized in that, The multimedia management platform sends the active focus to the media stream according to the set order, and the multimedia management platform controls the multimedia application to execute the multimedia task on the media stream corresponding to the active focus through the operating system of the home appliance; The activity focus is used to characterize the priority of the media stream.

4. A multimedia management system for home appliances as described in any one of claims 1-3, characterized in that, The multimedia management platform sets the priority of the media stream according to the multimedia task type, determines the set order according to the priority of the media stream, and sends the activity focus to the media stream with the highest priority.

5. A multimedia management system for home appliances as described in claim 4, characterized in that, The multimedia task types include at least one of the following: interaction, status announcement, and background music; different task types correspond to different priorities.

6. A multimedia management system for home appliances as described in any one of claims 3-5, characterized in that, The multimedia management platform sends the activity focus to the media stream with the highest priority based on the execution request of the media stream corresponding to the multimedia task sent by the multimedia application.

7. A multimedia management system for home appliances as described in any one of claims 3-6, characterized in that, The multimedia management platform locks the activity focus onto the media stream and prevents other media streams from acquiring the activity focus.

8. A multimedia management system for home appliances as described in claim 7, characterized in that, The multimedia management platform obtains the type of focus lock based on the execution request; When the focus lock is forced, the multimedia management platform controls each media stream to release all currently active focus and lock the active focus to the media stream.

9. A multimedia management system for home appliances as described in claim 7 or 8, characterized in that, Within a preset time range, the multimedia management platform will focus the activity on the media stream.

10. A multimedia management method for household appliances, characterized in that, The method includes: The multimedia application sends an execution request to the multimedia management platform; The multimedia management platform determines the setting sequence based on the execution request; The multimedia management platform controls multimedia applications to execute multimedia tasks according to the set sequence.

Images