A method and system for operating a sound device using an extended sound device

The system enhances multimedia device capabilities by integrating nearby devices' resources, addressing suboptimal user experiences by ensuring high-quality playback and optimized resource utilization.

WO2026005577A1PCT designated stage Publication Date: 2026-01-02SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/099215
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-25
Filing Date
2025-02-03
Publication Date
2026-01-02

AI Technical Summary

Technical Problem

Multimedia devices within an ecosystem often compromise on content quality due to hardware limitations, leading to suboptimal user experiences when devices with higher capabilities are not fully utilized for synchronized playback.

Method used

A system and method that dynamically integrates and extends the capabilities of sound devices by leveraging a networked ecosystem of nearby devices, sharing and extending capabilities through modules like capability determination, device insertion, and capability extension, ensuring high-quality audio experiences without frequent hardware updates.

Benefits of technology

Enables seamless integration and enhanced performance of multimedia devices, maximizing resource utilization and ensuring high-quality media playback by dynamically adjusting to the best available capabilities in the network, thereby optimizing user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025099215_02012026_PF_FP_ABST
    Figure KR2025099215_02012026_PF_FP_ABST
Patent Text Reader

Abstract

A method for operating a sound device using an extended sound device. The method includes receiving capability information from a plurality of nearby sound devices present in a device ecosystem. The method also includes estimating capabilities required for the sound device based on the received capability information of the plurality of nearby sound devices. The method further includes inserting, in the device ecosystem, the extended sound device with the estimated capabilities. The method includes adding an extended capability kernel in a device node of the sound device. The method includes configuring the sound device using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.
Need to check novelty before this filing date? Find Prior Art

Description

A METHOD AND SYSTEM FOR OPERATING A SOUND DEVICE USING AN EXTENDED SOUND DEVICE

[0001] This disclosure generally relates to multimedia devices, and more particularly relates to a system and a method for operating a sound device using an extended sound device for extending the capabilities of the multimedia devices.

[0002] Usually, multimedia devices, such as TVs, soundbars, speakers, etc., are commonly used to play various media contents, either individually or in a synchronized group setup. Each type of device within an ecosystem typically possesses different hardware capabilities that impact the ability of devices within the ecosystem to decode and render media content.

[0003] In some existing techniques, the media content is often adjusted to match the lowest hardware capability among the devices in the ecosystem. For example, if a high-definition audio file needs to be played, but one of the devices cannot decode the hi-fi audio file due to hardware limitations, the content quality is lowered to ensure compatibility. The reduction in content quality compromises the user experience. Instead of enjoying high-fidelity sound or high-resolution video, users receive a downgraded version that matches the least capable device.

[0004] Similarly, when multiple devices are used together for synchronized playback, the audio streaming is typically configured to match the lowest capability of the sound devices involved. The audio streaming is configured to maintain the same features and rendering profile across all devices and ensure synchronization. Although synchronization is achieved, the overall audio experience is compromised. The devices with higher capabilities are not fully utilized thereby resulting in a suboptimal listening experience.

[0005] Hence, there is a need for improved systems and methods that ensure high-quality audio experiences without compromising user experience.

[0006] This summary is provided to introduce a selection of concepts, in a simplified format, that are further described in the detailed description of the invention. This summary is neither intended to identify key or essential inventive concepts of the invention nor is it intended for determining the scope of the invention.

[0007] According to one embodiment of the present disclosure, a method for operating a sound device using an extended sound device is disclosed. The method may include receiving capability information from a plurality of nearby sound devices present in a device ecosystem. The method may also include estimating capabilities required for the sound device based on the received capability information of the plurality of nearby sound devices. The method may further include inserting, in the device ecosystem, the extended sound device with the estimated capabilities. The method may also include adding an extended capability kernel in a device node of the sound device. The method may further include configuring the sound device using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.

[0008] According to one embodiment of the present disclosure, a system for operating a sound device using an extended sound device is disclosed. The system may include a memory and at least one processor in communication with the memory. The at least one processor may be configured to receive capability information from a plurality of nearby sound devices present in a device ecosystem. The at least one processor may be also configured to estimate capabilities required for the sound device based on the received capability information of the plurality of nearby sound devices. The at least one processor may be configured to insert, in the device ecosystem, the extended sound device with the estimated capabilities. The at least one processor may be configured to add an extended capability kernel in a device node of the sound device. The at least one processor may be configured to configure the sound device using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.

[0009] According to one embodiment of the present disclosure, a computer-readable storage medium (e.g., non-transitory computer-readable medium) may store instructions that, when executed by at least one processor, cause the at least one processor to perform the method.

[0010] To further clarify the advantages and features of the present disclosure, a more particular description of the invention will be rendered by reference to specific embodiments thereof, which are illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail in the accompanying drawings.

[0011] These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:

[0012] Figure 1A illustrates a schematic block diagram depicting an environment for the implementation of a system for operating a sound device 102, according to an embodiment of the disclosure;

[0013] Figure 1B illustrates a schematic block diagram depicting an environment for the implementation of a system for operating a sound device 102, according to an embodiment of the disclosure;

[0014] Figure 2 illustrates a schematic block diagram of the system and components of the system for enhancing the capabilities of a sound device, according to an embodiment of the present disclosure;

[0015] Figure 3 illustrates a block diagram associated with a capability determination module of the system, according to an embodiment of the present disclosure;

[0016] Figure 4 illustrates a signal flow diagram associated with the capability determination module, in accordance with an embodiment of the present disclosure;

[0017] Figure 5 illustrates exemplary tables depicting a capability list of a plurality of nearby sound devices and an extended capability of the sound device, in accordance with an embodiment of the present disclosure.

[0018] Figure 6 illustrates a block diagram associated with a device insertion module of the system, in accordance with an embodiment of the present disclosure;

[0019] Figure 7 illustrates an exemplary schematic diagram depicting the plurality of devices and a virtual device creation for the sound device through the device insertion module, in accordance with an embodiment of the present disclosure;

[0020] Figure 8 illustrates a block diagram associated with a capability extension module of the system, in accordance with an embodiment of the present disclosure;

[0021] Figures 9A illustrates a use-case of the system for operating the sound device 102, in accordance with an embodiment of the present disclosure;

[0022] Figure 9B illustrates a use-case of the system for operating the sound device 102, in accordance with an embodiment of the present disclosure;

[0023] Figure 10A illustrates a use-case of the system, in accordance with an embodiment of the present disclosure;

[0024] Figure 10B illustrates a use-case of the system, in accordance with an embodiment of the present disclosure;

[0025] Figure 11A illustrates a use-case of the system, in accordance with an embodiment of the present disclosure;

[0026] Figure 11B illustrates a use-case of the system, in accordance with an embodiment of the present disclosure;

[0027] Figure 12A illustrates a use-case of the system, in accordance with an embodiment of the present disclosure;

[0028] Figure 12B illustrates a use-case of the system, in accordance with an embodiment of the present disclosure; and

[0029] Figure 13 illustrates an exemplary process flow comprising a method for enhancing the capabilities of the sound device, according to an embodiment of the present disclosure.

[0030] Further, skilled artisans will appreciate that elements in the drawings are illustrated for simplicity and may not have necessarily been drawn to scale. For example, the flow charts illustrate the method in terms of the most prominent steps involved to help to improve understanding of aspects of the present disclosure. Furthermore, in terms of the construction of the device, one or more components of the device may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the drawings with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.

[0031] For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the various embodiments and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates.

[0032] It will be understood by those skilled in the art that the foregoing general description and the following detailed description are explanatory of the invention and are not intended to be restrictive thereof.

[0033] Reference throughout this specification to "an aspect," "another aspect" or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Thus, appearances of the phrase "in an embodiment," and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.

[0034] The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or sub-systems or elements or structures or components proceeded by "comprises... a" does not, without more constraints, preclude the existence of other devices or other sub-systems or other elements or other structures or other components or additional devices or additional sub-systems or additional elements or additional structures or additional components. It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces. It should be appreciated that the blocks in each flowchart and combinations of the flowcharts may be performed by one or more computer programs which include computer-executable instructions. The entirety of the one or more computer programs may be stored in a single memory or the one or more computer programs may be divided with different portions stored in different multiple memories.

[0035] Figure 1A illustrates a schematic block diagram depicting an environment for the implementation of a system for operating a sound device 102, according to an embodiment of the disclosure. Figure 1B illustrates a schematic block diagram depicting an environment for the implementation of a system 100 for operating a sound device 102, according to an embodiment of the disclosure.

[0036] In an embodiment, referring to Figures 1A and 1B, the system 100 may enhance capabilities of the sound device 102-1, 102-2 (collectively numbered as 102) by leveraging a networked ecosystem of at least one of a plurality of nearby sound devices 104-1, 104-2 (collectively numbered as 104). The system 100 may dynamically integrate and extend the functionalities of the sound device 102 to provide a superior user experience without a need for frequent hardware updates. The system 100 may be implemented in a networked ecosystem (alternatively known as 'the ecosystem'), which includes the components of the plurality of nearby sound devices 104 and / or cloud-based components. The ecosystem may be a connected environment where the plurality of nearby sound devices 104 may communicate, share capabilities, and work together to enhance overall performance and user experience. The at least one of a plurality of nearby sound devices 104-1, 104-2 may be referred to as at least one of a plurality of nearby devices.

[0037] In an embodiment, the plurality of nearby sound devices 104 may include, but is not limited to, multimedia devices such as soundbars, speakers, music frame, loudspeaker, and televisions (TVs) located within the ecosystem. Each device from the plurality of nearby sound devices 104 may have listed capabilities.

[0038] Figures 1A and 1B depict two scenarios. In Figure 1A, the sound devices 102-1, 102-2 may not be grouped and played with the plurality of nearby sound devices 104-1, 104-2 due to differences in the listed capabilities of the sound devices 102-1, 102-2 and the plurality of nearby sound devices 104-1, 104-2. Whereas, in Figure 1B, the sound devices 102-1, 102-2 may be grouped and played with the plurality of nearby sound devices 104-1, 104-2 by utilizing extended capabilities from the system 100.

[0039] In Figure 1A, the user 106 may express concern because the user may be unable to group the TV 104-1 and the soundbar 104-2 with the loudspeaker 102-1, and the music frame 102-2. The loudspeaker 102-1 and the music frame 102-2 may lack the necessary capabilities to integrate and function with the TV 104-1 and the soundbar 104-2. In an embodiment, by utilizing existing techniques, a media content may be often adjusted to match the lowest hardware capability among the sound device 102 and the plurality of nearby sound devices 104 present within the ecosystem thereby reducing the quality of the media content significantly and overall group capability.

[0040] In Figure 1B, the user 108 may express satisfaction with usage of the system 100, the loudspeaker 102-1 and the music frame 102-2 may not be only compatible with the TV 104-1 and the soundbar 104-2 but may also deliver enhanced music quality. In an embodiment, by utilizing the system 100, the sound device 102 may utilize extended capability of the plurality of nearby sound devices 104 present within the ecosystem to play media content in high definition, thereby enhancing overall group capability.

[0041] Further, extended capabilities of the sound device 102 may be provided using modules of the system 100 as explained in forthcoming paragraphs of Figures 2-8.

[0042] Figure 2 illustrates a schematic block diagram of the system 100 and components of the system 100 for enhancing the capabilities of the sound device 102, according to an embodiment of the disclosure.

[0043] The system 100 may integrate with the sound device 102 and the plurality of nearby sound devices 104 present within the ecosystem. The system 100 may include but is not limited to, at least one processor 202 may be referred to as the processor 202, memory 204, modules 206, and data 208. The modules 206 and the memory 204 may be coupled to the processor 202.

[0044] The processor 202 can be a single processing unit or several units, all of which could include multiple computing units. The processor 202 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, and / or any devices that manipulate signals based on operational instructions. Among other capabilities, the processor 202 may be adapted to fetch and execute computer-readable instructions and data stored in the memory 204. The processor may include various processing circuitry and / or multiple processors.  For example, as used herein, including the claims, the term "processor" may include various processing circuitry, including at least one processor, wherein one or more of at least one processor, individually and / or collectively in a distributed manner, may be configured to perform various functions described herein. As used herein, when "a processor", "at least one processor", and "one or more processors" are described as being configured to perform numerous functions, these terms cover situations, for example and without limitation, in which one processor performs some of recited functions and another processor(s) performs other of recited functions, and also situations in which a single processor may perform all recited functions. Additionally, the at least one processor may include a combination of processors performing various of the recited / disclosed functions, e.g., in a distributed manner.  At least one processor may execute program instructions to achieve or perform various functions.

[0045] The memory 204 may include any non-transitory computer-readable medium known in the art including, for example, volatile memory, such as static random-access memory (SRAM) and dynamic random-access memory (DRAM), and / or non-volatile memory, such as read-only memory (ROM), erasable programmable ROM, flash memories, hard disks, optical disks, and magnetic tapes. The memory 204 may alternatively be referred to as the database 204 in the present disclosure.

[0046] The modules 206, amongst other things, may include routines, programs, objects, components, data structures, etc., which perform particular tasks or implement data types. The modules 206 may also be implemented as, signal processor(s), state machine(s), logic circuitries, and / or any other device or component that manipulates signals based on operational instructions.

[0047] Further, the modules 206 can be implemented in hardware, instructions executed by a processing unit, or by a combination thereof. The processor 202 can comprise a computer, a processor, a state machine, a logic array, or any other suitable devices capable of processing instructions. The processing unit can be a general-purpose processor (e.g., processor 202) which executes instructions to cause the general-purpose processor to perform the required tasks or, the processing unit can be dedicated to performing the required functions. In an embodiment of the present disclosure, the modules 206 may be machine-readable instructions (software) which, when executed by the processor 202 / processing unit, perform any of the described functionalities / methods, as discussed throughout the present disclosure.

[0048] In an embodiment, the modules 206 may include a capability determination module 210, a device insertion module 212, and a capability extension module 214. The capability determination module 210, the device insertion module 212, and the capability extension module 214 may be in communication with each other. The data 208 may serve, amongst other things, as a repository for storing data processed, received, and generated by one or more of the modules 206. In an example, the modules 206 may be in communication with a remote server or Cloud. Further, Figures 3 to 8 provide a detailed description of each of the modules 206 and related features.

[0049] Figure 3 illustrates a block diagram associated with the capability determination module 210 of the system 100, according to an embodiment of the disclosure.

[0050] In an embodiment, the system 100 may include a distributed capability service that may execute on each device including the sound device 102 and the plurality of nearby sound devices 104. The distributed capability service may be responsible for communication exchange and capability sharing across the sound device 102 the plurality of nearby sound devices 104 or the cloud. The distributed capability service may enable the sound device 102 and the plurality of nearby sound devices 104 in the ecosystem to dynamically request, share, and utilize advanced features from each other thereby enhancing the overall performance and functionality of the sound device 102.

[0051] In an embodiment, the capability determination module 210 may include a device capability identification sub-module 304 and an extended list determination sub-module 306. The sound device 102 may receive an audio file 302 in high definition. The sound device 102 may not include a required capability to play the audio file 302. The sound device 102 through the distributed capability service connect with the capability determination module 210 of the system 100.

[0052] In an embodiment, the device capability identification sub-module 304 may be configured to identify the capability information of the sound device 102. Based on the identified capability information of the sound device 102, the capability determination module 210 may be configured to analyse the capability of the sound device 102 to play the audio file 302. The capability determination module 210, based on the analysis, may be configured to identify the plurality of nearby sound devices 104 and receive the capability information of each of the plurality of nearby sound devices 104 present in the ecosystem. The capability information may include a device specific capability list that may comprise a device ID, codec information, sensor information, latency information, connectivity capability information, and amplifier information associated with a corresponding nearby sound device.

[0053] In an embodiment, the extended list determination sub-module 306 may be configured to determine the capabilities required for the sound device 102 based on the received capability information of the plurality of nearby sound devices 104 and create an extended list with required capability kernels for the sound device 102. The capability kernels may be, but not limited to, software modules or components that encapsulate specific functionalities or capabilities that may be dynamically loaded, integrated, and executed by the sound device 102 and / or the plurality of nearby sound devices 104 within the ecosystem. The capability kernels may enable the sound device 102 or / and the plurality of nearby sound devices 104 to extend inherent capabilities by leveraging additional processing power, or features provided by at least one of the plurality of nearby sound devices 104 in the network and the cloud.

[0054] The capability determination module 210 may determine an availability of the estimated capabilities on a nearby device among the plurality of nearby sound devices 104 or on the cloud. The capability determination module 210 may then create an extended device capability list having the capability information of the plurality of nearby audio devices 104. In an embodiment, the sound device 102 (or referred to as a source device) may receive extended device information. The extended device information may include at least one of device ID, sensor capabilities, codec capabilities, connectivity, or latency. Details of the identification of the features and components of the plurality of nearby sound devices 104 and the creation of an extended list are explained in detail in Figures 4 and 5.

[0055] Figure 4 illustrates a signal flow diagram 400 associated with the capability determination module 210, in accordance with an embodiment of the present disclosure.

[0056] The sound device 102 may use a Broadcast Search Device Protocol (BSDP) to identify the plurality of nearby sound devices 104 present within the ecosystem. The BSDP may be a network protocol to facilitate a discovery and communication between the sound device 102 and the plurality of nearby sound devices 104. The BSDP may utilize the broadcast messages to announce a presence and capabilities of the the sound device 102 and / or the plurality of nearby sound devices 104 within the ecosystem.

[0057] In the illustrated embodiment, the sound device 102 may send out the broadcast message within a predefined time interval, for example: 3 sec. Each of the plurality of nearby sound devices 104 including the device-A 104-1 and device-B 104-2, may receive the broadcast message from the sound device 102 and may send a response signal to the sound device 102. Once, the sound device 102 may identify the plurality of nearby sound devices 104 present within the ecosystem, the sound device 102 may pull node information from the device-A 104-1 and device-B 104-2. The node information may describe the capability information, status, and operational parameters of a device node. The device node may be a logical representation of the device 104-1 and 104-2 within the ecosystem.

[0058] In a specific scenario as shown in the Figure 4, at steps 402 and 406, the sound device 102 may send the broadcast message and at a given timestamp. At step 404, the sound device 102 may then receive a first response from the device-A 104-1 and at step 408, the sound device 102 may receive a second response from the device-B 104-2. At steps 410 and 414, the sound device 102 after identifying the device-A 104-1 and the device-B 104-2, may send a request to pull node information and of the device-A 104-1 and the device-B 104-2. The sound device 102 may receive the capability list of the device-A 104-1 and the device-B 104-2.

[0059] In an example, the received capability list of the device-A 104-1 and the device-B 104-2 is shown in Figure 5.

[0060] Figure 5 illustrates exemplary tables depicting the capability list of the plurality of nearby sound devices 104 and an extended capability of the sound device 102, in accordance with an embodiment of the present disclosure. The table-1 illustrates the capabilities of the plurality of nearby sound devices 104 within the ecosystem and extended capabilities that may be leveraged by the sound device 102 and / or the plurality of nearby sound devices 104 within the ecosystem.

[0061] The table 1 may list the plurality of nearby sound devices 104 within the ecosystem and their corresponding capabilities. The table-1 has columns and rows. Each column represents a device (Device-A 104-1, Device-B 104-2, Sound Device 102). Each row of the table-1 represents a specific capability (e.g., Codec (AAC), Codec (DTS), Sensor, Amplifier). Further, symbol O indicates that the device may have the specific capability, and symbol X indicates that the device may lack the specific capability.

[0062] As shown in table 1, the device-A 104-1 may have all the listed capabilities (AAC, DTS, DD codecs, Sensor, and Amplifier), and device-B 104-2 may have all the listed capabilities except for the Amplifier. The sound device 102 may have only the AAC codec, lacks DTS and DD codecs, and may lack the Sensor and Amplifier capabilities.

[0063] The table 2 may list the devices and their extended capabilities. The table 2 may show that the capabilities of one device may be extended by integrating functionalities from other devices present in the ecosystem. The table 2 depicts the list of the devices 102, 104-1, 104-2 in the network and the extended capabilities of each device 102, 104-1, 104-2.

[0064] As shown in table-2, the device-A 104-1 may not require any extended capabilities. The device-B 104-2 may extend the capability by utilizing the Amplifier from the device-A 104-1. The sound device 102 may extend the capability by utilizing the DTS and DD codecs, Sensor (Microphone), and Amplifier from the device-A 104-1 and the device-B 104-2.

[0065] The table-1 and table-2 together demonstrate that a networked ecosystem may dynamically share and integrate capabilities among the devices 102, 104 thereby enhancing their functionality without needing frequent hardware upgrades. The table-1 depicts inherent capabilities of each device 102, 104, while the table-2 shows that the capabilities may be extended by leveraging resources from other devices 104-1, 104-2 present in the ecosystem.

[0066] Figure 6 illustrates a block diagram associated with the device insertion module 212 of the system 100, in accordance with various embodiments of the disclosure.

[0067] In an embodiment, the device insertion module 212 may have one or more sub-modules. The one or more sub-modules may include a local device capability exploration sub-module 602-1, a cloud device capability exploration sub-module 602-2, a capability device selection sub-module 602-3, and a device creation sub-module 602-4.

[0068] In an embodiment, the local device capability exploration module 602-1 may send out a request to the plurality of nearby sound devices 104 present in a local network to receive the capability list. In an example, the message sent out by the local device capability exploration module 602-1 for receiving the capability list may be "GetAvailableCap". The plurality of nearby sound devices 104 may respond with a message containing four pieces of information i.e. availability of the capability, performance matrix, utilization level, and latency.

[0069] In an embodiment, the first information may include availability (represented by 'A') indicating whether the capability is available, where 0 means not available and 1 means available. The second information may be the performance matrix (represented by 'P') which mentions the performance of the nearby sound device 104 and is measured in Millions of Instructions Per Second (MIPS). The third piece of information required from the plurality of nearby sound devices 104 may be the utilization level (represented by 'U') which corresponds to an amount of the device's capability that may be currently used and provided as a percentage. The fourth required information may be the latency (represented by 'L') which indicates a delay or latency in milliseconds for the device 104 to respond or process tasks.

[0070] In an embodiment, the performance of the nearby sound device 104 may be measured to understand, specifically an amount of millions of instructions the nearby sound device 104 may process per second (MIPS). The performance matrix may be determined by the equation (1) as shown:

[0071] P = MIPS = Ic / (T * 10^6) ......(1)

[0072] where, Ic is the Instruction Count, i.e. a total number of instructions the nearby sound device 104 may execute, and T is the time taken to execute the instructions.

[0073] For instance, if the nearby sound device 104 may execute 1 billion instructions in 1 second, the MIPS would be 1,000,000,000 / (1 * 10^6) = 1000 MIPS.

[0074] In an embodiment, the soundbar may send a request (GetAvailableCap) to the nearby sound devices 104 on the local network. A nearby speaker may respond with A: 1, P: 500 MIPS, U: 30%, L: 10 ms. The soundbar may use the information to determine that the speaker has the required capability available, with sufficient performance and low latency. Later, the system 100 may create a virtual device 602 representing the speaker's capability.

[0075] Similarly, the cloud device capability exploration module 602-2 may send out a request to the nearby sound devices 104 present on the cloud to receive the capability list and may receive the capability information of the nearby sound device 104 available on the cloud. In an example, the message sent out by the cloud device capability exploration module 602-2 for receiving the capability list may be "GetAvailableCap". The plurality of nearby sound devices 104 on the cloud may respond with a message containing four pieces of information i.e. availability of the capability, performance matrix, utilization level, and latency.

[0076] In an embodiment, the capability device selection sub-module 602-3 may determine an extended sound device 602 (may alternatively be referred to as 'virtual device') among the plurality of nearby sound devices 104 within the local network and the cloud through a priority factor (Pk) associated with each nearby sound device 104 and determined by equation (2):

[0077] ......(2)

[0078] where P: indicates MIPS of device [i], U: indicates the utilization level percentage of the device [i], and L: indicates the latency of the device [i]. A conflict of same capability being populated by the plurality of nearby sound devices 104 (local devices(s) or cloud-based devices) may be resolved by prioritizing each of the plurality of nearby devices 104 based on the priority factor determined from equation (2).

[0079] The prioritization of each of the plurality of nearby devices 104 may be based on the priority factor (Pk) associated with corresponding weights of the MIPS (WP) and the utilization level (WU).

[0080] In an embodiment, the capability device selection sub-module 602-3 may further determine received signal strength indicator (RSSI) strength to select the nearby sound device 104 for extending capabilities during a playback request. The RSSI may be calculated through equation (3) as mentioned below:

[0081] RSSI = P - 10Nlog(d) ......(3)

[0082] where: d is the distance in meters, P is received signal power in dBm at 1 meter, and N is the signal propagation constant combined with antenna gains.

[0083] Further, the signal propagation constant may further be determined through the equation (4) as mentioned below:

[0084] N = 10log(d)A - RSSI ......(4)

[0085] where: A is known received signal strength at 1 meter, and RSSI is the measured signal strength.

[0086] Lastly, when the N is known, a distance between the nearby sound device 104 and the sound device 102 may be calculated from the below mentioned equation (5):

[0087] ......(5)

[0088] where, d: is the distance between two devices 102, 104, A: is the known received signal strength at 1 meter, RSSI: is the measured signal strength, and N: is the signal propagation constant.

[0089] The capability device selection sub-module 602-3 may be configured to determine a nearest nearby sound device 104 based on the equation (6):

[0090] Nearest device = min (d1,d2,...) .......(6)

[0091] In case the device 102 requires an addition of the sensor such as, not limited to, a microphone or an amplifier, the nearest device may be selected from the local network.

[0092] The capability device selection module 602-3 may iterate through a list of the plurality of nearby sound devices 104 and their corresponding capabilities. In an embodiment, the device creation sub-module 602-4 may create the virtual device 602 of a selected device from the plurality of nearby sound devices 104 having the required capability for the sound device 102. Specifically, for each capability required, the corresponding device that may extend the required capability may be virtually created and added to the capability list. In an embodiment, the sound device 102 may broadcast the extended capability to the plurality of the nearby sound devices 104 (e.g., all devices connected to the sound device 102). The plurality of the nearby sound devices 104 may update their databases with the extended capability.

[0093] Figure 7 illustrates an exemplary schematic diagram depicting the plurality of nearby sound devices 104 and the virtual device 602 creation for the sound device 102 through the device insertion module 212, in accordance with an embodiment of the present disclosure.

[0094] As depicted in the Figure 7, the sound device 102, the plurality of nearby sound devices 104 (104-1, 104-2, 104-3) may communicate with each other through a server 702. The sound device 102 and each of the plurality of nearby sound devices 104-1, 104-2, 104-3 may have the distributed capability service (may alternatively be referred to as 'DC service'). In an illustrated embodiment, the plurality of nearby sound devices 104-1, 104-2, 104-3 may have the additional features required by the sound device 102 which may be created as the extended list and the virtual device 602 may be created based on the extended list. The virtual device 602 may also be known as the extended sound device 602. The device insertion module 212 may then create the extended sound device 602 on the nearby device among the plurality of nearby sound devices 104 or on the cloud which has the estimated capabilities.

[0095] Figure 8 illustrates a block diagram associated with the capability extension module 214 of the system 100, in accordance with an embodiment of the present disclosure.

[0096] In an embodiment, when during a playback request, if the sound device 102 may not be able to support the playback request and may not have the required capability, the capability extension module 214 may dynamically estimate the capability required for the sound device 102, and request the extended sound device 602 to extend the required capability.

[0097] In an illustrated embodiment, at block 804, a local sound device 802 may receive the playback request and a stream for the playback request. At block 806, the local sound device 802 may then send the stream from the extended capability kernel to the extended sound device 602 with details of local capability kernels. The details of local capability kernels may include details with local capability (e.g., details related to sensors such as microphone, or details of amplifiers such as the number of the amplifiers or position of the speakers). At block 808, the stream (e.g., encoded stream ES) may be sent through the distributed capability service (represented by 'DCS'). At block 814, the extended sound device 602 may receive the local capability kernel through the distributed capability service. At block 816, the extended sound device 602 may decode the stream in accordance with the local capability kernels. The extended sound device 602 may decode the stream based on capability parameters. In an embodiment, the capability parameters may include received capability information of the plurality of nearby sound devices 104. The extended sound device 602 may decode the stream for the local sound device 802 for synchronized playback, based on a position of the local sound device 802 and the capability information of the local sound device 802.

[0098] At block 818, the extended sound device 602 may understand a configuration of the local sound device 802 based on the local capability kernels. At block 820, the extended sound device 602 may then adjust one or more audio channels in the decoded stream based on the local capability kernels. The adjusting of one or more audio channels may include one of down-mixing, down-sampling, or up-sampling of the stream. In an embodiment, channel configuration may be selceted based on location. In case the stream does not have the related channels, the extended sound device 602 may perform up-mixing or down-mixing. In an embodiment, final latency may be calculated based on maximum latency of each configured sound device.

[0099] In an embodiment, the number of loudspeakers in the local sound device 802 may differ from the number of decoded audio channels. In order to reproduce the audio effect with other sound devices, down-mixing or up-sampling may be required. In an embodiment, the audio channels may be 5.1 channels (Left, Center, Right, Left Surround, Right Surround, LFE), and the local sound device may have a 2.1 channel (Left, Right, LFE) configuration. The adjusting of one or more audio channels may include down-mixing to a 2.1 channel (Left, Right, LFE) based on the local sound device. The stereo downmix may be further downmixed to mono depending on the local sound device.

[0100] In an embodiment, converting five channels to stereo may be calculated through equation (7) and equation (8) as mentioned below:

[0101] ......(7)

[0102] ......(8)

[0103] where, Lo: is output left channel, Ro: is output right channel, L: is input left channel, R: is input right channel, C: is input center channel, Ls: is input left surround channel, Rs: is input right surround channel, clev: is center mixing level coefficient and slev: is surround mixing level coefficient. In an embodiment, converting stereo to mono may be calculated through equation (9) as mentioned below:

[0104] ......(9)

[0105] where, M: is final output mono channel.

[0106] The extended sound device 602 may then estimate delay and send the decoded stream DS to the extended capability kernel and local capability kernels. At step 810, the local sound device 802 may then configure a setting based on the decoded stream DS. At block 812, the local sound device 802 may then render the audio on a given timestamp to compensate for the delay and maintain synchronization in the playback.

[0107] Figure 9A illustrates a use-case of the system for operating the sound device 102, in accordance with an embodiment of the present disclosure. Figure 9B illustrates a use-case of the system 100 for operating the sound device 102, in accordance with an embodiment of the present disclosure. Figures 9A and 9B depict two scenarios: one where the sound device (herein depicted as home theatre) 102 may not initially work with the new TV 904, and another where the home theatre 102 successfully integrates and plays audio by utilizing extended capabilities.

[0108] In Figure 9A, the user 902 may express concern: "I cannot use my home theatre with my new TV?". The home theatre 102 may lack the necessary capabilities to integrate and function with the new TV. In Figure 9B, the user 906 may express satisfaction with the usage of the system 100. The home theatre 102 may be compatible with the new TV 904 with the usage of the system 100.

[0109] Figure 10A illustrates a use-case of the system, in accordance with an embodiment of the present disclosure. Figure 10B illustrates a use-case of the system 100, in accordance with an embodiment of the present disclosure.

[0110] In a specific scenario, as seen in Figure 10A, a user 1002 may be frustrated because the sound device 102, for instance, a soundbar, may not support the latest artificial intelligence (AI)-dependent features. The sound device 102 may be operating independently without leveraging the capabilities of at least one of the plurality of nearby sound devices 104, for instance, a television. The user 1002 may express a concern about a need to frequently update hardware to access new features.

[0111] In another exemplary scenario, as seen in Figure 10B, a user 1004 may be happy because the sound device 102 after integrating with the system 100 may now support the latest features by sharing capabilities with the at least one of the plurality of nearby sound devices 104 present within the ecosystem. The sound device 102 may now leverage capabilities from the at least one of the plurality of nearby sound devices 104 with an NPU (Neural Processing Unit). The user 1004 may express satisfaction with the improved features of the soundbar 102.

[0112] Figure 11A illustrates a use-case of the system, in accordance with an embodiment of the present disclosure. Figure 11B illustrates a use-case of the system 100, in accordance with an embodiment of the present disclosure.

[0113] In a specific scenario, as seen in Figure 11A, a user 1102 may be frustrated because the sound device 102, for instance, a soundbar, may not support the latest artificial intelligence (AI)-dependent features. The sound device 102 may be operating independently without leveraging the capabilities of at least one of the plurality of nearby sound devices 104, for instance, a television. As illustrated, the sound bar may not utilize extended features (such as microphone) of the television. The user 1102 may express a concern that the soundbar may not be controlled by his voice and a need to buy a new soundbar with upgraded features.

[0114] In another exemplary scenario, as seen in Figure 11B, a user 1104 may be happy because the sound device 102 after integrating with the system 100 may now utilize the latest features of the at least one of the plurality of nearby sound devices 104 (herein, the TV) present within the ecosystem. The sound bar may extend its capability through the capability of the television. For example, the soundbar may expand the features such as voice control, voice assistant, and noise detection through the capability of the television. The sound bar may be able to take commands from the user 1104 by utilizing the microphone of the television. The user 1104 may express satisfaction with the improved features of the soundbar.

[0115] Figure 12A illustrates a use-case of the system, in accordance with an embodiment of the present disclosure. Figure 12B illustrates a use-case of the system 100, in accordance with an embodiment of the present disclosure.

[0116] In a specific scenario, as seen in Figure 12A, a user 1202 may be frustrated because he may be unable to utilize extended capabilities of a television (TV) 1204 with a washing machine 1206 and an air conditioner (AC) 1208 present within the ecosystem. The user 1202 may not be able to control the washing machine 1206 and the AC 1208 through his voice.

[0117] In another exemplary scenario, as seen in Figure 12B, a user 1210 may be happy because he may be able to utilize the extended capabilities of the television (TV) 1204 with the washing machine 1206 and the air conditioner (AC) 1208 present within the ecosystem because of the presence of the system 100. The washing machine 1206 and the AC 1208 may now leverage the capabilities (such as a microphone) of the TV 1204. The user 1210 may control the washing machine 1206 and the AC 1208 through his voice. The washing machine 1206 and the AC 1208 may be controlled through the user 1004's voice. The user 1004 may express satisfaction with the improved features of the washing machine 1206 and the AC 1208 present within the ecosystem.

[0118] Figure 13 illustrates an exemplary process flow comprising a method 1300 for enhancing the capabilities of the sound device 102, according to an embodiment of the disclosure.

[0119] The method 1300 may be a computer-implemented method executed, for example, by the system 100 and the modules 206. For the sake of brevity, constructional and operational features of the system 100 that are already explained in the description of Figure 1, Figure 2, Figure 3, Figure 4, Figure 5, Figure 6, Figure 7, and Figure 8 are not explained in detail in the description of Figure 13.

[0120] At step 1302, the method 1300 may include receiving capability information from the plurality of nearby sound devices 104 present in the device ecosystem.

[0121] At step 1304, the method 1300 may include estimating capabilities required for the sound device 102 based on the received capability information of the plurality of nearby sound devices 104.

[0122] At step 1306, the method 1300 may include inserting, in the device ecosystem, the extended sound device 602 with the estimated capabilities.

[0123] At step 1308, the method 1300 may include adding an extended capability kernel in a device node of the sound device 102 to use the capability of the extended sound device 602.

[0124] At step 1310, the method 1300 may include configuring the sound device 102 using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.

[0125] The disclosure may provide various advantages:

[0126] The disclosure may enable the devices to seamlessly integrate and function together irrespective of varying hardware requirements. By sharing and extending capabilities through the system 100, the devices that would otherwise be incompatible may work in harmony, ensuring a more versatile and flexible home entertainment ecosystem.

[0127] The disclosure dynamically adjusts and utilizes the best available capabilities in the network thereby significantly enhancing the user experience by ensuring that media content is played at highest quality.

[0128] By leveraging the capabilities of the nearby devices, the system may maximize the use of available resources. Therefore, the devices with advanced features may share their processing power, codecs, and other capabilities with less capable devices, leading to optimized performance without redundant hardware upgrades.

[0129] Further, the ability to extend capabilities through networked devices may mean investing in a single high-capability device that may improve the performance of all connected devices.

[0130] The disclosure may promote sustainability by enhancing the performance of old devices when connected to the new device, thereby reducing resource wastage.

[0131] In an embodiment of the disclosure, the method 1300 may include receiving 1302 capability information from a plurality of nearby sound devices 104 present in a device ecosystem. In an embodiment of the disclosure, the method 1300 may include estimating 1304 capabilities required for the sound device 102 based on the received capability information of the plurality of nearby sound devices 104. In an embodiment of the disclosure, the method 1300 may include inserting 1306, in the device ecosystem, the extended sound device 602 with the estimated capabilities. In an embodiment of the disclosure, the method 1300 may include adding 1308 an extended capability kernel in a device node of the sound device 102. In an embodiment of the disclosure, the method 1300 may include configuring 1310 the sound device 102 using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.

[0132] In an embodiment of the disclosure, for receiving the capability information from the plurality of nearby sound devices 104, the method 1300 may include identifying the plurality of nearby sound devices 104 present in the device ecosystem. In an embodiment of the disclosure, for receiving the capability information from the plurality of nearby sound devices 104, the method 1300 may include receiving, upon identification of the plurality of nearby sound devices 104, the capability information from each of the plurality of nearby sound devices 104.

[0133] In an embodiment of the disclosure, the capability information comprises a device specific capability list that comprises at least one of a device ID, codec information, sensor information, latency information, connectivity capability information, or amplifier information associated with a corresponding nearby sound device.

[0134] In an embodiment of the disclosure, for estimating 1304 the capabilities required for the sound device 102, the method 1300 may include estimating the capabilities based on node information of the sound device 102 embedded in the device node and the received capability information of the plurality of nearby sound devices 104.

[0135] In an embodiment of the disclosure, the method 1300 may include creating an extended list with required capability kernels for the sound device 102.

[0136] In an embodiment of the disclosure, the method 1300 may include determining an availability of the estimated capabilities on a nearby device among the plurality of nearby sound devices 104 or on cloud. In an embodiment of the disclosure, the method 1300 may include creating the extended sound device 602 on the nearby device among the plurality of nearby sound devices 104 or on the cloud which has the estimated capabilities.

[0137] In an embodiment of the disclosure, the method 1300 may include selecting, as the extended sound device 602, the nearby device among the plurality of nearby sound devices 104 based on capability parameters of the plurality of nearby sound devices 104.

[0138] In an embodiment of the disclosure, the method 1300 may include broadcasting the extended capability to the plurality of nearby sound devices 104.

[0139] In an embodiment of the disclosure, the method 1300 may include dynamically estimating the capability required for the sound device 102 based on determination that the capability is not supported by the sound device 102 during a playback request. In an embodiment of the disclosure, the method 1300 may include requesting the extended sound device 602 to extend the required capability.

[0140] In an embodiment of the disclosure, the method 1300 may include receiving a playback request for the playback using the extended capability kernel. In an embodiment of the disclosure, the method 1300 may include sending stream from the extended capability kernel to the extended sound device 602 with details of local capability kernels. In an embodiment of the disclosure, the method 1300 may include decoding the stream, by the extended sound device 602, based on the local capability kernels. In an embodiment of the disclosure, the method 1300 may include estimating delay and sending the decoded stream to the extended capability kernel and the local capability kernels by the extended sound device 602. In an embodiment of the disclosure, the method 1300 may include rendering the audio on the sound device 102 on a given timestamp.

[0141] In an embodiment of the disclosure, for decoding the stream, the method 1300 may include adjusting one or more audio channels in the stream based on the local capability kernels and the extended sound device 602, wherein the adjusting comprises one of down-mixing, down-sampling, or up-sampling of the stream.

[0142] In an embodiment of the disclosure, the method 1300 may include decoding the stream for at least one of the plurality of nearby sound devices 104, by the extended sound device 602, for synchronized playback based on a position of the sound device 102 and the capability information of at least one of the plurality of nearby sound devices 104.

[0143] In an embodiment of the disclosure, a computer-readable storage medium e.g., non-transitory computer-readable medium may store instructions that, when executed by at least one processor, cause the at least one processor to perform the method.

[0144] In an embodiment of the disclosure, the system 100 may include at least one processor 202 including processing circuitry and memory 204 storing instructions. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to receive capability information from a plurality of nearby sound devices 104 present in a device ecosystem. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to estimate capabilities required for the sound device 102 based on the received capability information of the plurality of nearby sound devices 104. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to insert, in the device ecosystem, the extended sound device 602 with the estimated capabilities. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to add an extended capability kernel in a device node of the sound device 102. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to . In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to configure the sound device 102 using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.

[0145] In an embodiment of the disclosure, to receive the capability information from the plurality of nearby sound devices 104, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to identify the plurality of nearby sound devices 104 present in the device ecosystem. In an embodiment of the disclosure, to receive the capability information from the plurality of nearby sound devices 104, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to receive, upon identification of the plurality of nearby sound devices 104, the capability information from each of the plurality of nearby sound devices 104.

[0146] In an embodiment of the disclosure, the capability information includes a device specific capability list that comprises a device ID, codec information, sensor information, latency information, connectivity capability information, and amplifier information associated with a corresponding nearby sound device.

[0147] In an embodiment of the disclosure, for estimating the capabilities required for the sound device 102, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to estimate the capabilities based on node information of the sound device 102 embedded in the device node and the received capability information of the plurality of nearby sound devices 104.

[0148] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to create an extended list with required capability kernels for the sound device 102.

[0149] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to determine an availability of the estimated capabilities on a nearby device among the plurality of nearby sound devices 104 or on cloud. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to create the extended sound device 602 on the nearby device among the plurality of nearby sound devices 104 or on the cloud which has the estimated capabilities.

[0150] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to select, as the extended sound device 602, the nearby device among the plurality of nearby sound devices 104 based on capability parameters of the plurality of nearby sound devices 104.

[0151] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to broadcast the extended capability to the plurality of nearby sound devices 104.

[0152] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to dynamically estimate the capability required for the sound device 102 based on determination that the capability is not supported by the sound device 102 during a playback request. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to request the extended sound device 602 to extend the required capability.

[0153] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to receive a playback request for the playback using the extended capability kernel. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to send stream from the extended capability kernel to the extended sound device 602 with details of local capability kernels. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to decode the stream, by the extended sound device 602, based on the local capability kernels. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to estimate delay and send the decoded stream to the extended capability kernel and the local capability kernels by the extended sound device 602. In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to .

[0154] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to render the audio on the sound device 102 on a given timestamp.

[0155] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to adjust one or more audio channels in the stream based on the local capability kernels and the extended sound device 602, wherein adjusting the one or more audio channels comprises one of down-mixing, down-sampling, or up-sampling of the stream.

[0156] In an embodiment of the disclosure, when executed by the at least one processor individually or collectively, the instructions cause the system 100 to decode the stream for at least one of the plurality of nearby sound devices 104, by the extended sound device 602, for synchronized playback based on a position of the sound device 102 and the capability information of at least one of the plurality of nearby sound devices 104.

[0157] The terms “computer-readable storage medium", "computer program medium," "computer usable medium," "computer readable medium", and "computer program product," are used to generally refer to media such as main memory, secondary memory, removable storage drive, a hard disk installed in hard disk drive, and signals. These computer program products are means for providing software to the computer system. The computer readable medium allows the computer system to read data, instructions, messages or message packets, and other computer readable information from the computer readable medium. The computer readable medium, for example, may include non-volatile memory, such as a floppy disk, ROM, flash memory, disk drive memory, a CD-ROM, and other permanent storage. It is useful, for example, for transporting information, such as data and computer instructions, between computer systems. Computer program instructions may be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0158] As will be appreciated by one skilled in the art, aspects of the embodiments may be embodied as a system, method or computer program product. Accordingly, aspects of the embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit," "module" or "system." Furthermore, aspects of the embodiments may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.

[0159] Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0160] Computer program code for carrying out operations for aspects of one or more embodiments may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0161] Aspects of one or more embodiments are described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems) and computer program products. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0162] These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0163] The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0164] The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustration, and combinations of blocks in the block diagrams and / or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.

[0165] While specific language has been used to describe the disclosure, any limitations arising on account of the same are not intended. As would be apparent to a person in the art, various working modifications may be made to the method in order to implement the inventive concept as taught herein.

[0166] The drawings and the forgoing description give examples of embodiments. Those skilled in the art will appreciate that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, orders of processes described herein may be changed and are not limited to the manner described herein.

Claims

1.A method (1300) for operating a sound device (102) using an extended sound device (602), the method (1300) comprising:receiving (1302) capability information from a plurality of nearby sound devices (104) present in a device ecosystem;estimating (1304) capabilities required for the sound device (102) based on the received capability information of the plurality of nearby sound devices (104);inserting (1306), in the device ecosystem, the extended sound device (602) with the estimated capabilities;adding (1308) an extended capability kernel in a device node of the sound device (102); andconfiguring (1310) the sound device (102) using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.2.The method (1300) as claimed in claim 1, wherein the capability information comprises a device specific capability list that comprises at least one of a device ID, codec information, sensor information, latency information, connectivity capability information, or amplifier information associated with a corresponding nearby sound device.3.The method (1300) as claimed in any one of claims 1 to 2, wherein, for estimating (1304) the capabilities required for the sound device (102), the method (1300) comprises estimating the capabilities based on node information of the sound device (102) embedded in the device node and the received capability information of the plurality of nearby sound devices (104).4.The method (1300) as claimed in any one of claims 1 to 3, further comprises creating an extended list with required capability kernels for the sound device (102).5.The method (1300) as claimed in any one of claims 1 to 4, further comprises:determining an availability of the estimated capabilities on a nearby device among the plurality of nearby sound devices (104) or on cloud; andcreating the extended sound device (602) on the nearby device among the plurality of nearby sound devices (104) or on the cloud which has the estimated capabilities.6.The method (1300) as claimed in any one of claims 1 to 5, further comprises broadcasting the extended capability to the plurality of nearby sound devices (104).7.The method (1300) as claimed in any one of claims 1 to 6, further comprises:dynamically estimating the capability required for the sound device (102) based on determination that the capability is not supported by the sound device (102) during a playback request, andrequesting the extended sound device (602) to extend the required capability.8.The method (1300) as claimed in any one of claims 1 to 7, further comprises:receiving a playback request for the playback using the extended capability kernel;sending stream from the extended capability kernel to the extended sound device (602) with details of local capability kernels;decoding the stream, by the extended sound device (602), based on the local capability kernels;estimating delay and sending the decoded stream to the extended capability kernel and the local capability kernels by the extended sound device (602); andrendering the audio on the sound device (102) on a given timestamp.9.The method (1300) as claimed in claim 8, wherein for decoding the stream, the method (1300) comprises:adjusting one or more audio channels in the stream based on the local capability kernels and the extended sound device (602), wherein the adjusting comprises one of down-mixing, down-sampling, or up-sampling of the stream.10.The method (1300) as claimed in any one of claims 8 to 9, further comprises:decoding the stream for at least one of the plurality of nearby sound devices (104), by the extended sound device (602), for synchronized playback based on a position of the sound device (102) and the capability information of at least one of the plurality of nearby sound devices (104).11.A computer-readable storage medium storing instructions, wherein the instructions, when executed by at least one processor, cause the at least one processor to perform the method of any one of claims 1 to 10.12.A system (100) for operating a sound device (102) using an extended sound device (602), the system (100) comprising:at least one processor (202) including processing circuitry; andmemory (204) storing instructions that, when executed by the at least one processor individually or collectively, cause the system (100) to:receive capability information from a plurality of nearby sound devices (104) present in a device ecosystem;estimate capabilities required for the sound device (102) based on the received capability information of the plurality of nearby sound devices (104);insert, in the device ecosystem, the extended sound device (602) with the estimated capabilities;add an extended capability kernel in a device node of the sound device (102); andconfigure the sound device (102) using the extended capability kernel to playback with the required estimated capability individually or in a group in the device ecosystem.13.The system (100) as claimed in claim 12, wherein, the instructions, when executed by the at least one processor individually or collectively, cause the system (100) to further:dynamically estimate the capability required for the sound device (102) based on determination that the capability is not supported by the sound device (102) during a playback request; andrequest the extended sound device (602) to extend the required capability.14.The system (100) as claimed in any one of claims 12 to 13, wherein the instructions, when executed by the at least one processor individually or collectively, cause the system (100) to further:receive a playback request for the playback using the extended capability kernel;send stream from the extended capability kernel to the extended sound device (602) with details of local capability kernels;decode the stream, by the extended sound device (602), based on the local capability kernels;estimate delay and send the decoded stream to the extended capability kernel and the local capability kernels by the extended sound device (602); andrender the audio on the sound device (102) on a given timestamp.15.The system (100) as claimed in claim 14, wherein decoding the stream,the instructions, when executed by the at least one processor individually or collectively, cause the system (100) to:adjust one or more audio channels in the stream based on the local capability kernels and the extended sound device (602), wherein adjusting the one or more audio channels comprises one of down-mixing, down-sampling, or up-sampling of the stream.

Citation Information

Patent Citations

  • Method for transferring / playing multimedia data onwireless network and wireless device thereof

    KR1020070116454A

  • Computer system, method of controlling sound, and recording medium for storing sound control program

    KR1020090020235A

  • Electronic device using logical channels for communication

    KR1020160045635A

  • Method and apparatus for processing voice input

    KR1020160071732A

  • System for intelligent audio rendering using heterogeneous speaker nodes and method thereof

    US20220386026A1