Audio device and method of generating audio content

Abstract

A method of for generating a presentation to the user of dynamic media content, the device comprising control circuitry configured to generate for presentation to a user one or more items of dynamic m

Description

The following description of the preferred embodiment(s) is merely exemplary in nature and is no way intended to limit the invention, its application, or uses. The description of illustrative embodiments according to principles of the present invention is intended to be read in connection with the accompanying drawings, which are to be considered part of the entire written description. In the description of embodiments of the invention disclosed herein, any reference to direction or orientation is merely intended for convenience of description and is not intended in any way to limit the scope of the present invention. Relative terms such as “lower,” “upper,” “horizontal,” “vertical,” “above,” “below,” “up,” “down,” “top” and “bottom” as well as derivatives thereof (e.g., “horizontally,” “downwardly,” “upwardly,” etc.) should be construed to refer to the orientation as then described or as shown in the drawing under discussion. These relative terms are for convenience of description only and do not require that the apparatus be constructed or operated in a particular orientation unless explicitly indicated as such. Terms such as “attached,” “affixed,” “connected,” “coupled,” “interconnected,” and similar refer to a relationship wherein structures are secured or attached to one another either directly or indirectly through intervening structures, as well as both movable or rigid attachments or relationships, unless expressly described otherwise. Moreover, the features and benefits of the invention are illustrated by reference to the exemplified embodiments. Accordingly, the invention expressly should not be limited to such exemplary embodiments illustrating some possible non-limiting combination of features that may exist alone or in other combinations of features; the scope of the invention being defined by the claims appended hereto. An embodiment of a device 10 according to the present disclosure as shown in FIG. 1 comprises a housing 12 within which at least a processor, memory, and communication means are enclosed. The system architecture and details of the components of the device 10 are described in detail below. The device 10 further comprises three physical controls 14, 16, 18 with which a user may communicate to instruct the device 10 to take certain actions in accordance with audio content. It will of course be appreciated that the device 10 may be provided with less than three, more than three, or exactly three physical controls 14,16,18. It will also be appreciated that reference to physical controls 14, 16, 18 may be replaced with any other means of the user communicating with the device 10 by way of contact or gesture. In an embodiment where there are three physical controls 14, 16, 18, it is envisaged that a first of the controls 14 may be used by the user to select an object, person, or other selectable attribute forming part of the audio content that is presently being delivered to the user. The second of the controls 16 may be used by the user to select an action according to the object, person or other attribute selected by the user through use of the first control. The third of the controls 18 may be used to execute the action selected by the user in conjunction with the second control 16 on the object, person, or other attributes of the audio content selected by the user in conjunction with the first control 14. The first, second, and third controls may each comprise an encoded jog wheel, toggle switch, or button, for example. In this way, a user may interact with audio content. Taking a simple example where the audio content relates to a fantasy world where the reader plays the part of a hero, that user may be presented with an audio story detailing the exploits of the hero. While the details of any particular story are not relevance to his disclosure, it is important to understand the disclosure in the context of one or more examples. In such an example, the hero may be involved in an adventure where he or she is required to infiltrate a castle ruled by an evil wizard. When the hero arrives at the castle he or she may be presented with a series of options for objects, people, or other attributes detailed within the story with which the user may interact. For example, the user may be presented with a list of objects, people, or other attributes of the story that he or she may interact with. In this example, the user may have a choice of interacting with a guard who is positioned outside of a drawbridge to the castle. Alternatively, the user may have the option of scaling the wall of the castle. In yet another example, the user may simply have the option of walking through a door. If the user selects the second option of scaling the wall of the castle he or she may then be presented with a series of options as to how they would scale the wall of the castle. For example, the user may use a grappling hook to engage with a turreted castle and pull themselves up and over the wall. Another example, the user may have the option of using some form of spell or other apparatus for lifting themselves up and over the wall of the castle. In yet another example, the user may have the option of using explosives or other objects to destroy the wall of the castle to gain access thereto. Finally, to implement the action selected by the user in conjunction with the object, person, or other attributes of the audio content selected by the user, the user interacts with the third button 18 to execute the way in which they would like the story to progress. Of course, this example is highly simplified and relies upon the user being provided with predefined content for which they may engage. In other examples, the audio content may take the form of an audio sandbox. In such an example, the user may use the same buttons 14, 16, 18 to select from a wide variety of objects, people, or other attributes of the audio content and an equally wide variety of actions in relation to such people, objects, or other attributes of the audio content. Thus, in a first example, as illustrated in FIG. 2, a method of dynamically generating user-defined audio content 200 is provided. At a first step of the method 202 a media asset in the form of audio content is retrieved either from local storage of the device 10 or from a remote server. At a second step of the method 204 the retrieved media asset is generated for presentation to the user via the device 10. At a third step of the method 206 the user is presented via the device 10 with an audible list of actions which the user may take within the media asset. At a fourth step 208 of the method objects, people, or other attributes of the media asset. At a fourth step of the method 108 the device 10 receives from the user the device 10 receives from the user a selection of one or more actions to take within the media asset. At a fifth step of the method 210 the user is presented via the device 10 with an audible list of people, objects, or other attributes of the media asset. At a sixth step of the method 212 the device 10 receives from the user a selection of one or more people, objects, or other attributes of the media asset. At a seventh step 214 the user is presented via the device 10 with an audible confirmation of the selection of the selected action(s) and one or more people, objects, or other attributes of the media asset. At an eight step 216 the device 10 receives from the user an executable command to take the actions selected by the user in connection with the one or more people, objects, or other attributes selected by the user. In some embodiments, the available objects and actions may be variable depending on certain parameters. Certain parameters may be linked to the progress of the user within the media asset itself. For example, the pre-recorded elements of the media asset may be time stamped and each timestamp range may be linked to a particular data filled entry in a database that may be stored either on the device 10 or on a remote server. Alternatively, certain content and corresponding objects, people, and other attributes of the media asset may only be available to the user when the user is physically located in a certain geographically bound space. For example, if the user is walking within Richmond Park in London certain content may only be available to the user in that location. In that way the user may control the audio content presented to them via the media asset by visiting certain locations. The geographical locale of the user may be received by the device 10 by way of GPS or geo-fence technology. In yet another embodiment, the content available to the user may be controlled depending on the time of day, the weather, current events, and any other variable that may be selected either by the user or content developer. For example, if the user happens to be walking through the centre of London at two in the morning, they would not be provided with the opportunity to illegally enter a television store which would of course be close to business at that time of the morning. This may involve a combination of determining the location of the user and controlling the content both via the user's location and in connection with the time of day. The content available to a user may be controlled in accordance with many different parameters some of which are described herein. However, it should be appreciated that this description is not exhaustive and that omission of any method or means of controlling the content should not be interpreted as exclusion of such method and means from the scope of the claims as set out at the end of this document. FIG. 3 illustrates a method of presenting content to a user 300. At a first step of the method 302 an item of base content is retrieved from local storage or a remote server. At a second step of the method 304 the retrieved base content is generated for presentation to the user via the device 10. At a third step 306 one or more attributes of the user or the user's device 10 are collected and compared to a plurality of data entries concerning the base content. At a fourth step 308 one or more items of supplemental content may be generated for presentation to the user based upon one or more matched data entries. At a fifth step 310 the device 10 receives from the user a selection of one or more items of supplemental content and acts to retrieve such supplemental content from local memory or the remote server. At a sixth step 312 the retrieved supplemental content is generated for presentation to the user via the device 10. FIG. 4 illustrates a decision tree according to an embodiment of the disclosure. These subjects of the content contained therein is not relevant to the underlying structure of the decision tree hence is omitted from the illustration and this disclosure for clarity. As can be seen, a particular story path is represented at block 402. This story path 402 may comprise four major subplots 404 that a user may select at an appropriate point in the story. Each subplot 404 may consequently comprise an additional four minor subplots 406. Each minor subplot 406 may further comprise an unlimited number of endings 408 fixed only by the number of decision points present throughout the storyline. There may also be interrelatedness between one or more of the major subplots, minor subplots, or endings. Thus, the story path may comprise a plurality of audio files stored within a data structure that may be accessed by the device 10 in accordance with a user selected plot for a particular story path. In some embodiments, the user may be presented audibly with the option to build an environment that reflects their current location. For example, the user may first select a type of location using the first button of the device 10. For example, the user may select first whether they are inside or outside. Next, the user may select the type of building or outside space of therein. The sake of argument, the user at this stage may select that they are currently in a classroom. Based on this information, the user may be presented with a series of questions to help them build an audible twin of their location. For example, the user might be asked how many desks are in the classroom, how many people are in the classroom, what objects are in the classroom of significance, for example. Using this data, a digital audio twin is created to enable a semblance of realism when the user is presented with objects, people, and other attributes concerning their location as well as the different actions that the user might wish to take in association with such people, objects, or other attributes. In accordance with the disclosure, the user therefore may create a sandbox world within which to immerse themselves. Using the three physical buttons of the device, the user may place objects and people in the digital audio twin of their location and interact with those objects and people. The user may also incorporate pre-recorded content into their sandbox story. For example, if a user is located within a school, they may be presented with options for storylines that involve school environment. This provides a further semblance of realism to the user created story. While there is no technological limit to the number of objects, people, or other attributes with which the user may interact, or actions which the user may take, it is generally expected that at any one time the user may be presented with up to 20 options from which they may select. For example, in a game type environment, the user may first select a walk command using the first button and a bench using the second button consequently when at the bench the user may select a stick to command with the first button on the bench with the second button to cause their character to sit on the bench. Even with a relatively limited number of options available to the user, he or she may be presented with anywhere between 100 and 400 possibilities for control of the storyline or their character within the storyline. The aforementioned disclosure applies equally to generating user-defined correspondence with in story characters and / or other users who may be interacting at any time with the same media asset or storyline. For example, as shown in FIG. 5, a method of generating predefined user correspondence 500 is provided. At a first step of the method 502 a media asset in the form of audio content is retrieved from local storage or a remote server. At a second step 504 of the method the retrieved media asset is generated for presentation to the user via the device 10. At a third step 506 the user is presented firstly with a list of characters with whom they may interact. At a fourth step 508 the user is presented with a list of audio commands or speech that they may select. At a fifth step 510, the device 10 receives from the user a selection of both a character and an audio command or speech. At a sixth step 512 the device 10 receives from the user an execute command to take the action specified by the user. At a seventh step 514 the device 10 generates for presentation to the user an audio output representative of the user's executable command in conjunction with the media asset currently being presented to the user. The structural architecture of a device 10 according to aspects and embodiments of the invention is shown at FIG. 6. At its core, the device comprises control circuitry, also referred to herein as a processor, to which each of the other components of the device are either directly or indirectly connected. As a non-exhaustive list, the following components may be connected to the control circuitry 602: data storage 604, battery management unit 606, inertial measurement unit 608, GSS or GPS receiver 610, Bluetooth controller 612, amplifier 614, load switch 616, interface buttons 618, vibration motor 620, and speaker 622. FIG. 7 is a block diagram representing devices, components of each device, and data flow therebetween for a remote inspection system, in accordance with some methods and embodiments of the disclosure. System 700 is shown to include a client device 702, a server 704, and a communication network 706. It is understood that while a single instance of a component may be shown and described relative to FIG. 7, additional instances of the component may be employed. For example, server 702 may include or may be incorporated in, more than one server. Similarly, communication network 706 may include or may be incorporated in, more than one communication network. Server 704 is shown communicatively coupled to client device 702 through communication network 706. While not shown in FIG. 7, server 704 may be directly communicatively coupled to client device 702, for example, in a system absent or bypassing communication network 706. Communication network 706 may comprise one or more network systems, such as, without limitation, an Internet, LAN, WIFI, or other network systems suitable for audio processing applications. In some embodiments, system 700 excludes server 704, and functionality that would otherwise be implemented by server 704 is instead implemented by other components of system 700, such as one or more components of communication network 706. In still other embodiments, server 704 works in conjunction with one or more components of communication network 706 to implement certain functionality described herein in a distributed or cooperative manner. Similarly, in some embodiments, system 700 excludes client device 702, and functionality that would otherwise be implemented by client device 702 is instead implemented by other components of system 700, such as one or more components of communication network 706 or server 704 or a combination. In still other embodiments, client device 702 works in conjunction with one or more components of communication network 706 or server 704 to implement certain functionality described herein in a distributed or cooperative manner. Client device 702 includes control circuitry 708 and storage 712. In some embodiments, client device 702 may be configured as device 10 of FIG. 1. Server 704 includes control circuitry 714 and storage 716. Each of the storages 712 and 716 may be an electronic storage device. As referred to herein, the phrase “electronic storage device” or “storage device” should be understood to mean any device for storing electronic data, computer software, or firmware, Each storage 712, 716 may be used to store various types of content, media data, and or other types of data (e.g., they can be used to store multimedia content such as audio, video, and advertisement data). The non-volatile memory may also be used (e.g., to launch a boot- up routine and other instructions). Cloud-based storage may be used to supplement storages 712, 716, or instead of storages 712, 716. In some embodiments, control circuitry 708 and / or 714 executes instructions for an application stored in memory (e.g., storage 712 and / or storage 716). Specifically, control circuitry 708 and / or 714 may be instructed by the application to perform the functions discussed herein. In some implementations, any action performed by control circuitry 708 and / or 714 may be based on instructions received from the application. For example, the application may be implemented as software or a set of executable instructions that may be stored in storage 712 and / or 716 and executed by control circuitry 708 and / or 714. In some embodiments, the application may be a client / server application where only a client application resides on client device 702, and a server application resides on server 704. The application may be implemented using any suitable architecture. For example, it may be a stand-alone application wholly implemented on client device 702. In such an approach, instructions for the application are stored locally (e.g., in storage 712), and data for use by the application is downloaded periodically (e.g., from an out-of-band feed, from an Internet resource, or using another suitable approach). Control circuitry 708 may retrieve instructions for the application from storage 712 and process the instructions to perform the functionality described herein. Based on the processed instructions, control circuitry 708 may determine a type of action to perform. For example, in response to a network bandwidth maximum, control circuitry 708 may perform the steps of processes relative to various embodiments discussed herein. In client / server-based embodiments, control circuitry 708 may include communication circuitry suitable for communicating with an application server (e.g., server 704) or other networks or servers. The instructions for carrying out the functionality described herein may be stored on the application server. Communication circuitry may include a cable modem, an Ethernet card, or a wireless modem for communication with other equipment, or any other suitable communication circuitry. Such communication may involve the Internet or any other suitable communication networks or paths (e.g., communication network 706). In another example of a client / server-based application, control circuitry 708 runs a web browser that interprets web pages provided by a remote server (e.g., server 704). For example, the remote server may store the instructions for the application in a storage device. The remote server may process the stored instructions using circuitry (e.g., control circuitry 708). Client device 702 may receive inputs from the user and transmit those inputs to the remote server 704 for processing. Alternatively, client device 702 may receive inputs from the user and process the received inputs locally, by control circuitry 708. Control circuitry 708 and / or 714 may be based on any suitable processing circuitry. As referred to herein, processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field- programmable gate arrays (FPGAs), applicationspecific integrated circuits (ASICs), etc., and may include a multi-core processor (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores). In some embodiments, processing circuitry may be distributed across multiple separate processors, for example, multiple of the same type of processors (e.g., two Intel Core i9 processors) or multiple different processors (e.g., an Intel Core i7 processor and an Intel Core i9 processor). In some embodiments, control circuitry 708 and / or control circuitry 714 are configured to implement a media content operation system, such as systems, or parts thereof, that perform various media content manipulation processes described herein. It should be appreciated that in the above description of exemplary embodiments, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of or more of the various inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. While some embodiments described herein include some, but not other features included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the disclosure, and form different embodiments, as would be understood by the skilled person. For example, in the following claims, any of the claimed embodiments can be used in any combination. Thus, while certain embodiments have been described, it will be appreciated that other and further modifications may be made thereto without departing from the spirit of the disclosure, and it is intended to cover all such modifications, enhancements, and other implementations, which fall within the true spirit and scope of this disclosure. To the maximum extent permitted by law, the scope of this disclosure is to be determined by the broadest permissible interpretation of the following claims, and shall not be restricted or limited by the foregoing detailed description While various implementations of the disclosure have been described, it will be readily apparent to the skilled person that many more implementations are possible within the scope of the disclosure.

Claims

1. A device for generating a presentation to the user of dynamic media content, the device comprising:control circuitry configured to generate for presentation to a user one or more items of dynamic media content;storage for storing one or more items of dynamic media content;communication means for enabling the device to communicate wirelessly with a remote server and / or other devices;a first control input configured to enable the user to select one or more objects, people, or other attributes of media content that the user wishes to interact with;a second control input configured to enable the user to select one or more actions that the user wishes to be undertaken in relation to the selected objects, people, or other attributes of media content selected using the first control input; anda third control input configured to execute the combination of the user's input using the first control input and second control input, and an audible output for generating for presentation to the user the dynamic media content.

2. A device for generating to a user dynamic media content, wherein the dynamic media content is in the form of audio content.

3. A device for generating to a user dynamic media content according to claim two wherein the device further comprises one or more location sensors including but not limited to GPS or geo-fencing sensors.

4. A device for generating to a user dynamic media content according to any of claims 1 to 3, the device further comprising a display for providing a visual indication to the user of the audio options that are presented to the user by way of the audio output of the device.

5. A device for generating to a user dynamic media content according to any preceding claim wherein the device further comprises at least one inertial measurement unit.

6. A device for generating to a user dynamic media content according to any preceding claim further comprising at least one vibration motor.

7. A device for generating to the user dynamic media content according to any preceding claim further comprising a load switch configured to control the one or more vibration motors in response to determination by the processor that the load switch has or has not exceeded a predefined input threshold.

8. A device for generating to the user dynamic media content according to any preceding claim further comprising a battery management module.

9. A device for generating to the user dynamic media content according to claim six wherein the vibration motor is configured to activate if the user leaves a predetermined area.

10. A device for generating to the user dynamic media content according to any preceding claim wherein each of the first, second, and third control inputs comprise physical control inputs that may be interacted with to select options from a list of available options generated for presentation to the user.11 .A method for generating for presentation to auser dynamic media content, the method comprising receiving from the user selection of an item of media content; generating the presentation to the user the selected item of media content; generating for presentation to the user a plurality of options concerning actions that the user may cause to be undertaken within the media content; receiving from the user selection of one or more actions; generating for presentation to the user a plurality of options concerning objects, people, or other attributes of the media content that the user wishes to apply the selected action to; receiving from the user a selection of one or more objects, people, or other attributes of the media content; generating for presentation to the user a confirmation of the selected action and people, object, or other attributes of the media content selected by the user; receiving from the user a confirmation that the selected action and people, objects, or other attributes of the media content should be executed.

12. A method for generating for presentation to a user dynamic media content, themethod comprising:means for presentation to a user one or more items of dynamic media content;means for storing one or more items of dynamic media content;means for enabling the device to communicate wirelessly with a remote server and / or other devices;means for enabling the user to select one or more objects, people, or other attributes of media content that the user wishes to interact with;means for enabling the user to select one or more actions that the user wishes to be undertaken in relation to the selected objects, people, or other attributes of media content selected using the first control input; andmeans for executing the combination of the user's input using the first control input and second control input, and an audible output for generating for presentation to the user the dynamic media content.

Images