Interactive play apparatus

Abstract

An interactive play apparatus comprising a spatial audio system and an interactive toy element, in particular an interactive toy construction element, wherein the inter- active toy element comprises at least one sensor configured to detect one or more user interactions, and wherein the spatial audio system is configured to output a plu- rality of sounds perceivable by a user interacting with the interactive toy element as a spatial soundscape.

Description

[0001] Interactive play apparatus

[0002] The present invention relates to an interactive play apparatus.

[0003] BACKGROUND OF THE INVENTION

[0004] A variety of interactive play apparatus exist that allow a user to engage in various play scenarios.

[0005] For example, programmable toys are known e.g. from the product ROBOTICS INVENTION SYSTEM from LEGO MINDSTORMS, which is a toy that can be programmed by a computer to perform unconditioned as well as conditioned actions. While the above prior art system provides interesting game play, it remains desirable to provide improved interactive play apparatus that foster children's imagination in a playful and entertaining manner.

[0006] SUMMARY

[0007] In accordance with a first aspect disclosed herein, an interactive play apparatus comprises a spatial audio system and an interactive toy element, in particular an interactive toy construction element. The interactive toy element comprises at least one sensor configured to detect one or more user interactions. The spatial audio system is configured to output a plurality of sounds perceivable by a user interacting with the interactive toy element as a spatial soundscape.

[0008] The spatial audio system comprises one or more loudspeakers, in particular one or more loudspeakers different and separate from the interactive toy element and different from any loudspeaker of the interactive toy element. The interactive toy element is preferably movable relative to the one or more speakers; in particular, the user can move the interactive toy element relative to the one or more speakers of the spatial audio system. The one or more speakers may be stationary speakers located at respective positions, e.g. at respective positions throughout a room. Alternatively or additionally one or more speakers of the spatial audio system may be provided as a headset or similar audio device to be worn by a user. The interactive toy element may be a toy construction element of a modular toy construction system. The modular toy construction system may include a plurality of modular toy construction elements, in particular the interactive toy construction element and further one or more toy construction elements. In particular, the modular toy construction system may further may comprise conventional toy construction elements, in particular passive toy construction elements that do not include any electronic components. Each modular toy construction element may comprise coupling members for detachably connecting the toy construction elements to each other so as to construct a toy construction model. When the coupling members are detachably interconnectable, the user may deconstruct previously built toy construction models and re-use the toy construction elements so as to build new toy construction models. For example, the toy construction elements may be interconnected with each other by traction / friction or by an interlocking connection.

[0009] Preferably, the interactive toy element does not comprise electrical contacts directly accessible on the outside of its housing. Advantageously, a re-chargeable power supply may be included in the interactive toy element. The re-chargeable power supply may be adapted for wireless charging. Advantageously, a housing of the interactive toy element is made of, or fully encapsulated with, an electrically insulating material.

[0010] The interactive toy element may be communicatively coupled to the spatial audio system, preferably by means of a direct or indirect wireless communication link, e.g. via Bluetooth and / or another suitable radio-frequency communication.

[0011] In some embodiments, the interactive play apparatus is configured to detect one or more attributes of a toy construction model constructed from the interactive toy element and from one or more additional toy construction elements. The detected one or more attributes may include a physical property of the toy construction model and / or of one or more of the toy construction elements included in the toy construction model, such as a shape, size, color and / or weight of the constructed toy construction model and / or of a toy construction element of the model. Alternatively or additionally, the detected one or more attributes may include an identity of, or an identifier or code associated with, the toy construction model or of / with a toy construction element of the toy construction model. The identifier or code may be machine-readable, e.g. a barcode, a QR code, and RFID identifier etc. Alternatively or additionally, the detected one or more attributes may include a detected or recognized type of object represented by the toy construction model, e.g. an identification of the toy construction model as representing a car, a creature, a building and / or the like. To this end, the apparatus may include one or more sensors for detecting the one or more attributes, e.g. an RFID reader, a barcode reader a QR code reader, a color sensor, a camera, etc. In some embodiments, the one or more sensors are included in the interactive toy element.

[0012] The spatial audio system may thus be configured to create a perceivable spatial soundscape responsive at least to the detected one or more attributes of the toy construction model constructed from the interactive toy element and from one or more additional toy construction elements. To this end, the interactive toy element may communicate the one or more detected attributes to the spatial audio system or to a control unit for controlling the spatial audio system. The spatial audio system or the control unit may then create the soundscape responsive to at least the received one or more attributes. For example, the control unit may be a gateway device communicatively coupled to the interactive toy element and to the spatial audio system. Alternatively, the interactive toy element may determine, from the detected one or more attributes of the toy construction model, one or more attributes of the spatial soundscape to be created and communicate the determined attributes of the spatial soundscape to the spatial audio system or to the control unit.

[0013] In some embodiments, the interactive toy element includes a local loudspeaker and is configured to output sounds associated with the interactive toy element and / or associated with a toy construction model that includes the interactive toy element. The sounds output by the loudspeaker of the interactive toy element and associated with the interactive toy element or the toy construction model may represent sounds emitted by the toy construction model or by an object represented by the toy construction model. For example, when the toy construction model represents a police car, the associated sounds may be car engine sounds, sounds of the police car siren, and / or the like. The spatial audio system may then be configured to create a soundscape representing an environment in which the toy construction model is immersed, but not being emitted from the object represented by the toy construction model per se. In the above example of a toy construction model representing a police car, the soundscape created by the spatial audio system may be general city sounds, such a sounds from other cars, honking horns, chatter from pedestrians, and / or the like.

[0014] In some embodiments, the local loudspeaker of the interactive toy element is controlled locally by the interactive toy element. In alternative embodiments, operation of the local loud speaker is controlled by the spatial audio system.

[0015] Operation of the local loudspeaker may be coordinated, in particular synchronised, with the operation of the spatial audio system. Synchronisation may be performed with different accuracies, depending on the nature of the desired coordinated sound effects. In some embodiments, the interactive play apparatus may control the local loudspeaker of the interactive toy element and one or more loudspeakers of the spatial audio system so as to create a combined spatial soundscape, e.g. so as to create a perceived movement of a virtual sound source along a trajectory away from or towards the interactive toy element, e.g. to provide an audible representation of the casting of a spell, of the ejection of an object, and / or the like.

[0016] The one or more sensors of the interactive toy element may include one or more of the following sensors: a position sensor, an orientation sensor, a tilt sensor, a movement sensor, an accelerometer, an I MU, a color sensor, an acoustic sensor such as a microphone, a proximity sensor, a light sensor, a touch sensor, a magnetic sensor, and / or one or more other sensors. The one or more sensors generate one or more sensor signals indicative of a sensed quantity or property, in particular a quantity or property indicative of a user interaction with the interactive toy element, e.g. the user touching, shaking, moving or otherwise manipulating the interactive toy element.

[0017] The interactive toy element may communicate the one or more sensor signals and / or information about one or more sensed properties derived from the sensor signals to the spatial audio system or to a control unit for controlling the spatial audio system. The spatial audio system or the control unit may then create the sound- scape responsive to at least the received one or more sensor signals and / or the received information. Alternatively, the interactive toy element may determine one or more attributes of the spatial soundscape to be created from the sensor signals and / or from the information about one or more sensed properties and communicate the determined attributes of the spatial soundscape to the spatial audio system or to the control unit.

[0018] For example, the spatial audio system may be configured to create a soundscape responsive to a detected movement of the interactive toy element, e.g. responsive to a detected gesture. Alternatively or additionally, the spatial audio system may be configured to create a soundscape responsive to a detected relative position and / or orientation of the interactive toy element relative to another interactive toy element and / or relative to a component of the spatial audio system, e.g. relative to a loudspeaker of the spatial audio system. The detected position may e.g. be a detected proximity of the interactive toy element relative to another interactive toy element and / or relative to a component of the spatial audio system or to another reference location. The detected orientation may e.g. be indicative of a pointing direction, e.g. when the user holds the interactive toy element and points towards a location in a room or the like.

[0019] In some embodiments, the spatial audio system is configured to create the soundscape based on one or more additional inputs and / or configuration parameters of the spatial audio system or otherwise. For example, in some embodiments, the interactive play apparatus may have stored thereon, or be configured to obtain, one or more data items indicative of one or more properties of the environment in which the spatial audio system and / or the interactive toy element is / are placed. The spatial audio system may thus be configured to create the soundscape based on said one or more properties. Examples of properties of the environment a scene map, a universal scene description or other information indicative of a layout of the space, e.g. the room, in which the spatial audio system and / or interactive toy element is / are positioned. Generally, when referring to the interactive play apparatus performing an operation, it will be appreciated that a processor and / or another component / unit of the interactive play apparatus may perform this operation. Here and in the following, the term processor is intended to comprise any circuit and / or device and / or system suitably adapted to perform the functions described herein. In particular, the above term comprises general- or special-purpose programmable microprocessors, such as a central processing unit (CPU) of a computer or other data processing system, Digital Signal Processors (DSP), Application Specific Integrated Circuits (ASIC), Programmable Logic Arrays (PLA), Field Programmable Gate Arrays (FPGA), special purpose electronic circuits, etc., or a combination thereof. The processor may be implemented as a plurality of processing units.

[0020] The interactive play apparatus may include a suitable computer program implementing the various functions of the interactive play apparatus. For example, the computer program may be stored on a suitable storage device of the interactive play apparatus and executable by a processor of the interactive play apparatus, e.g. a suitably programmed microprocessor. It will be appreciated that the functions of the play apparatus may be divided into program modules in different ways. For example, some of the above functional modules may be integrated into a single module while others may be split up into submodules.

[0021] The present disclosure relates to different aspects including the interactive play apparatus described above and in the following, corresponding apparatus, systems, methods, and / or products, each yielding one or more of the benefits and advantages described in connection with one or more of the other aspects, and each having one or more embodiments corresponding to the embodiments described in connection with one or more of the other aspects and / or disclosed in the appended claims.

[0022] Additional features and advantages will be made apparent from the following detailed description of embodiments that proceeds with reference to the accompanying drawings.

[0023] BRIEF DESCRIPTION OF THE DRAWINGS Preferred embodiments of the aspects disclosed herein will be described in more detail in connection with the appended drawings, where:

[0024] FIG. 1 shows a schematic block diagram of an example of an interactive play apparatus.

[0025] FIG. 2 shows a schematic view of another example of an interactive play apparatus. FIG. 3 shows a schematic view of another example of an interactive play apparatus. FIG. 4 illustrates a use of an example of an interactive play apparatus.

[0026] FIG. 5 schematically illustrates different examples of detectable user interactions influencing the created spatial soundscape.

[0027] FIG. 6 schematically illustrates different examples of use cases of an embodiment of an interactive play apparatus as disclosed herein.

[0028] DETAILED DESCRIPTION

[0029] Generally, in some embodiments, the interactive play apparatus disclosed herein comprises an interactive toy element and a spatial audio system. The interactive toy element may be in the form of an interactive toy construction element, e.g. a brickshaped toy construction element. The interactive toy element may be equipped with an accelerometer and / or with a position tracking device. The interactive toy element may further comprise a compact speaker. The interactive toy element may be wirelessly connected to the spatial audio system. The spatial audio system may comprise one or more smart speakers. During operation, the interactive play apparatus generates a spatial audioscape / soundscape that responds to the interactions of the user with the interactive toy element, e.g. with a toy construction model including the interactive toy element, in real time.

[0030] The system may be scalable and dynamically reconfigurable to the number of speakers present in the room, thus enabling spatial audio to manifest in one dimension for single mono speaker setups, in two dimensions in the case of stereo speaker pairs or soundbars, or in three dimensions in the case of surround sound and other multi- speaker setups. For example, two or more speakers may be controlled such that the created sound appears to originate from a virtual sound source that moves, e.g. in two dimensions such as from left to right, or in three dimensions. In some embodiments, the interactive play element includes an embedded speaker, also referred to herein as a local speaker. The interactive play element may be a toy construction element that can be part of a toy construction model such that the model includes the interactive toy element and one or more additional toy construction elements. The interactive play element comprises hardware, in particular, one or more sensors, to determine its position and orientation, e.g. by way of an inertial 3-DOF measurement (acceleration and orientation). The interactive toy element may further comprise a processing unit configured (e.g. by suitable software) to perform e.g. position / orientation determination (based on the sensor inputs) and / or sound rendering. The processing unit may be configured to calculate the real-time position, orientation and / or acceleration of the interactive toy element based on a tracking solution and, optionally, based on the current physical configuration of the model. The latter may e.g. be based on the detection of machine-readable toy construction elements or otherwise. The processing unit of the interactive toy element and / or a processing unit of the spatial audio system may be configured to render a spatial soundscape, e.g. based on pre-recorded samples and / or based on dynamic sound synthesis. The processing unit of the interactive toy element and / or a processing unit of the spatial audio system may be configured to modify the soundscape based on the sensor data. The tacking solution may be implemented as a software solution that tracks the relative and / or absolute position of the interactive toy element in space.

[0031] FIG. 1 shows a schematic block diagram of an example of an interactive play apparatus, generally designated by reference numeral 10.

[0032] The interactive play apparatus 10 comprises an interactive toy element 100 and a spatial audio system 200.

[0033] The interactive toy element comprises a processing unit 102, a communications interface 103, a sensor 104 and a local loudspeaker 105.

[0034] It will be appreciated that other embodiments of an interactive play apparatus may include more than one interactive toy element. It will further be appreciated that alternative embodiments of an interactive toy element may comprise more than one sensor. Similarly, some embodiments of an interactive toy element may include no internal loudspeaker. Yet alternatively or additionally, some embodiments of an interactive toy element may include additional components, such as a power source, e.g. a rechargeable battery, a memory or other data storage device, one or more additional function devices such as a light source, etc.

[0035] The processing unit 102 may be a suitably programmed microprocessor such as a CPU of a suitably programmed computer. In alternative embodiments, the processing unit may be embodied as an ASIC or other suitable processing circuitry. The processing unit may receive sensor signals from the sensor 104 and processes the received sensor signals so as to determine a play action from at least the received input. The processing unit may further control the loudspeaker 105 and / or one or more other function devices of the interactive toy element responsive to the sensor signals. The processing unit may further communicate the determined play action via the communications interface 103 to the spatial audio system 200.

[0036] To this end, the processing unit 102 may include, or be coupled to, a memory or other suitable data storage device. The memory may have stored thereon play rules, etc. The memory may further have stored thereon other relevant information, data, one or more parameters and / or attributes, one or more programs to carry out the functionality as disclosed herein, and / or the like.

[0037] The communications interface 103 may comprise one or more devices or circuitry configured to communicate with the spatial audio system 200, e.g. with one or more loudspeakers 210A-C of the spatial audio system as described herein. The communications interface 103 may be configured to facilitate wired and / or wireless communications via one or more suitable communications protocols and technologies, such as Bluetooth, another form of radio-frequency communications, e.g. a wireless local area network, or via other wireless technologies such as infrared-based communications, ultrasound-based communication, etc.

[0038] Examples of a suitable sensor 104 include a position sensor, an orientation sensor, a tilt sensor, a movement sensor, an accelerometer, an I MU, a color sensor, an acoustic sensor such as a microphone, a proximity sensor, a light sensor, a touch sensor, a magnetic sensor, and / or one or more other sensors.

[0039] The sensor 104 may be responsive to one or more sensor inputs representative of one or more aspects and / or features of the physical environment in a proximity of the interactive toy element and / or indicative of user interactions with the interactive toy element, e.g. responsive to gestures performed by the user with the interactive toy element. The or each sensor 104 is adapted to forward a sensor signal to the processing unit 102, corresponding to, or representing, the sensor input as obtained or provided by the respective sensor 104. Alternatively or additionally, the interactive toy element may receive one or more sensor signals or other input from one or more external devices, e.g. from another interactive toy element, e.g. via the communications interface 103.

[0040] The spatial audio system 200 includes one or more loudspeakers 210A-C. In the example of FIG. 1 , the spatial audio system 200 includes three loudspeakers. However, it will be appreciated that other examples may include a different number of loudspeakers, such as a single loudspeaker or two, three, four or even more loudspeakers. The spatial audio system may be configured to output sounds via the one or more loudspeakers 210A-C that create a spatial soundscape, i.e. a combination of sounds that forms or arises from an immersive environment around the interactive toy element. The spatial soundscape is perceived by the user interacting with the interactive toy element as a three-dimensional immersive acoustic environment, i.e. as a combination of sounds that are perceived as originating from one or more virtual sound sources at respective 3D locations relative to the user, in particular from virtual sound sources that appear to be moving relative to the user. Examples of spatial audio systems include smart speakers, soundbars and / or the like.

[0041] Accordingly, in some embodiments, the processing unit 102 is configured to control the loudspeaker 105 in response to a received sensor signal from the sensor(s) 104. Moreover, the spatial audio system may create a soundscape responsive to the determined play action(s) based on the information received from the interactive toy element via the communications interface 103. The play experience and, in particular, the soundscape may thus be specifically adapted on the basis of, or influenced by, the interactions of the user with the interactive toy element as sensed by the sensor 104.

[0042] It will be appreciated that some embodiments of the interactive play apparatus 100 may comprise additional or alternative components, such as further interfaces, displays, output devices, etc.

[0043] The different blocks of FIG. 1 may be implemented in respective different physical devices or, alternatively, some or all of them may be implemented in a single physical device. The shown connections may be wired connections, wireless connections or a mix thereof.

[0044] FIG. 2 shows a schematic view of another example of an interactive play apparatus. The interactive play apparatus 10 of FIG. 2 comprises an interactive toy element 100 and a spatial audio system 200, all as described in connection with FIG. 1.

[0045] The example of FIG. 2 differs from the previous example in that the spatial audio system 200 includes loudspeakers 210A-C and a control unit 220, e.g. a suitably programmed computer or other processing device communicatively coupled to the loudspeakers 210A-C via respective wired or wireless connections. Accordingly, in the example of FIG. 2, the interactive toy element 100 may communicate with the control unit 220 of the spatial audio system and does not need to communicate directly with multiple individual loudspeakers 210A-C. In the example of FIG. 2, the control unit 220 controls the loudspeakers 210A-C so as to create the soundscape. It will be appreciated that the control unit 220 may be provided as a separate device, separate from the loudspeakers 210A-C as shown in FIG. 2. Alternatively, the control unit 220 may be integrated with one of the loudspeakers 210A-C.

[0046] FIG. 3 shows a schematic view of yet another example of an interactive play apparatus. The interactive play apparatus 10 of FIG. 3 comprises an interactive toy element 100 and a spatial audio system 200, all as described in connection with FIG. 2. The example of FIG. 3 differs from the previous example in that the interactive play apparatus 10 further comprises a gateway device 300 configured to communicate with the interactive toy element 100 and with the spatial audio system 200. In the example, of FIG. 3, the gateway device 300 communicates with a control unit 220 of the spatial audio system 200. However, it will be appreciated that, in other embodiments, the gateway device 300 may communicate with the one or more loudspeakers 210A-C directly.

[0047] The gateway device 300 may communicate with the interactive toy element 100 via a first communication link, preferably a wireless communications link, e.g. Bluetooth or another radio-based communications technology. The gateway device 300 may communicate with the spatial audio system 200 via a second communication link, which may use the same or a different communications technology as the first communication link. For example, the second communications link may be via a domestic communications network, such as via Wifi, a local area network, and / or the like. The gateway device 300 may thus operate as a gateway between one or more interactive toy elements and the spatial audio system and, optionally, as a gateway to other systems. In some embodiments, the gateway device 300 may also include a processing unit that receives sensor signals and / or other information, e.g. information derived from the sensor signals, from the one or more interactive toy elements and that determines attributes of the soundscape to be created from the received sensor signals and / or the received other information. The gateway device 300 may then control the spatial audio system to create the soundscape accordingly.

[0048] FIG. 4 illustrates a use of an example of an interactive play apparatus including an interactive toy element 100 and a spatial audio system, which, in this example, includes loudspeakers 200A and 200B. In the example of FIG. 4, the interactive toy element 100 may be part of a hand-held toy construction model or another type of hand-held or wearable toy, or the like. The interactive play apparatus may e.g. be of the type described in connection with any one of FIGs. 1 through 3. In the example of FIG. 4, the interactive toy element 100 includes a light source, e.g. a handheld flash light or a handheld projector controllable to project images or other visual ef- fects onto a surface such as a wall. Nevertheless, it will be appreciated that the interactive toy element 100 may be operable to perform alternative or additional functions. The interactive toy element 100 comprises a sensor e.g. an accelerometer and / or IMU or another sensor configured to detect the position and / or orientation of the interactive toy element. In some embodiments, the sensor may be operable to detect the position and / or orientation of the interactive toy element 100 relative to one or more of the loudspeakers 200A-B and / or relative to another reference. For example, to this end, the loudspeakers and / or a separate device may include a beacon or other functionality allowing the interactive toy element 100 to determine its position relative to the loudspeakers 200A and 200B.

[0049] When the user 400 moves the interactive toy element 100 around the room, the apparatus may control the loudspeakers 200A-B to create a spatial soundscape responsive to the movements of the interactive toy element and / or responsive to other user interactions with the interactive toy element 100.

[0050] Generally, various embodiments of the interactive play apparatus may be configured to create responsive spatial soundscapes. To this end, the spatial soundscapes may be created responsive to one or more triggers, e.g. as schematically illustrated in FIG. 5.

[0051] For example, the spatial soundscapes may be responsive to gestures, e.g. as schematically illustrated by FIG. 5A. To this end, the spatial audio system may implement a dynamic spatial audio layer that may respond to user gestures, e.g. based on accelerometer, IMU and / or gyroscopic data, so as to alter the sound dynamically. For example, to this end, the dynamic spatial audio layer may implement audio engineering methods known as such in the art, such as: panning, phase modulation, delay, change of amplitude, Doppler effect, etc. In some embodiments, the interactive play apparatus is configured to unlock soundscapes responsive to gestures. To this end, the interactive toy element may detect and analyze movements of the interactive toy element, e.g. so as to recognize one or more specific gestures, which may have previously been recorded by the user or which may otherwise be pre-defined. Responsive to recognizing a gesture, the apparatus may unlock respective sounds associated with the recognized gesture. For example, in order to unlock a certain sound associated with a magic spell, a child might need to move a toy construction model, which includes the interactive toy element, in a specific manner to hear the sound.

[0052] In some embodiments, the spatial soundscapes may be responsive to the position of the interactive toy element, e.g. as schematically illustrated by FIG. 50. For example, using position tracking by the interactive toy element, the dynamic soundscape may respond to the location of the interactive toy element in real time. For instance, moving a car from position A to position B may cause the soundscape to change from a city sound to a forest sound.

[0053] In some embodiments, the spatial soundscapes may be responsive to the build state of a toy construction model or responsive to another detectable attribute of the constructed toy construction model, e.g. as schematically illustrated by FIG. 5B. For example, dynamic spatial audio may respond to how the toy construction model has been constructed by the child, thereby dynamically creating layers and soundscapes as the construction changes and evolves. For instance, building the model of a jet ski - once the model is identified as a jet ski - may cause the system to create the soundscape of sea waves. The interactive play apparatus may determine how the toy construction model has been constructed in a number of ways. For example, the interactive toy element may detect machine-readable tag construction elements added to the model, e.g. as described in WO 2020 / 145720, or the apparatus may otherwise detect the physical topology of a toy construction model, e.g. as described in WO 2019 / 238630. In some embodiments, the interactive play apparatus may include a vision system configured to recognize attributes of a constructed toy construction model, e.g. as described in WO 2017 / 194439.

[0054] In some embodiments, the spatial soundscapes may be responsive to proximity e.g. as schematically illustrated by FIG. 5D. For example, the interactive play apparatus may be configured to control the spatial audio system based on a detected proximity of the interactive toy element in relationship to one or more other toy elements, to one or more other toy construction models, to the user, to a loudspeaker or other component of the spatial audio system, and / or or to virtual sound sources created by the spatial audio system. For example, the interactive toy element may detect such proximity using a method as described in WO 2020 / 156719, or otherwise. A proximity-based mode of operation enables the speaker (or set of speakers) of the spatial audio system to respond once a toy construction model or interactive toy element is nearby. For instance, the system might be playing the sound of an animal running away once the user approaches another model, a speaker or a virtual sound source, while holding a toy construction model including the interactive toy element.

[0055] It will be appreciated that, in some embodiments, the spatial soundscape may be created responsive to two or more of the above triggers and / or responsive to other triggers, e.g. responsive to a detected attribute of a toy construction model and responsive to position and / or proximity and / or gestures. For example, a certain gesture may trigger different sounds depending on the type of toy construction model, the gesture is performed with.

[0056] In some embodiments, the interactive play apparatus may be configured to create one or more spatial soundscape prompts for prompting the user to perform certain activities, in particular activities involving interaction with the interactive toy element.

[0057] For example, the created sounds may function as construction prompts, i.e. the spatial soundscape might prompt the child to build a toy construction model as a response to a prompt in sound. For example, the sound of car might prompt the child to construct a car.

[0058] Alternatively or additionally, the created sounds may function as motion prompts. For example, when the spatial audio system creates sound that is perceivable as originating from a virtual sound source at a certain location in the room may trigger the user to move towards said location. The audio soundscape might tease the presence of a certain artifact by playing a sound in specific speaker or room, triggering the child to move towards that sound, e.g. as schematically illustrated by FIG. 6C.

[0059] In some embodiments, the interactive play apparatus may be configured to provide a bidirectional Integration between a handheld interactive toy element and the spatial audio system. In particular, the interactive play apparatus may be configured to enable interaction between local sounds and global sounds. The local sounds may be produced by a speaker integrated into the interactive toy element or otherwise by a mobile, e.g. hand-held or wearable, speaker. The global sounds may be generated by the one or more loudspeakers of the spatial audio system, e.g. by stationary speakers. Accordingly, the interactive play apparatus may enable hand offs where a sound might originate from a model and spread around the room, or a sound that is originally generated by the spatial audio system and that is then transferred to the interactive toy element. This enables for entertaining interactions between user actions and the spatial audio system.

[0060] In some embodiments, the interactive play apparatus may be configured to provide spatial sound positioning and / or directionality, e.g. based on a detected position and / or orientation or movement of the interactive toy element, e.g. as schematically illustrated by FIGs. 6A and 6B. FIG. 6A illustrates an example where the interactive play apparatus provides a soundscape responsive to detected movements of a handheld toy, whereas FIG. 6B illustrates an example where the interactive play apparatus provides a soundscape responsive to detected positions and / or orientations of toy models in the room, and relative to the loudspeakers of the spatial audio system.

[0061] For example, when the interactive toy element includes a mobile speaker, and when the apparatus is configured to detect a position (relative to a reference position) and / or orientation and / or movement of the interactive toy element, the apparatus may determine a vector representing the detected position, orientation and / or movement. The apparatus may thus control the spatial audio system to create a sound representing the determined vector, e.g. by creating a sound that appears to originate from a moving virtual sound source that moves along a trajectory corresponding to the determined vector, e.g. along a direction defined by the determined vector. When used in combination with the bidirectional interaction described above, the virtual sound source may e.g. start at the interactive toy element. To this end, the sound may initially be played by the mobile speaker of the interactive toy element; the playing of the sound may then be handed over to the spatial audio system, which may simulate a virtual sound source moving away from the interactive toy ele- merit along a direction defined by the determined vector, thus providing the perception of the sound being projected from the interactive play element into the room. Projecting a sound from a local object to multiple speakers in the room creates the experience of a sound that can be projected in any direction in the room. For instance, a child builds a model of a laser blaster; when standing with a model in one position of the room and aiming it towards another position, the apparatus may create a laser sound that transitions from the blaster towards the direction and location where the child is pointing the blaster to, thereby creating the illusion of an actual laser blast.

[0062] In various embodiments, the spatial audio system may be configured to operate as an extension, augmentation or supplement of a local speaker that is included in the interactive toy element. In this role, the spatial audio system performs as an aural complementation to the sound from the local speaker. In a play scenario where the child builds a toy construction model of a light saber, the child may hear an electric hiss of the saber produced by the local speaker and the corresponding echo produced by the spatial audio system.

[0063] In various embodiments, the user is provided with means to take control over the created soundscape. For example, using a combination of position and gesture tracking the apparatus may enable the user to control the soundscape using the interactive toy element as a controller. For instance, when building a magic wand, the child might be able to move the sound of a storm by pointing the magic wand to different points in the room giving the sense that the ‘storm’ is being controlled by the wand.

[0064] In various embodiments, the apparatus may create atmosphere and immersion. For example, by layering different sounds on different positions in the room in response to a model having been built by the child, the apparatus can create different atmospheres that immerse the child in the world of the model. This atmosphere can be created iteratively as the model is being built. For instance, creating a model of trees causes the soundscape to generate the sound of moving leaves, adding a model of a bird to the trees causes the soundscape to generate bird sounds, while adding water generates the sound of a river and son on. Examples of play scenarios involving an embodiment of the interactive play apparatus described herein include:

[0065] - A play scenario, in which a child has the model of a chest and a wand. When opening the chest, the child unleashes an imaginary dragon from a chest and can hear the dragon wings flapping around the room. By building a wand to cast spells, the child may cast a spell and attract the dragon to the chest. Once the dragon approaches the chest, the child may close the chest, thereby trapping the dragon inside the chest. The child can hear the trapped dragon inside the chest.

[0066] - A play scenario where a child can be building models with a soundscape attached to each one of them and place them in different places of the room (e.g. nearby spatial sound speakers). When navigating the space with another model (that acts like a vehicle) the child may hear the soundscape of the vehicle the child is holding, and in addition, the soundscape of each built model. Accordingly, the system can bring models to life creating adaptive soundscapes based on models and location.

[0067] - A play scenario where the child builds a wand model that “activates” a storm in the room. When the child moves the wand, the storm soundscape changes; when the child performs certain gestures, the child can cast the storm towards different locations within the room.

[0068] Although the invention has been described with reference to certain specific embodiments, various modifications thereof will be apparent to those skilled in art without departing from the spirit and scope of the invention as outlined in claims appended hereto.

Claims

CLAIMS1 . An interactive play apparatus comprising a spatial audio system and an interactive toy element, in particular an interactive toy construction element, wherein the interactive toy element comprises at least one sensor configured to detect one or more user interactions, and wherein the spatial audio system is configured to output a plurality of sounds perceivable by a user interacting with the interactive toy element as a spatial soundscape.

2. An interactive play apparatus according to claim 1 ; wherein the spatial audio system comprises one or more loudspeakers, in particular one or more loudspeakers different and separate from the interactive toy element.

3. An interactive play apparatus according to claim 2; wherein the interactive toy element is movable relative to the one or more speakers by the user.

4. An interactive play apparatus according to any one of the preceding claims, wherein the interactive toy element is communicatively coupled to the spatial audio system, in particular by means of a direct or indirect wireless communication link.

5. An interactive play apparatus according to any one of the preceding claims; wherein the interactive toy element is a toy construction element of a modular toy construction system, the modular toy construction system including modular toy construction elements, in particular the interactive toy construction element and further toy construction elements.

6. An interactive play apparatus according to claim 5, wherein the interactive play apparatus is configured to detect one or more attributes of a toy construction model constructed from the interactive toy element and from one or more additional toy construction elements, and wherein the spatial audio system is configured to create a perceivable spatial soundscape responsive at least to the detected one or more attributes.

7. An interactive play apparatus according to any one of the preceding claims, wherein the interactive toy element includes a loudspeaker and is configured to output sounds associated with the interactive toy element and / or associated with a toy construction model, which includes the interactive toy element, in particular sounds representing sounds emitted an object represented by the toy construction model.

8. An interactive play apparatus according to claim 7, wherein the spatial audio system is configured to create a soundscape representing an environment in which the toy construction model is immersed.

9. An interactive play apparatus according to any one of the preceding claims, configured to create a perceived movement of a virtual sound source along a trajectory relative to a detected position and / or orientation and / or movement path of the interactive toy element.

Images