Local node, extended media selection and delivery system and method for selecting extended media and causing generation of sensor stimuli

Abstract

A local node (110) and method therein for causing generation of sensor stimuli to a user in an environment of the local node (110) are disclosed. The local node (110) is configured to obtain status information of one or more Auxiliary Sensor Stimuli Generating Modules (ASSGM) (130), associated to the local node (110); send the status information of the one or more ASSGM to an Extended Media Selection and Delivery (EMSD) system (120) for selection of one or more extended media; obtain information from the EMSD system (120), on one or more extended media to be presented to the user; and cause generation of sensor stimuli to the user from the one or more ASSGM (130) based on the one or more extended media.

Description

[0001] LOCAL NODE, EXTENDED MEDIA SELECTION AND DELIVERY SYSTEM AND METHOD FOR SELECTING EXTENDED MEDIA AND CAUSING GENERATION OF SENSOR STIMULI

[0002] TECHNICAL FIELD

[0003] Embodiments herein relate to extended reality applications. In particular, they relate to a local node, an extended media selection and delivery system and methods therein for selecting extended media and causing generation of sensor stimuli to one or more users in an environment of the local node.

[0004] BACKGROUND

[0005] Virtual Reality (VR) is a term for technology that involves creating a virtual environment that a user can interact with. Today this interaction is often performed via head-mounted displays (HMDs), as they allow a user to view a 3D representation of the virtual space with real-life motions being tracked and mirrored inside the virtual reality. VR can also be represented in other senses, most commonly being spatial audio and haptic feedback within hand controllers.

[0006] Augmented Reality (AR) is a term for technology that involves combining the real world with virtual environments, enhancing or changing a user’s perception of the real world. Virtual objects are represented by using displays, speakers, haptics, or other mediums, intersecting with the physical real-world environment. An example would be a pair of glasses that has an integrated heads-up display that can show for example a virtual model of a building in a place where another building is already standing. Depending on the application, objects in the real world can influence virtual objects and vice versa.

[0007] When referring to VR and AR together, Extended Reality (XR) or Mixed Reality (MR) is often used as an umbrella term.

[0008] While visual and auditory stimuli have been at the forefront when it comes to XR development, affecting other senses is seen as a key element to improve further immersion in XR space. Using olfactory stimuli or scents to enhance audio-visual experiences has been attempted for a long time. The solutions available today are commonly adapted to fit conventional VR HMDs. Scents can be used to create an ambient olfactory landscape such as a grassy vista, an oily car shop or a pier by the salty ocean, or to smell specific virtual objects that a user is holding such as a rose or piece of chocolate. Users who engage with XR with an olfactory component congruent to their virtual environment report a higher level of immersion and satisfaction, even when the fragrances are light enough not to be consciously noticed.

[0009] Delivering personalized ads maximizes value for both people and businesses. It helps businesses reach customers affordably, grow and create jobs, and provides people a better experience. Some social networking websites and search engines e.g. Facebook, Google have studied how to select ads for delivery to a specific user. However, selection and delivery of ads to users of XR devices are not considered in the existing ads selection mechanism. Further enhancing selection and delivery of relevant ads or any extended media to users of XR devices will open avenues for more cognitive immersion related to XR products and for an even more immersive user experience.

[0010] SUMMARY

[0011] Therefore, it is an object of embodiments herein to provide an improved system that enhances selection and delivery of relevant ads or any extended media to one or more users and causing generation of sensor stimuli to one or more users for an even more immersive user experience.

[0012] According to one aspect of embodiments herein, the object is achieved by a local node and method therein for causing generation of sensor stimuli to a user in an environment of the local node. The local node is configured to obtain status information of one or more Auxiliary Sensor Stimuli Generating Modules (ASSGM) associated with the local node, e.g. residing at the local node or an equipment operatively connected to the local node. The local node is further configured to send the status information of the ASSGM to an Extended Media Selection and Delivery (EMSD) system for selection of one or more extended media. The local node is further configured to obtain information from the EMSD system, on one or more extended media to be presented to the user. The local node is further configured to cause generation of sensor stimuli to the user from the one or more ASSGM based on the one or more extended media.

[0013] According to one aspect of embodiments herein, the object is achieved by an Extended media Selection and Delivery (EMSD) System and method therein for selecting one or more extended media for a local node. The EMSD system is configured to obtain from the local node, status information of one or more Auxiliary Sensor Stimuli Generating Modules (ASSGM) residing at the local node or an equipment operatively connected to the local node. The EMSD system is further configured to select one or more extended media to be presented to the local node based on the status information of the ASSGM and send to the local node, information on the one or more extended media.

[0014] According to some embodiments herein, the extended media may comprise content intended for stimuli of any one or a combination of a somatosensory system, an olfactory system, and a gustatory system of the user.

[0015] According to some embodiments herein, the extended media may comprise any one or a combination of advertisement, music streaming, data streaming, audio streaming, video, film or movie, soundtrack, still picture, gaming contents, educational contents, public information etc.

[0016] According to some embodiments herein, the local node may be any one of an Extended Reality (XR) device, a communication device, an electronic equipment etc.

[0017] The solutions according to embodiments herein provide a new way to enhance selection and delivery of extended media, e.g. ads, to users based on status information of one or more ASSGMs, e.g. a scent system, associated with the user’s device, e.g. XR / MR / VR / AR device. The status information of ASSGMs may be e.g. availability of fragrance components in the scent system etc. In other words, the solutions according to embodiments herein allows for ads to be selected based on scent availability so as to further enhance said ads.

[0018] Some advantages of the embodiments herein include but are not limited to:

[0019] Enabling selection and delivery of extended media to users associated to one or more local nodes, e.g. XR / MR / VR / AR devices etc, based on status information of the Auxiliary Sensor Stimuli Generating Modules associated with the XR / MR / VR / AR devices.

[0020] Enabling selection and delivery of sensor stimuli associated to the relevant extended media, e.g. ads.

[0021] Providing a more immersive and targeted ads experience for users associated to one or more local nodes, e.g. XR / MR / VR / AR devices etc.

[0022] Opening avenues for more XR / MR / VR / AR products with more cognitive immersion.

[0023] Allowing for a fuller user experience and more users adopting XR / MR / VR / AR technology.

[0024] Therefore, embodiments herein provide an improved system that enhances selection and delivery of relevant ads or any extended media to one or more users and causing generation of sensor stimuli to one or more users for an even more immersive user experience.

[0025] BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Examples of embodiments herein are described in more detail with reference to attached drawings in which:

[0027] Figure 1 is a block diagram showing a communication system in which embodiments herein may be implemented;

[0028] Figure 2 is a schematic drawing showing an example of XR device with scent system according to prior art;

[0029] Figure 3 is a flow chart illustrating a method performed in a local node according to embodiments herein;

[0030] Figure 4 is a flow chart illustrating a method performed in an extended media selection and delivery system according to embodiments herein; and

[0031] Figure 5 is a flow chart illustrating an example procedure for XR device according to embodiments herein.

[0032] DETAILED DESCRIPTION

[0033] The proposed solution comprises a local node including one or more Auxiliary Sensor Stimuli Generating Modules (ASSGM) e.g. scent delivery system, and an Extended Media Selection and Delivery (EMSD) system using knowledge from the ASSGM to further enhance selection of extended media, e.g. ads, to be displayed to one or more users associated with the local node and causing generation of sensor stimuli to one or more users for an even more immersive and realistic experience.

[0034] Figure 1 shows an example of a communication system 100 in which embodiments herein may be implemented. The communication system 100 comprises a local node 110 associated with a user. The communication system 100 further comprises an Extended Media Selection and Delivery (EMSD) system 120. The EMSD system 120 may be server or cloud based which storing extended media subscriptions information of users to applications, services, extended media etc. One or more Auxiliary Sensor Stimuli Generating Modules (ASSGM) 130 are associated with the local node 110. For example, the ASSGM 130 may reside at the local node 110 or attached to the local node 110. The ASSGM 130 may also reside at an equipment operatively connected or coupled to the local node 110 or attached to an equipment operatively connected or coupled to the local node 110. The local node 110 may be an XR device 110 associated with a user 111 as shown in the figure and the ASSGM 130 may be a scent system 130 attached to the XR device 110. The term XR used herein is an umbrella term that covers MR, VR, AR. The terms “XR” and “XR / AR / VR / MR” may be used interchangeably herein. The local node 110 may also be XR / AR / VR / MR glasses, or a communication device or an electronic equipment with XR capability. The communication system 100 further comprises a network node 140. The network node 140 is a network access node which may be a base station (BS), for example, an eNB, gNB, eNodeB, gNodeB, or a Home NodeB, or a Home eNodeB or a Home gNodeB in a wireless communication network. The wireless communication network may be any wireless system or cellular network, such as a second generation (2G) Global System for Mobile Communications (GSM), a third generation (3G) telecommunication network e.g. Universal Mobile Telecommunications System (UMTS), a Fourth Generation (4G) network, e.g. Evolved Packet System (EPS) or Long Term Evolution (LTE) network, a Fifth Generation (5G) New Radio (NR) network, or Wimax network, Wireless Local Area Network (WLAN) or Wi-Fi network etc. The local node 110 may communicate with the network node 140 and EMSD system 120 to receive and transmit information.

[0035] According to embodiments herein, the local node 110 can cause generation of sensor stimuli to a user associated to the local node 110 or in an environment of the local node 110. The sensor stimuli may comprise any one or a combination of scent, taste, tactile, heat, cold, acceleration, air movement, motion, haptics, light, polarized light, infrared light, sounds, air moisture, electric fields, magnetic fields etc.

[0036] The local node 110 is configured to obtain status information of one or more ASSGMs 130 associated with the local node 110. The status information of one or more ASSGMs 130 may comprise any one or a combination of the following:

[0037] • information on whether the ASSGM is connected;

[0038] • information on whether the ASSGM is active;

[0039] • a type of the ASSGM;

[0040] • a brand and version of the ASSGM;

[0041] • whether a subscription to one or more applications and I or services is available with the ASSGM;

[0042] • available fragrance / scent components in a scent system, timing and delay from start to olfactory perception, amount of fragrance left per scent component, time to change scent, time to disperse / remove scent;

[0043] • Nearby ASSGM and capability that could be used. The local node 110 is further configured to send the status information of the ASSGM 130 to the EMSD system 120 for selection of one or more extended media. The extended media may comprise content intended for stimuli of any one or a combination of a somatosensory system, an olfactory system, and a gustatory system of the user 111. The somatosensory system is the network of neural structures in the brain and body that produce the perception of touch e.g. haptic perception, as well as temperature i.e. thermoception, body position, i.e. proprioception, and pain. The olfactory system or sense of smell is the sensory system used for smelling or olfactory. The gustatory system or sense of taste is the sensory system that is partially responsible for the perception of taste or flavor.

[0044] According to some embodiments herein, the extended media may comprise any one or a combination of advertisements, music streaming, data streaming, audio streaming, video, film or movie, soundtrack, still picture, gaming contents, educational contents, public information etc.

[0045] The local node 110 is further configured to obtain information from the EMSD system 120, on one or more extended media to be presented to the user. The one or more extended media are selected based on the status information of the ASSGM 130.

[0046] The local node 110 is further configured to cause generation of sensor stimuli to the user from the one or more ASSGM 130 based on the one or more extended media.

[0047] The local node 110 may be configured to cause generation of sensor stimuli by obtaining one or more control signals for turning on or off the generating of the corresponding sensor stimuli or adjusting the intensity of the corresponding sensor stimuli.

[0048] The communication system 100 shown in Figure 1 is just one example where the local node 110 is represented by an XR device 110 shown as head mounted unit such as head mounted display (HMD) with a scent system 130. Figure 2 shows an example XR device 200 as XR glasses with a scent generator 201 , one or more scent guides 202, 203, and one or more scent guide outlets 204, 205. The scent guides 202, 203 are typically not visible and usually integrated or embedded, layered in the glasses’ construction. The arrow 206 shows the direction of scent particles flowing. The scent generator 201 generates scent particles that are pushed via one or more channels, e.g. the dual scent guide 202, 203, to the XR glasses 200 for release to the user's sides of the head at the scent guide outlets 204, as well as the user’s nose in the front at the scent guide outlets The XR device 110 / 200 can simulate some sort of virtual reality. For example, when the user of XR device 110 / 200 encounters an object, environment or situation in the virtual reality that prompts a scent to be released, the XR device 110 / 200 sends signals to the scent system / generator 130 / 201 to begin dispensing scent(s). The XR device 110 / 200 can also control the valves related to the scent outlet to choose where the scent will be released. When the EMSD system 120 selects one or more extended media to be presented to the user, e.g. an ads selection and delivery system selects and displays an ad in said XR device 110 / 200, it can also release scents related to said ad.

[0049] In the following, as an example, a method performed in the local node 110, e.g. the XR device 110 / 200 with the scent delivery system 130 or scent generator 201 , for causing generation of sensor stimuli to one or more users for more immersive and realistic experience will be described in detail with reference to Figure 3. The method comprises the following actions which may be performed in any suitable order.

[0050] Action 310

[0051] When the local node 110 starts, i.e. the XR device 110, 200 and the scent delivery system or scent generator 130 / 201 starts, the local node 110 obtains status information of one or more ASSGM 230 associated to the local node 110. That is the XR device 110, 200 obtains status information of the scent delivery system or scent generator 130 / 201 , for examples, configuration information of the scent delivery system or scent generator 130 / 201, such as:

[0052] • Type of scent device / system / generator,

[0053] • Available scent components, e.g., scents like rubber, chocolate, etc.

[0054] • Brand and version of scent device / system / generator;

[0055] • Amount(s) of scent fragrance left per scent component;

[0056] • Scent release timing, delay from start to olfactory perception, time to change scent, time to disperse / remove scent;

[0057] • Nearby scent device / system / generator and capability that can be used by the XR device 110 / 200 including related fragrance components and amount(s) left etc.

[0058] Action 320

[0059] The local node 110 sends the status information of the ASSGM 130 to the EMSD system 120 for selection of one or more extended media. For example, the XR device 110 / 200 shares scent system configuration and related scent component information with an ads system at start and when a change to the scent system and or its related scent components occurs. The XR device 110 / 200 may periodically check if the configuration of the scent system / generator 130 / 201 and the scent components are modified and sends the information to the ads system. The ads system may also poll the status information from the XR device 110 / 200 instead of waiting for said information to be pushed to the ads system. This means that the ads system will have updated information that it can act on when a new ad is to be selected and prioritized for display by the XR device 110 / 200.

[0060] Action 330

[0061] The local node 110 obtains information from the EMSD system 120, on one or more extended media to be presented to the user 111. For example, the XR device 110 / 200 obtains information on an ad to be displayed to the user 111. The ads system uses information received about the XR device 110 / 200 and its scent system 130 and related scent components to select and prioritize one or more relevant ad for the XR device 110 / 200 to display.

[0062] Action 340

[0063] The local node 110 causes generation of sensor stimuli to the user from the one or more ASSGM 130 based on the one or more extended media. For example, the XR device 110 / 200 displays one or more ads selected and prioritized by the ads system based on XR device scent system and related scent components, and causes generation of sensor stimuli relevant, related or corresponding to the ads to the user.

[0064] According to some embodiments herein, the local node 110 may be configured to cause generation of sensor stimuli by obtaining one or more control signals for turning on or off the generating of the corresponding sensor stimuli or adjusting the intensity of the corresponding sensor stimuli. For example, the XR device 110 / 200 may generate one or more control signals based on the information on the selected one or more ads to control its scent system 130 / 201 to release one or more scents related to the one or more ads or adjust the intensity of the one or more scents related to the one or more ads.

[0065] According to some embodiments herein, the one or more extended media e.g. ads, may be collaboratively selected or prioritized based on availability of the scent system and scent components in two or more XR devices being nearby. For example, two people watching a movie in a sofa or sharing a communication session, e.g., two people in a Teams chat, or video, orXR session, so as to have a shared ad selected or prioritized based on availability of scent system and scents in all involved users XR devices. Then the method may further comprise the following actions.

[0066] Action 312 The local node 110 may detect an activity or a location of a user of the XR device 110 / 200 and send information on the activity or location of the user to the EMSD system 120 for selecting one or more extended media.

[0067] For example, the XR device 110 / 200 may generate a control signal based on a location of the user of the XR device 110 / 200 and available scent components in the scent system 130 / 201 for causing the scent system 130 / 201 to generate a permeating scent in a specific area that is available to other non-users of the XR device 110 / 200. This may, for example, be that any scent device or system that passes by a certain shop releases a floral fragrance associated with a selected ad, if the scent device or system is capable of the desired floral scent, making other people who pass by the shop smell that scent as well to improve experience of other people.

[0068] For example, ads may be selected or prioritized based on availability of scent system and I or scent components, the activity of the user and how the scent system and scent components relate to object(s) associated to the user. For example, a user is having wine A which is detected and recognized by the XR device 110 / 200 by e.g. camera sensor(s), and based on the information on the scent system and scent component availability e.g., a specific dark chocolate ad that would go well with wine A may be selected and displayed to the user and chocolate scent will be released to the user by the scent system.

[0069] Action 314

[0070] The local node 110 may obtain information on one or more other scent systems nearby to generate a control signal for causing the scent system to generate a scent towards other user than a user of the XR device 110 / 200.

[0071] For example, ads may be collaboratively selected or prioritized based on availability of scent system and scent components in two or more XR devices being nearby. For example, two people watching a movie in a sofa or sharing a communication session e.g., two people in a Teams chat, or video / XR session, then a shared ad may be selected or prioritized based on availability of scent system and scent components in all involved users XR devices.

[0072] For example, ads may be collaboratively selected or prioritized based on availability of scent systems and scent components in two or more XR devices and if ads system decides to select or prioritize an ad that not all involved users can get related scent component(s) for, that user or those users may be informed about said lack of scent and having a less immersive experience. For example, the scent device of a user can release scents for ads targeted for another user, i.e. towards that other user. This is performed separately from the scent device user’s experience, allowing an ad with scent to be made for another user without affecting the scent experience of the first user. This can be combined with knowledge of the other user’s scent device’s scent availability, should they have one available.

[0073] The method for more immersive and realistic ads experience may apply to various scenarios and applications. In the following some examples are briefly described.

[0074] According to some embodiments herein, the local node 110 may be a communication device in a car, the ASSGM 130 may be a heating system in one or more chairs in the car. When the user buys the car, the heating system in one or more chairs in the car is auxiliary functionality and may not be actuated due to economic reasons. When the communication device in the car obtains status information about this auxiliary functionality provided by the heating system, the communication device may generate a control signal for turning on the heating system based on the status information about auxiliary functionality provided by the ASSGM 130.

[0075] According to some embodiments herein, the local node 110 may be a communication device in a home, and the ASSGM 130 may be one or more home electronics in the home. The communication device may receive one or more extended media to be presented from the EMSD 120 selected based on the status information about auxiliary functionality provided by the one or more home electronics. For example, if a home has a speaker setup connected to the communication device, the choice of extended media may focus on audio-only content.

[0076] In the following, as an example, a method performed in an Extended media Selection and Delivery (EMSD) System 120 for selecting one or more extended media for the local node 110 for more immersive and realistic user experience will be described in detail with reference to Figure 4. The method comprises the following actions which may be performed in any suitable order.

[0077] Action 410

[0078] The EMSD system 120 obtains from the local node 110, status information of one or more Auxiliary Sensor Stimuli Generating Modules (ASSGM) 130 associated to the local node 110, e.g. residing at the local node 110 or an equipment operatively connected to the local node 110. The status information of one or more ASSGM 130 may comprise any one or a combination of the following: • information on whether the ASSGM is connected;

[0079] • information on whether the ASSGM is active;

[0080] • a type of the ASSGM;

[0081] • a brand and version of the ASSGM;

[0082] • whether a subscription to one or more applications or services is available with the ASSGM;

[0083] • available fragrance / scent components in a scent system, timing and delay from start to olfactory perception, amount of fragrance left per scent component, time to change scent, time to disperse / remove scent;

[0084] • Nearby ASSGM and capability that could be used.

[0085] Action 420

[0086] The EMSD system 120 selects one or more extended media to be presented to the local node 110 based on the status information of the one or more ASSGM 130. The extended media may comprise any one or a combination of advertisement, music streaming, data streaming, audio streaming, video, film or movie, soundtrack, still picture, gaming contents, educational contents, public information etc.

[0087] Some examples on how to select one or more extended media based on the status information of the one or more ASSGM 130 are described in previous sections. For example, one or more extended media, e.g. ads, may be selected or prioritized based on availability of scent system and I or scent components, the activity of the user and how the scent system and scent components relate to object(s) associated to the user.

[0088] Action 430

[0089] The EMSD system 120 sends to the local node 110, information on the one or more extended media.

[0090] According to some embodiments herein, the extended media may be selected and presented to the local node 110 based on the activity and / or location of the user of the local node 110, the method may further comprise the following actions.

[0091] Action 412

[0092] The EMSD system 120 may obtain information on an activity and / or a location of a user of the local node 110 to select one or more extended media to be presented to the local node 110 based on the activity and / or location of the user of the local node 110.

[0093] Action 414

[0094] The EMSD system 120 may obtain status information of one or more ASSGMs 130 associated with two or more local nodes to select one or more extended media to be presented to the two or more local nodes based on the status information of the one or more ASSGMs associated with two or more local nodes.

[0095] The methods for enhance immersive and realistic experience for a user according to embodiments herein may be applied to any XR devices having associated scent system, such as HMDs, XR / AR / VR / MR glasses, mobile devices or handheld XR device controllers etc. The mobile devices may be any kind of smart watches, bracelets, headsets etc.

[0096] Figure 5 is an example procedure flow chart showing how an XR device displays an ad selected and prioritized by an ads system based on status information on scent system associated to the XR device and related scent components. The ads system will use the scent system status information to further improve selection and prioritization of ads to be displayed by the XR device.

[0097] Scent system status information that can be shared by the XR device and ads system is for example (not limited to):

[0098] Scent system brand and version.

[0099] Scent release fragrance components, e.g., scents like rubber, chocolate, etc.

[0100] Scent release fragrance amount(s) left per scent component.

[0101] Scent release timing, delay from start to olfactory perception, time to change scent, time to disperse / remove scent.

[0102] Nearby scent system and capability that may be used by the XR device including related fragrance components and amount(s) left.

[0103] The procedure flow chart comprises the following actions.

[0104] Action 501

[0105] The XR device and associated scent system started.

[0106] Action 502

[0107] The XR device shares scent system status information, such as type of scent system, scent components available etc. with the ads system.

[0108] The XR device may share the scent system status information with the ads system at start and when a change to the scent system or its related scent components occurs so the ads system will have updated information that it can act on when a new ad is to be selected and prioritized for display by the XR device.

[0109] Action 503 The ads system uses status information gathered about the XR device and associated scent system and related scent components to select and prioritize one or more relevant ads for the XR device.

[0110] Action 504

[0111] The XR device displays the one or more ads selected by the ads system and uses the associated scent system to release one or more scents related to the one or more ads.

[0112] To summarize, embodiments herein provide a new way to enhance selection and delivery of extended media, e.g. ads, to users based on status information of one or more Auxiliary Sensor Stimuli Generating Modules (ASSGMs), e.g. scent system / device / generator, associated with the user’s device, e.g. XR / MR / VR / AR device. The status information of one or more ASSGMs may be e.g. availability of fragrance components in the scent system / device / generator etc. In other words, the solutions according to embodiments herein allows for extended media, e.g. ads, to be selected and causing generation of sensor stimuli to one or more users based on ASSGMs availability so as to further enhance said extended media / ads.

[0113] Some advantages of the embodiments herein include but not limited to:

[0114] Enabling selection and delivery of extended media to one or more users associated to one or more local nodes, e.g. XR / MR / VR / AR devices etc, based on status information of the Auxiliary Sensor Stimuli Generating Modules associated with the XR / MR / VR / AR devices.

[0115] Enabling selection and delivery of sensor stimuli associated to the relevant extended media, e.g. ads.

[0116] Providing a more immersive and targeted ads experience for one or more users associated to one or more local nodes, e.g. XR / MR / VR / AR devices.

[0117] Opening avenues for more XR / MR / VR / AR products with more cognitive immersion.

[0118] Allowing for a fuller user experience and more users adopting XR / MR / VR / AR technology.

[0119] When using the word "comprise" or “comprising” it shall be interpreted as nonlimiting, i.e. meaning "consist at least of".

[0120] The embodiments herein are not limited to the above described preferred embodiments. Various alternatives, modifications and equivalents may be used. Therefore, the above embodiments should not be taken as limiting the scope of the invention, which is defined by the appended claims.

Claims

CLAIMS1. A local node (110) for causing generation of sensor stimuli to a user in an environment of the local node (110), the local node (110) is configured to: obtain status information of one or more Auxiliary Sensor Stimuli Generating Modules, ASSGM (130), associated to the local node (110); send the status information of the one or more ASSGM to an Extended Media Selection and Delivery, EMSD, system (120) for selection of one or more extended media; obtain information from the EMSD system (120), on one or more extended media to be presented to the user; cause generation of sensor stimuli to the user from the one or more ASSGM (130) based on the one or more extended media.

2. The local node (110) according to claim 1, wherein the extended media comprises content intended for stimuli of any one or a combination of a somatosensory system, an olfactory system, and a gustatory system of the user.

3. The local node (110) according to any one of claims 1-2, wherein the extended media comprises any one or a combination of advertisement, music streaming, data streaming, audio streaming, video, film or movie, soundtrack, still picture, gaming contents, educational contents, public information.

4. The local node (110) according to any one of claims 1-3, wherein the local node is any one of an Extended Reality, XR, device, XR / AR / VR / MR glasses, a communication device, an electronic equipment.

5. The local node (110) according to any one of claims 1-4, wherein the sensor stimuli comprise any one or a combination of scent, taste, tactile, heat, cold, acceleration, motion, air movement, haptics, light, polarized light, infrared light, sounds, air moisture, electric fields, magnetic fields.

6. The local node (110) according to any one of claims 1-5, wherein the local node is configured to cause generation of sensor stimuli by obtaining one or more control signals for turning on or off the generating of the corresponding sensor stimuli or adjusting the intensity of the corresponding sensor stimuli.

7. The local node (110) according to any one of claims 1-6, wherein the status information of the ASSGM comprises any one or a combination of the following: information on whether the ASSGM is connected; information on whether the ASSGM is active; a type of the ASSGM; a brand and version of the ASSGM; whether a subscription to one or more applications is available with the ASSGM.

8. The local node (110) according to any one of claims 1-7, wherein the local node is an XR device and the ASSGM is a scent device.

9. The local node (110) according to claim 8, wherein the local node is further configured to detect an activity or a location of a user of the XR device.

10. The local node (110) according to any one of claims 8-9, wherein the local node is further configured to obtain information on one or more other scent devices nearby.

11. The local node (110) according to any one of claims 8-10, wherein the local node is further configured to generate a control signal for causing the scent device to generate a scent towards other user than a user of the XR device.

12. The local node (110) according to any one of claims 8-11, wherein the local node is further configured to generate a control signal based on a location of a user of the XR device and available scent components in the scent device for causing the scent device to generate a permeating scent in a specific area that is available to other non-users of the XR device.

13. The local node (110) according to any one of claims 1-7, wherein the local node is a communication device in a car, the ASSGM is a heating system in one or more chairs in the car, and wherein the local node is configured to generate a control signal for turning on the heating system based on the status information about auxiliary functionality provided by the ASSGM.

14. The local node (110) according to any one of claims 1-7, wherein the local node is a communication device in a home, and the ASSGM is one or more homeelectronics in the home, and wherein the communication device is configured to receive one or more extended media to be presented from the EMSD selected based on the status information about auxiliary functionality provided by the one or more home electronics.

15. An Extended media Selection and Delivery, EMSD, system (120) for selecting one or more extended media for a local node (110), the EMSD system (120) is configured to: obtain from the local node (110), status information of one or more Auxiliary Sensor Stimuli Generating Modules, ASSGM (130), associated to the local node (110); select one or more extended media to be presented to the local node (110) based on the status information of the one or more ASSGM (130); and send to the local node (110), information on the one or more extended media.

16. The EMSD system (120) according to claim 15, wherein the extended media comprises any one or a combination of advertisement, music streaming, data streaming, audio streaming, video, film or movie, soundtrack, still picture, gaming contents, educational contents, public information.

17. The EMSD system (120) according to any one of claims 15-16, wherein the EMSD system (120) is further configured to: obtain information on an activity and / or a location of a user of the local node (110) to select one or more extended media to be presented to the local node (110) based on the activity and / or location of the user of the local node (110).

18. The EMSD system (120) according to any one of claims 15-17, wherein the EMSD system (120) is further configured to: obtain status information of one or more ASSGM (130) associated with two or more local nodes (110) to select one or more extended media to be presented to the two or more local nodes (110) based on the status information of the one or more ASSGM (130) associated with the two or more local nodes (110).

19. A method performed in a local node (110) for causing generating of sensor stimuli to a user in an environment of the local node (110), the method comprising: obtaining (310) status information of one or more Auxiliary Sensor Stimuli Generating Modules, ASSGM (130), associated to the local node (110); sending (320) the status information of the one or more ASSGM to an Extended Media Selection and Delivery, EMSD, system (120) for selection of one or more extended media; obtaining (330) information from the EMSD system (120), on one or more extended media to be presented to the user; causing (340) generation of sensor stimuli to the user from the one or more ASSGM (130) based on the one or more extended media.

20. The method according to claim 19, further comprising: detecting (312) an activity or a location of a user of the XR device.

21. The method according to any one of claims 19-20, further comprising: obtaining (314) information on one or more other scent devices nearby.

22. A method performed in an Extended media Selection and Delivery, EMSD, System (120) for selecting one or more extended media for a local node (110), the method comprising: obtaining (410) from the local node (110), status information of one or more Auxiliary Sensor Stimuli Generating Modules, ASSGM (130), associated with the local node (110); selecting (420) one or more extended media to be presented to the local node based on the status information of the one or more ASSGM; and sending (430) to the local node, information on the one or more extended media.

23. The method according to claim 22, further comprising: obtaining (412) information on an activity and / or a location of a user of the local node 110 for selecting one or more extended media to be presented to the local node 110 based on the activity and / or location of the user of the local node 110.

24. The method according to claim 22, further comprising: obtaining (414) status information of one or more ASSGMs (130) associated with two or more local nodes (110) for selecting one or more extended media to be presented to the two or more local nodes based on the status information of the one or more ASSGMs associated with two or more local nodes.

Images