Computer-implemented method, device, and system for generating an experience to a user

Abstract

The disclosure concerns to a method, device, and system for generating an experience to a user. The method comprises several steps. In a first step (110), at least one condition and / or event using one or more event devices (1) is detected, wherein the condition and / or event is based on contextual condition data. Followed by determining (120), using an orchestration logic (11), at least one content component as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event. Further, a plurality of candidate content components based on one or more priority rules is prioritized (130); and a prioritized candidate component, which has been selected from the plurality of candidate content components, to at least one experience device (3) is outputted (140), wherein the experience device (3) is configured to generate as the at least one experience an audio and / or visual output.

Description

[0001] holoride technologies Europe GmbH 1 93970

[0002] DESCRIPTION

[0003] Computer-implemented method, device, and system for generating an experience to a user

[0004] The disclosure relates to a computer-implemented method, a device, and a system for generating an experience to a user.

[0005] From the prior art it is known that audio and visual experiences are typically prerecorded and static in nature. Example systems play back content irrespective of the user’s situation, the motion of a vehicle, or other environmental or contextual factors. Known navigation and travel guide systems, for example, deliver sequential information about points of interest along a route, but they do not alter their behavior in response to dynamically detected events such as acceleration, braking, turning, and / or changes in user location or state. Interactive experiences such as mobile games or augmented-reality tours also exist, in which users point a device towards a visual target to trigger information retrieval, yet these systems do not synchronize their content parameters with real-time measurements of motion or other sensed conditions.

[0006] It is also known to use sensor-equipped portable devices and vehicle-based telemetry systems for collecting motion or environmental data. However, conventional implementations merely log such measurements or use them for navigation functions. They do not integrate sensor data into a unified orchestration framework capable of controlling the structure, timing, or content parameters of an audio or visual narrative. As a result, the perceived experience remains largely disconnected from the actual physical context in which the user or the platform is located.

[0007] A further drawback of existing approaches lies in the lack of an integrated orchestration mechanism that evaluates entry conditions and priority relationshipsholoride technologies Europe GmbH 2 93970

[0008] among multiple candidate content components. Known content-selection logics may define condition triggers, but they are not designed to operate on a real-time event stream produced by multiple distributed event-sensing devices. Consequently, the runtime experience cannot evolve educated, guided, and / or focused given the input events in accordance with actual conditions. In a vehicle context, such systems fail to adjust output parameters such as audio level, panning, or spatial rendering in correspondence with the vehicle’s motion or driving situation. The result is either an unresponsive or cognitively distracting output that requires manual user intervention.

[0009] The disclosure therefore addresses the technical problem of providing a method, device, and system that generate runtime experiences whose parameters and content are automatically and deterministically adapted based on measured contextual conditions, thereby enabling a motion-synchronized and condition-aware presentation on one or more output devices. In embodiments where Al or machinelearning models contribute to content generation, the deterministic orchestration logic provides predictable, rule-based guardrails that constrain the otherwise probabilistic model outputs. This can ensure reproducible behavior, improved contextual relevance, and technical stability of the experience generation.

[0010] The objective is to couple sensor-derived event information with the orchestration of content components through rule-based candidate formation and priority resolution, to ensure that the most contextually relevant elements are presented to the user at the appropriate time without requiring user interaction.

[0011] This object is achieved by the subject-matter of the independent claims.

[0012] Advantageous embodiments and refinements are subject to dependent claims. The present disclosure is not restricted to the currently claimed subject-matter. Rather, this disclosure may also cover currently unclaimed subject-matter which, however, could provide improvements and / or be made subject to the claims as will be readily appreciated by the skilled reader.

[0013] One aspect of the disclosure relates to a computer-implemented method. The method comprises several method steps. The processing order of the method steps can be adapted, if technically possible.holoride technologies Europe GmbH 3 93970

[0014] The computer-implemented method for generating at least one experience to at least one user provides a computer-implemented process for adaptive, event-aware generation of sensory output. The term experience can denote a computer-generated audio and / or visual output configured to convey a sensory impression to a human user in response to computationally evaluated contextual inputs. In the context of the disclosure, an experience can comprise dynamically modulated elements such as sound, imagery, or mixed-reality cues, whose generation is technically controlled through measured parameters and system states. The technical effect of this feature is that the computer system transforms raw contextual data into synchronized sensory content, thereby linking measured system states to the control of audiovisual output and establishing a direct causal relationship between sensor input and signal generation.

[0015] The step of detecting at least one condition and / or event using one or more event devices establishes the foundation for adaptive content control. A condition can be defined as a computationally derived contextual state of a system or environment, such as the motion and / or location of a platform, the ambient weather, the position / location of a user, or the operational state of a connected apparatus. An event can be defined as a discrete or transient occurrence identifiable through measurement or computation, representing a change in the contextual state, such as acceleration, deceleration, a change in environmental brightness, or user interaction through a device. Both conditions and events are derived (based of) from contextual condition data, which can comprise data related to motion, location, environmental state, user interaction, time, navigation, company data (e.g. databases provided by commercial partners) or user profile information, individually or in combination. Such contextual condition data can form the basis for detecting situational patterns that influence how content is generated, selected, or orchestrated. The technical effect of this detection step is that the system creates a measurable, objective representation of the external context that allows educated, sensor-based adaptation of output parameters, reducing latency and enhancing runtime synchronization between physical context and digital experience.holoride technologies Europe GmbH 4 93970

[0016] The step of determining, using an orchestration logic, at least one content component as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event, provides the computational selection mechanism for content activation. The orchestration logic can be defined as a machine-executable control layer that manages the conditional activation and sequencing of content components by evaluating predefined relationships between detected events and associated entry conditions. The entry conditions can denote a structured set of logical, numerical, or semantic thresholds that must be satisfied for a content component to become eligible for presentation. The technical effect of this step lies in the deterministic and / or controlled linkage between sensed system states and content activation, enabling real-time and condition-specific selection of output content without user intervention.

[0017] The step of prioritizing a plurality of candidate content components based on one or more priority rules ensures that when multiple components satisfy their respective entry conditions, the system can identify which content is most contextually relevant. This prioritization can be based on probability, temporal relevance, spatial proximity, or user profile correlation. The technical effect is a reduction in computational ambiguity and the prevention of concurrent or conflicting content activations, thereby optimizing both processing efficiency and perceptual coherence of the experience.

[0018] The step of outputting a prioritized candidate component, which has been selected from the plurality of candidate content components to at least one experience device, wherein the experience device is configured to generate as the at least one experience an audio and / or visual output includes the finalization of the adaptive presentation. Alternatively, wherein the experience device is configured to generate to at least on experience a combined audiovisual format, or immersive formats including augmented reality, virtual reality, mixed reality, or extended reality.

[0019] The outputting step can include the technical step of selecting the prioritized candidate component from the plurality of candidates, encoding or streaming the selected component, and transmitting it to an experience device configured to render the output as an audio or visual signal. A synchronized and adaptive audio-visualholoride technologies Europe GmbH 5 93970

[0020] presentation can be provided that reflects real-time sensor conditions and events, improving user perception alignment and enabling a continuous and contextually reactive experience.

[0021] The method and the device and system described below enable seamless synchronization between the physical environment and the digital presentation of content. It can be continuous adaptation of audio-visual output to real-world events achieved and contextual conditions derived from sensor measurements, environmental data, and / or user interaction. The orchestration logic processes these inputs to determine and prioritize content components according to their situational relevance, so that the experience evolves dynamically with motion, position, or other contextual parameters. This results in a technically improved data-processing chain that minimizes latency between event detection and sensory output, enhances temporal and spatial coherence of the presented content, and maintains a consistent user experience without requiring manual intervention. The automated orchestration of sensory output reduces cognitive load and supports safe and uninterrupted interaction, particularly in moving or variable environments such as vehicles. The described functionality applies to any type of moving platform, including but not limited to private or public vehicles such as cars, buses, trains, trams, aircraft, boats, or emergency and business transport systems, since all such platforms can provide the contextual motion and environmental data required for adaptive and synchronized experience generation. The described functionality applies also to pedestrians or other entities that can provide the contextual motion and environmental data. By merging real-time sensing, rule-based orchestration, and adaptive rendering, the disclosure provides a technically verifiable method for generating experiences that are both contextually aware and computationally efficient, achieving controlled responsiveness and stable output quality across different devices and platforms.

[0022] It can be provided that the contextual condition data comprise motion data including at least one of velocity, acceleration, deceleration, turning maneuvers, lane changes, driving patterns, walking, or moving patterns. The inclusion of motion data enables the orchestration logic to adapt the experience dynamically to the real-time movement of the user, platform or vehicle. It can ensure that the audio and visualholoride technologies Europe GmbH 6 93970

[0023] output evolves consistently with the detected motion. This function achieves precise temporal synchronization between physical dynamics and sensory output, thereby improving realism and spatial awareness within the generated experience. Through the evaluation of motion parameters such as speed and acceleration, the system can adjust playback timing, modify spatial sound distribution, or alter narrative pacing according to moving behavior. This produces a technically enhanced correlation between sensory rendering and mechanical motion of the platform, improving user orientation and reducing motion-related perceptual inconsistencies.

[0024] It can be provided that the contextual condition data comprise location data including at least one of global positioning data, relative position data, orientation, route or navigation data, or road signs or proximity to a point of interest. Further, it can include proximity to a neighborhood, or proximity to a type of street. The presence of location-based contextual data allows the system to associate experiences with specific geographic references. This results in a spatially contextualized presentation where content components correspond to real-world places or routes. The orchestration logic can thus trigger new components when the vehicle approaches a relevant location. Thus, a continuous adaptation of the experience to geographical transitions can be provided. The technical effect achieved is a reduction in informational latency between detected position changes and corresponding experience updates, leading to coherent geographical mapping of digital content.

[0025] It can be provided that the contextual condition data comprise environmental data including at least one of weather conditions, daylight or time-of-day information, traffic data, or pollution levels, or historical data. Historical data can denote background information associated with locations, objects, or events, including for example the construction date, architectural history, cultural relevance, or past occurrences related to a point of interest such as a monument or building. By integrating environmental data, the system adjusts the mood, tone, or thematic composition of the experience according to real-world external conditions. The orchestration logic processes these data to modify the presentation of visual brightness, sound characteristics, or informational density. The inclusion of such environmental adaptation leads to a technically improved perceptual consistency, asholoride technologies Europe GmbH 7 93970

[0026] the digital output reflects current external states, thereby enhancing realism and situational immersion.

[0027] It can be provided that the contextual condition data comprise data obtained from one or more external or proprietary databases, including company-specific databases. Such data may include, information about commercial partners or associated locations, such as a list of restaurants belonging to a restaurant chain, together with metadata or customer profiles relevant for prioritized or personalized content presentation. These database-derived contextual condition data enable the orchestration logic to adapt the experience according to commercial relevance, user preferences, or location-specific attributes, thereby improving contextual alignment and relevance of the generated output.

[0028] It can be provided that the contextual condition data comprise data obtained from interactions data with vehicles objects or people.

[0029] It can be provided that the contextual condition data comprise user profile data including demographic information, age, interest profile, usage history, navigation behavior, or preferred language. The use of user profile data permits personalized orchestration of experiences in which the system automatically adjusts narrative complexity, language selection, or thematic relevance to the individual user. This results in a technically optimized experience pipeline that tailors output parameters in real time without requiring manual configuration. It is an adaptive experience generation process that improves user engagement and relevance while maintaining controlled orchestration behavior.

[0030] It can be provided that the contextual condition data comprise user interaction data including touch screen input, controller input, voice commands, or pointing gestures including feedback, selection inputs, or task outcomes that influence subsequent orchestration of content components, and / or other gestures or body signals. The integration of user interaction data enables bidirectional control within the orchestration logic, allowing real-time modification of subsequent content selection based on user actions. The resulting feedback loop allows adaptive branching of the experience and reinforces system responsiveness. Further, the interaction latencyholoride technologies Europe GmbH 8 93970

[0031] can be minimized while experience continuity is preserved. That can allow controlled correlation between user actions and content progression.

[0032] In the context of the present disclosure, user interaction data can be understood as sensor-detected or software-received inputs originating from user interface actions, speech recognition, or gesture-tracking subsystems, which can directly modify orchestration parameters.

[0033] It can be provided that the contextual condition data are derived from a single sensor (as a sensor source) or combination or fusion of multiple sensor sources including inertial sensors, satellite-based navigation, optical sensors, and data services, and / or are derived from a temporal sequence of measurements to identify movement patterns, driving behavior, or recurring user interactions, and / or are obtained at least in part from internal units or external servers or web-based services including map services, weather services, or traffic information services. The fusion of heterogeneous sensor data can improve the accuracy and stability of detected conditions and events. This leads to a technically improved detection process in which sensor noise is reduced and redundant signals are filtered. The temporal aggregation of measurements further allows pattern recognition, ensuring predictive adaptation to upcoming environmental or behavioral changes. The system thereby maintains a continuous situational model with high temporal precision and robustness.

[0034] It can be provided that the at least one event device comprises inertial sensors including an inertial measurement unit, accelerometers, gyroscopes, or magnetometers. The implementation of such sensors allows direct measurement of linear and angular motion of the platform. It enables fine-grained motion tracking for synchronized content modulation. The resulting technical effect is precise determination of motion vectors used to generate corresponding auditory or visual cues with minimal latency, ensuring phase-accurate sensory adaptation.

[0035] It can be provided that the at least one event device comprises positioning sensors including a global navigation satellite system receiver, global positioning system receiver, or ultra-wideband sensors, or dead reckoning sensors such as wheelholoride technologies Europe GmbH 9 93970

[0036] sensors or steering sensors, or optical sensors such as cameras, lasers, radars, or similar implementations. The inclusion of these sensors enables high-resolution positional tracking for contextual awareness. This allows the orchestration logic to correlate content activation with absolute or relative spatial coordinates. The technical effect lies in accurate geographic anchoring of content triggers, resulting in reproducible and position-dependent experience behavior.

[0037] It can be provided that the at least one event device comprises optical or imaging sensors including cameras, laser sensors, or radar sensors. The integration of optical sensors permits environmental perception including and extending beyond inertial and positional measurements. These sensors provide visual context such as object proximity or scene recognition, object detection, object tracking which enhances the fidelity of detected events. An improved environmental understanding can be received that supports precise mapping between physical surroundings and content orchestration, which can lead to a reduced false event detection.

[0038] It can be provided that the at least one event device comprises environmental sensors including weather sensors, air quality sensors, humidity sensors, or temperature sensors. The incorporation of environmental sensors enriches contextual condition data with local atmospheric parameters. The orchestration logic can then adapt sensory output to external conditions such as rain or temperature. This enhances perceptual realism and temporal coherence of the output.

[0039] It can be provided that the at least one event device is configured to obtain contextual condition data from storages or external sources including map databases, traffic information services, or web-based data services including services for historical data or forecasted data provision. This can include services for historical data (e.g. Wikipedia) or forecasted data provision (e.g., user trajectory prediction, also e.g., driving habits and forecasts based on paths already visited). The capability to access external data sources extends the contextual range of event detection. The technical effect is improved prediction accuracy for environmental transitions and earlier orchestration preparation. It can result in maintaining seamless continuity in the experience flow.holoride technologies Europe GmbH 10 93970

[0040] It can be provided that the at least one event device is integrated in a mobile device including a smartphone or tablet. Alternatively, it can be provided in the infotainment of a vehicle. The integration allows utilization of built-in sensors and network interfaces without additional hardware. The technical effect is a simplified architecture with lower system latency and power consumption, while maintaining full sensing capability.

[0041] It can be provided that the at least one event device is coupled to a moving platform including a vehicle and is configured to receive sensor data from the vehicle including wheel speed sensors, steering angle sensors, safety sensors, inertial sensors, positioning sensors, optical or imaging sensors, environmental sensors and infotainment sensors. This configuration can ensure direct acquisition of vehicular dynamics and operational states. A high-fidelity synchronization of the experience with the motion and status of the vehicle can be achieved, which can enable precise timing of sensory cues during driving.

[0042] It can be provided that the at least one experience device comprises an infotainment system of a vehicle, vehicle speakers, connected speakers, or a head unit display and / or a mobile device including a smartphone, tablet, laptop, or wearable device. The inclusion of such hardware broadens the range of supported output modalities and platforms. This yields a distributed system capable of presenting content across multiple synchronized interfaces. A unified multi-device output framework can be provided that preserves temporal alignment across heterogeneous hardware.

[0043] It can be provided that the at least one experience device is configured to provide an audio output, a visual output, or a combined audiovisual output, including immersive content presented in augmented reality, virtual reality, extended reality, or mixed reality formats. This configuration allows multimodal sensory engagement through spatial and immersive rendering. It can result in a broader dynamic range of user perception, enhanced situational immersion, and more natural environmental alignment of digital elements.

[0044] It can be provided that the at least one experience device is communicatively coupled to an external server unit or server or to an integrated unit configured toholoride technologies Europe GmbH 11 93970

[0045] orchestrate, synchronize, and distribute content components to the experience device. The use of an external server can establish a distributed orchestration system where heavy computation can be offloaded to server infrastructure. The technical effect is reduced on-device computational load and improved synchronization across networked devices through centralized orchestration timing.

[0046] It can be provided that the experience device presents content adapted based on events including a physical position of the user, including a seat position inside a vehicle or an orientation of a handheld device or a location of a vehicle hosting the user. The adaptation to physical position can ensure that output presentation aligns with the actual viewpoint or listening position of the user. A spatially coherent audiovisual rendering can be provided, maintaining correct directional cues and consistent immersion irrespective of user posture or seat position.

[0047] It can be provided that the at least one experience device is located outside a vehicle and configured to present context-aware information during pedestrian movement. This allows portability of the experience generation system beyond vehicle environments. A consistent functionality of context-sensitive output in mobile pedestrian contexts with dynamic environmental variability is given.

[0048] It can be provided that a plurality of experience devices is used simultaneously, wherein each experience device is configured to present an individually tailored experience session for different users. Thus, the same contextual condition data may result in different content components being selected for different users. This feature enables multi-user orchestration where shared environmental data yield personalized outputs. The technical effect is individualized content generation from a common contextual basis that can allow synchronized yet user-specific experiences without data duplication or processing conflict.

[0049] It can be provided that the orchestration logic is rule-based and configured to map detected conditions and events to controlled content components. The rule-based configuration ensures controlled behavior with verifiable logic paths. It is a traceable and predictable orchestration of content that can reduce error propagation and ensure compliance with functional safety requirements.holoride technologies Europe GmbH 12 93970

[0050] It can be provided that the orchestration logic employs artificial intelligence, machine learning, mathematical functions, or heuristic algorithms to evaluate contextual condition data and to select candidate content components. The use of Al enables adaptive and self-optimizing orchestration through learned correlations between contextual inputs and suitable content outputs. It can result in an improved accuracy of content selection under variable conditions, which can increase responsiveness and adaptability of the experience generation system. In the context of the present disclosure, an artificial intelligence can be understood as computational models capable of probabilistic reasoning or pattern recognition trained on multimodal datasets of contextual and behavioral data.

[0051] It can be provided that the orchestration logic structures content components in hierarchical storytelling levels including a meta-level defining general themes or user scope, or a macro-level defining overarching chapters or tasks, or a meso-level defining scenes or episodes, or a micro-level defining moment-to-moment narrative changes, and / or a sub-micro-level defining dialogue clauses or narrative beats. The hierarchical structure allows multi-layer orchestration of content granularity. This hierarchical division ensures that events of different temporal or contextual significance produce proportionate modifications in the narrative or presentation. The technical effect is a structured and scalable content framework that maintains logical coherence and temporal continuity between narrative segments.

[0052] It can be provided that the orchestration logic dynamically combines and sequences content components during runtime to generate adaptive and personalized experiences. The dynamic composition of content in real time enables individualized adaptation to both environmental and behavioral changes. The technical effect is a continuous personalization of content with consistent temporal flow that can eliminate perceptible segmentation or discontinuity.

[0053] It can be provided that the orchestration logic filters or selects content components based on an estimated cognitive state of the user including high, low, or transitional mental workload. The evaluation of cognitive state can be derived from user interaction frequency, motion data, or task complexity. The technical effect isholoride technologies Europe GmbH 13 93970

[0054] contextually appropriate information delivery matching the user’s attentional capacity, thereby maintaining safety and reducing cognitive interference in driving or navigation scenarios.

[0055] It can be provided that the orchestration logic is at least partially author-defined, such that an author predetermines constraints or content pools to control which components may be selected at runtime. This allows content designers to embed creative boundaries and narrative structure while maintaining computational flexibility. The technical effect is hybrid orchestration combining automated logic with controlled artistic intent, preserving both consistency and creative direction.

[0056] It can be provided that the orchestration logic incorporates interaction outcomes, which includes successful or failed user actions, into subsequent content selection. This functionality introduces event-dependent branching based on a user performance. It can result in a continuous feedback adaptation where user outcomes directly shape narrative direction and increase the interactivity while preserving computational control.

[0057] It can be provided that the orchestration logic generates and maintains a decision graph defining multiple possible experience paths and updates the decision graph in real time depending on contextual condition data and user interactions. The maintenance of a dynamic decision graph allows flexible narrative flow management with continuous condition tracking. The technical effect is non-linear yet coherent orchestration that ensures logical consistency despite branching pathways.

[0058] It can be provided that each content component is associated with a set of entry conditions and that the content component is raised into a candidate state only when all its entry conditions are fulfilled. This can guaranty a strict logical consistency between the context and content activation. This can result in a deterministic candidate generation that eliminates ambiguous triggering and ensures stability of the orchestration logic.

[0059] It can be provided that prioritization of candidate content components is performed according to predefined priority rules, mathematical functions, heuristic functions,holoride technologies Europe GmbH 14 93970

[0060] and / or machine learning models, and is based on rarity or uniqueness of the fulfilled conditions such that rare conditions receive higher priority than frequent ones, or based on contextual relevance including user profile, geographic context, or time of day, and is updated dynamically during runtime depending on user responses or changing contextual condition data. The prioritization process ensures that the most contextually meaningful content components are presented at the correct time. The technical effect is efficient allocation of computational and perceptual resources that can result in an adaptive narrative flow and reduced redundancy.

[0061] It can be provided if termination of a previously selected content component activates additional entry conditions for subsequent content components. This chaining mechanism provides smooth transitions between segments and ensures continuity in the experience timeline. An uninterrupted narrative progression and precise state management of orchestration can be provided.

[0062] It can be provided that the orchestration logic selects the next content component from the pool of candidate components by applying deterministic selection of the highest-priority candidate or stochastic selection to increase variability of the experience. Deterministic selection ensures consistent behavior, while stochastic selection introduces controlled unpredictability. A balanced orchestration strategy that preserves both stability and novelty can be provided. It can maintain the user engagement without compromising logical structure.

[0063] It can be provided that the orchestration of content components is performed on an external server and / or on an integrated server unit, both being configured to generate personalized content streams and distribute them to one or more experience devices. The server-based orchestration provides distributed computation for large-scale synchronization across devices. The technical effect is reduced local processing demand and global timing coordination that guarantees identical response latency across connected units.

[0064] As an alternative embodiment, the orchestration of content components may be performed on an integrated processing unit, for example directly on the experience device or on a computing unit embedded in the platform. In such a configuration, theholoride technologies Europe GmbH 15 93970

[0065] orchestration logic executes locally without relying on an external server, allowing real-time content selection, prioritization, and rendering even in the absence of network connectivity. The embodiment can provide a reduced communication latency, increased operational robustness, and improved autonomy of the system, while maintaining controlled orchestration behavior and full functionality of the adaptive experience generation.

[0066] It can be provided that the experience comprises an immersive experience including a relaxation experience or a design experience or a theme experience, wherein the experience is presented not only in an auditory or visual format but also through controllable color-based output. In such embodiments, the experience device or a platform -integrated output unit is configured to control lighting elements, in particular interior lighting or LED-based illumination of a vehicle, based on detected conditions or events. The orchestration logic evaluates contextual condition data to adapt color parameters such as hue, intensity, or temporal variation in response to motion events, environmental conditions, user interaction, or other contextual parameters. This enables an event-based color experience in which the visual appearance of the vehicle interior is dynamically synchronized with real-world events or situational states, thereby enhancing perceptual coherence, immersion, and user comfort while maintaining deterministic and / or context-aware control of the output.

[0067] It can be provided that the experience comprises informational experiences including travel guides, educational, relaxation, or productivity-related content, or alternatively fictional or gamified experiences with narrative storylines or interactive gameplay, presented in auditory, visual, or combined audiovisual form, optionally immersive through augmented, virtual, mixed, or extended reality. The experience can further be structured in sequential components including continuous playback, chapters, scenes, episodes, or modular tasks, and can be adapted dynamically based on user interactions or presented passively without input. These configurations enable flexible application of the invention across entertainment, education, and productivity domains. The embodiment provides a universal adaptability of the orchestration framework to various content types and interaction modes while maintaining consistent runtime control.holoride technologies Europe GmbH 16 93970

[0068] It can be provided that the experience is structured in content components including audio storytelling, trivia questions, riddles, mini-games, new, narrative audio, interactive audio, dialogues, podcasts, music, audio and / or assistance, environmental sound effects, or synchronized visual elements. The modular structure allows combinatorial generation of complex experiences from reusable units. The technical effect is scalable content creation and efficient memory management within the orchestration process.

[0069] It can be provided that the experience is synchronized with the movement and / or location of a person, platform or vehicle such that acceleration, braking, or directional changes, (positional or orientation changes) and / or global location, relative location, global orientation, or relative orientation are reflected in the audio or visual output. This feature ensures direct physical-to-digital coupling and aligns sensory presentation with real-world motion. It can result in a perceptually coherent and motion-synchronized experience minimizing disorientation and enhancing immersion through real-time feedback to platform dynamics.

[0070] It can be provided that the contextual condition data comprise user-interaction data derived from the physical manipulation or spatial orientation of an experience device, including pointing gestures, device orientation changes, or position-based selection actions. In such an embodiment, a user may direct a handheld device toward a point of interest, whereby the device’s orientation, motion, or input signals are detected by the event device and evaluated by the orchestration logic. When the detected pointing action satisfies one or more entry conditions associated with a content component relating to the selected point of interest, the system can raise this component into the candidate state and optionally provide additional informational or narrative content. This can enable interactive and location -aware experiences in which the user influences the progression or selection of content by actively engaging with physical surroundings through device-based pointing or selection.

[0071] It can be provided that the experience device is configured to generate directional or spatially resolved audio or video output, wherein the output parameters are influenced by the direction from which a detected event originates relative to the platform or to the experience device. In such embodiments, the contextual conditionholoride technologies Europe GmbH 17 93970

[0072] data comprising directional vectors, orientation information, or relative positioning of external or platform-based events, which are evaluated by the orchestration logic to modulate the spatial presentation of the content. For example, when an event is detected on the left side of the platform, a spatial audio system may render the corresponding audio component predominantly through left-side speakers, or a visual system may adjust the placement of augmented-reality elements accordingly. An enhanced spatial coherence, improved situational awareness, and increased perceptual realism of the generated experience can be achieved.

[0073] Up to now, the disclosure has been described with respect to the claimed method. Features, advantages or alternative embodiments herein can be assigned to the other claimed objects (e.g., device, system, and a computer program) and vice versa. In other words, the subject matter which is claimed or described with respect to the claimed method can be improved with features described or claimed in the context of the device and / or system and vice versa. In this case, the functional features of the method are embodied by structural units of the device and / or system and vice versa, respectively. Generally, in computer science a software implementation and a corresponding hardware implementation are equivalent. Thus, for example, a method step for “storing” data may be performed with a storage unit and respective instructions to write data into the storage. For the sake of avoiding redundancy, although the device and / or system may also be used in the alternative embodiments described with reference to the method, these embodiments are not explicitly described again for the device and / or system.

[0074] In another aspect, the disclosure relates to a device for generating at least one experience to at least one user.

[0075] The device provides a dedicated hardware and software architecture for performing the orchestration and delivery of adaptive experiences. The event receiving interface establishes a hardware or software gateway configured to receive at least one condition and / or event, wherein the condition and / or event is based on contextual condition data, e.g., from local sensors or external systems. This interface ensures real-time acquisition of contextual condition data and forms the basis for condition detection and event classification. It establishes a continuous and reliable data flowholoride technologies Europe GmbH 18 93970

[0076] between contextual measurement systems and the content orchestration logic, which allows immediate computational reaction to contextual or operational changes.

[0077] The processing unit comprising the orchestration logic serves as the computational core of the device. The orchestration logic can be technically defined as a rule-based or machine-learning control module that evaluates detected events and conditions against predefined entry conditions to determine eligible content components. The orchestration logic being configured to determine at least one content component as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event, and wherein the processing unit is further configured to prioritize a plurality of candidate content components based on one or more priority rules. The processing unit can perform context evaluation, priority computation, and activation control. It supports execution of adaptive content control at hardware speed and enables deterministic and low-latency response to event triggers and ensures consistent real-time synchronization between system context and sensory output.

[0078] The prioritization functionality within the processing unit introduces controlled order into the selection process. By evaluating each candidate component according to defined priority rules, such as temporal immediacy, spatial relevance, or uniqueness of triggering condition, the device prevents multiple conflicting activations and ensures that the most contextually appropriate content is selected for output. It can stabilize the experience flow and the avoidance of cognitive overload or redundant information delivery.

[0079] The experience interface operatively coupled to the processing unit serves as the communication conduit for providing the prioritized candidate component to one or more experience devices, which has been selected from the plurality of candidate content components, as the at least one experience, wherein the at least one experience comprises an audio or visual output or a combined audiovisual format, or immersive formats including augmented reality, virtual reality, mixed reality, or extended reality. The experience interface can handle content encoding, signal conversion, and data transmission in accordance with the capabilities of theholoride technologies Europe GmbH 19 93970

[0080] connected experience device. The experience itself can denote the generated sensory output that provides an audio and / or visual impression responsive to realtime contextual data. The device can output a contextually synchronized and temporally aligned sensory presentation with reduced latency and improved perceptual continuity across multiple devices.

[0081] In another aspect, the disclosure relates to a system for generating at least one experience for at least one user.

[0082] The system combines sensing, computation, and presentation units into a coordinated architecture for generating adaptive experiences. The system comprises at least one event device configured to detect at least one condition and / or event, wherein the condition and / or event is based on contextual condition data. The event device can be defined as a hardware or software unit configured to perform measurement and detection of contextual condition data. Such data can include signals from inertial sensors, GNSS, cameras, or other environmental and userinteraction sources. The event device can perform signal processing, filtering, and data fusion to identify one or more events or conditions relevant for experience generation. A transformation of raw environmental or motion data into structured contextual information can be performed, which allows subsequent orchestration processes to operate on semantically meaningful input rather than unprocessed signals.

[0083] Further, the system comprises a computing unit. The computing unit serves as the orchestration and decision layer. The computing unit is configured to determine at least one content component as a candidate based on a mapping of the at least one detected condition and / or event to one or more entry conditions associated with said component. Further, the computing unit is configured to prioritize a plurality of candidate content components using one or more priority rules. Through its orchestration logic, the computing unit maps detected events and conditions to entry conditions defined for each content component. The mapping can be based on explicit logical relationships, heuristic rules, or trained models that link contextual states to content selection criteria. An educated and interpretable control mechanism can be provided that ensures the content output corresponds precisely to theholoride technologies Europe GmbH 20 93970

[0084] detected contextual state and eliminates randomness or inconsistency in the generated experience.

[0085] The computing unit further performs the prioritization of multiple candidate content components using priority rules that quantify relevance or urgency of activation. The priority rules can consider the likelihood of occurrence, the uniqueness of the triggering condition, or the user’s cognitive load as derived from contextual data. The priority rules can consider a preference by the author, e.g. based on a commercial interest. An optimized runtime selection process that guarantees the most contextually meaningful and perceptually balanced content sequence while reducing redundant computations can be provided.

[0086] Further, the system comprises at least one experience device configured to present a prioritized candidate component, which has been selected from the plurality of candidate content components to the user in an audio and / or visual form or a combined audiovisual format, and optionally in immersive formats including augmented reality, virtual reality, mixed reality, or extended reality. The experience device is configured to present the selected, prioritized candidate component to the user as an audio and / or visual output. The experience device can include output systems such as infotainment displays, loudspeakers, headsets, headphones, earphones, output devices, mobile devices, orXR environments. The experience generated by the experience device can represent the technical manifestation of the orchestrated output, namely, a real-time synchronized sensory presentation that evolves in response to detected contextual conditions. A closed control loop between environment sensing, orchestration computation, and user-perceptible output can be provided, resulting in an integrated system that dynamically adapts to physical and environmental changes while maintaining temporal consistency across distributed devices.

[0087] Furthermore, a computer program is provided, comprising commands that, when executed by a computer, cause it to carry out or execute the methods described above at least in part. The program code of the computer program can be in any code, in a code suitable for controlling a drug delivery monitoring system.holoride technologies Europe GmbH 21 93970

[0088] The above-described relating to the method, device, and system also applies analogously to the computer program and vice versa.

[0089] As a further solution, the disclosure also encompasses a computer-readable storage medium, comprising program code that, when executed by a computer or a computer network, causes it to execute an embodiment of the method according to the disclosure. The storage medium can be provided at least in part as non-volatile data storage (e.g., as a flash memory and / or as an SSD - solid-state drive) and / or at least in part as volatile data storage (e.g., as a RAM - random access memory). The storage medium can be arranged in the computer or computer network. However, the storage medium can also, for example, be operated as a so-called app store server and / or cloud server on the internet. The computer or computer network can provide a processor circuit with, for example, at least one microprocessor. The program code can be provided as binary code and / or assembler code and / or as source code of a programming language (e.g., C) and / or as a program script (e.g., Python).

[0090] Features described above and below in connection with different aspects or embodiments may be combined with one another.

[0091] The above described may be summarized in other words and in relation to a possible more specific embodiment of the disclosure as described below, the following description being considered as not limiting the disclosure.

[0092] It is an objective of the present invention to support and / or enable adaptive and / or events aware experiences. In the context of this document, an experience is a technically generated sensual impression for one or more users. Experiences can be audio (acoustic) and / or visual, e.g. an audio and / or video stream or playback.

[0093] Experiences can be available on any device or a combination of devices capable of producing and / or reproducing audio and / or visual and / or similar digital experiences, including XR, VR, AR, or MR. For simplicity, we refer to these device / s as “experience device / s” in the remainder of this invention.

[0094] Experiences can be aware of events, and / or can be influenced by such events.

[0095] Events can be related to the experience device / s, for example, the motion and / orholoride technologies Europe GmbH 22 93970

[0096] position and / or (global or relative) location of the experience device. Events can be related to another device / s or platform, for example, the motion and / or position and / or (global or relative) location of the device and / or platform. Events can be external to the experience device / s, and / or the platform, and / or other devices. Events can be related to time and / or space (e.g. weather, motion, location, history, traffic, and / or similar). Events can be live and / or anticipations and / or pre-determined. Events can be real and / or imaginary and / or a combination. For example, an event can be the runtime speed of a vehicle that can influence the sound of a virtual engine. Events can be a combination of these events. Events can be derived and / or calculated based on other events. Events can be related to data about one or more users (e.g. interests, hobbies, anagraphical, history) and / or user interaction / s (e.g. commands, responses, votes). As an example, user interaction events can be using a gamepad and / or controller input, e.g. the event of pointing at a store can result in receiving information about it. For the sake of simplicity and not limitation, in the following, we will refer to “events”, suggesting any or a combination of the options above.

[0097] The experience device / s can be physically and / or wirelessly connected to a user and / or a static or moving platform (e.g. a vehicle) and / or a device, it can be integrated or part of it, and / or can be onboard inside and / or outside the user and / or the platform and / or the device. In the following, for the purpose of simplicity and not limitation, we refer to the “platform” of the system, implying any or a combination of the options above.

[0098] This disclosure describes a solution that uses a portable device and / or an integrated device, for example within a platform, that may be portable, and / or standalone, and / or connected, and / or integrated in the platform, and that may allow performing measurements, i.e. (cyclic or periodic) measurements concerning events, for example the pose and / or motion and / or acceleration of the platform and / or device in the environment (e.g. a location on Earth) or in a relative manner. Measurements can be related to events as defined above and / or in the remainder of the disclosure. As such, the portable device and / or an integrated device and / or multiple of those, being examples of a generic superset of devices capable of performing these measurements, in the following are referred to as “event device / s”.holoride technologies Europe GmbH 23 93970

[0099] Without excluding the descriptions above, events can be:

[0100] motion events (e.g. interactions with vehicles (e.g. surpassing, traffic jam) and / or people and / or objects, forces, accelerations, decelerations, velocities, turns, start and stop, sudden breaking, roundabout ramp, sliding, and / or similar) motion events derivatives (e.g. sequences of movement, driving patterns, maneuvers, and / or similar)

[0101] location events (e.g. points of interest, traffic lights, forests, cities, gas stations, stores, countryside, rough road, parking, highway, highway ramp, rest area, speed limits, low speed area, constructions, and / or similar)

[0102] navigation events (e.g. journey and / or route data, and / or similar)

[0103] time events (e.g. weather, history, day, dusk, dawn, night, duration, and / or similar)

[0104] profile events (e.g. number of people in the car, user profile, browser history, and / or similar)

[0105] user interaction events (e.g. using a single or multi-dimensional controller, a touch screen, a voice input, buttons, and / or similar)

[0106] platform -related events (e.g., for a vehicle, windows parameters, convertible top, seats, heating, air conditioning, and / or similar)

[0107] environment events, e.g.

[0108] captured by sensors (e.g. nearby vehicles, pedestrians, road signs, and / or similar)

[0109] leveraging map data (e.g. road network, buildings, points of interest, object metadata, and / or similar)

[0110] leveraging data services (e.g. web services, traffic, time, date, weather, celestial objects, pollution, seasonality (e.g. allergens), cinema programs, results (e.g. sports, events), and / or similar)

[0111] Events may fit in one or more of the contexts above. Events may be real and / or artificial and / or fictional and / or a combination (e.g. digital rewards may be placed at specific locations and / or may be collected during the experience in a location-aware manner, for example depending on geometric quantities, e.g. the distance to a location). Events may derive from one or a combination of contexts (e.g. stopping at a red light and / or entering the highway accelerating are examples of events where motion and / or location awareness may be fused to understand the situation).holoride technologies Europe GmbH 24 93970

[0112] DISCLOSURE OF INVENTION

[0113] Implementation examples of the disclosure are described below. The following shows:

[0114] Figure 1 schematically illustrates an embodiment of a system 300 according to the present disclosure;

[0115] Figure 2 schematically illustrates an embodiment of a device 200 according to the present disclosure;

[0116] Figure 3 schematically illustrates a flow diagram of an embodiment of the method 100 according to the disclosure;

[0117] Figure 4 schematically illustrates a further embodiment of a system 300

[0118] indicating the component that an event is related to;

[0119] Figure 5 illustrates a further embodiment of a system 300 on the platform 2;

[0120] Figure 6 schematically illustrates a further implementation scheme of the method 100;

[0121] Figure 7 schematically illustrates a flow diagram of a further embodiment of the method 100;

[0122] Figure 8 schematically illustrates a scene for an experience generated by the method 100 according to the present disclosure, and

[0123] Figure 9 schematically illustrates a further scene for an experience generated by the method 100 according to the present disclosure.

[0124] The embodiments explained below are preferred embodiments of the disclosure. In the embodiments, the described components of the embodiments each representholoride technologies Europe GmbH 25 93970

[0125] individual features of the disclosure which are to be considered independently of each other, and which also further develop the disclosure independently of each other. Therefore, the disclosure is also intended to include combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the disclosure already described.

[0126] Identical features, features of the same kind, identically or similarly acting features may be provided with the same reference numerals in the drawings. Further, it is noted that the drawings are schematic drawings and may not be true to scale. The drawings are provided to facilitate a better understanding of the concepts described herein.

[0127] In the following description, for purposes of explanation and not limitation, specific details are set forth, to provide a thorough understanding of the current disclosure. It will be apparent to one skilled in the art that the current disclosure may be practiced in other embodiments that depart from these specific details. For example, the skilled artisan will appreciate that the current disclosure may be practiced with any application for different functionalities or for different computing entities.

[0128] Figure 1 schematically illustrates an embodiment of a system 300 according to the present disclosure. Figure 1 shows the system 300 for generating at least one experience 7 for at least one user. Figure 1 illustrates a vehicle without excluding the other options described above and below, including other mobile devices e.g. a mobile phone. The system 300 comprises at least one event device 1 , at least one experience device 3, and at least one computing unit 310. The computing unit 310 can be implemented in a cloud system on an external server 13. The event device 1 is configured to detect at least one condition and / or event 4 (see Figure 4). The detected condition and / or event 4 (see Figure 4) is based on contextual condition data. The experience device 3 can be mounted in a platform 2, e.g., a vehicle 2. The system 300 is also configured to process the method 100 as shown in Figure 3.

[0129] The contextual condition data can comprise motion data including velocity, acceleration, deceleration, turning maneuvers, lane changes, or driving patterns. Asholoride technologies Europe GmbH 26 93970

[0130] an example, motion data include a forward acceleration of the vehicle 2 or a lane change detected via an inertial sensor. The contextual condition data can further comprise location data including global positioning data, relative position data, orientation, route or navigation data, or proximity to a point of interest. As an example, location data comprise the relative distance to a specific museum along a planned route. The contextual condition data can also comprise environmental data including weather conditions, daylight or time-of-day information, traffic data, or pollution levels. As an example, weather data comprise information about rainfall detected from a weather server. The contextual condition data can comprise user profile data including demographic information, age, interest profile, usage history, navigation, or preferred language. For example, the profile data comprise an age entry of a user being 12 years old and a preferred language being English. The contextual condition data can further comprise user interaction data including touch screen input, controller input, voice commands, or pointing gestures. For example, a voice command issued by a user while passing a landmark is included as user interaction data.

[0131] The contextual condition data can derive from a sensor source or a combination or fusion of multiple sensor sources. The sensor sources can comprise inertial sensors, satellite-based navigation, optical sensors, and external data services. The contextual condition data can also derive from a temporal sequence of measurements to identify movement patterns, driving behavior, or recurring user interactions. For example, a sequence of accelerations and turns is interpreted as a recurring driving behavior. The contextual condition data can also be obtained from external servers or web-based services including map services, weather services, or traffic information services.

[0132] The event device 1 can comprise inertial sensors including an inertial measurement unit, accelerometers, gyroscopes, or magnetometers. For example, a three-axis accelerometer measures longitudinal, lateral and vertical acceleration. The event device 1 can also comprise positioning sensors including a global navigation satellite system receiver, global positioning system receiver, or ultra-wideband sensors. For example, a GNSS receiver tracks real-time position. The event device 1 can also comprise optical or imaging sensors including cameras, laser sensors, or radarholoride technologies Europe GmbH 27 93970

[0133] sensors. For example, a camera detects a vehicle ahead. Optical or imaging sensors can also be considered as positioning sensors. For example, a camera or multiple cameras detect movement. The event device 1 can further comprise environmental sensors including weather sensors, air quality sensors, or temperature sensors. For example, an air quality sensor measures NO2levels inside a tunnel.

[0134] The event device 1 can be configured to obtain contextual condition data from external sources including map databases, traffic information services, or web-based data services. For example, an online map database provides location-specific metadata. The event device 1 can be integrated in a mobile device including a smartphone or tablet. For example, a smartphone contains integrated inertial and / or GNSS sensors. The event device 1 can be coupled to the moving platform 2, such as a vehicle, and configured to receive sensor data from the vehicle including wheel speed sensors, steering angle sensors, or infotainment sensors. For example, steering angle and wheel speed data are collected from the vehicle’s CAN bus.

[0135] The computing unit 310 is configured to determine at least one content component as a candidate based on a mapping of the at least one detected condition and / or event 4 to one or more entry conditions associated with the content component. Each content component is associated with a set of entry conditions. A content component is raised into a candidate state only when all its entry conditions are fulfilled.

[0136] The computing unit 310 is configured to prioritize a plurality of candidate content components using one or more priority rules. The priority rules include predefined rules, heuristic functions, or machine learning models. The prioritization of candidate content components can be based on a rarity or uniqueness of the fulfilled conditions, such that rare conditions are assigned a higher priority than frequent conditions. The prioritization can also based on contextual relevance including user profile data, geographic context, time of day, or other events. The prioritization is updated dynamically during runtime depending on user responses, interaction outcomes, or changing contextual condition data. For example, a rare combination of fog and low speed results in selection of a specific fog-related story component.holoride technologies Europe GmbH 28 93970

[0137] The experience device 3 is configured to present a prioritized candidate component to the user in an audio and / or visual form. The experience device 3 can comprise an infotainment system of a vehicle 2, vehicle speakers connected or integrated (e.g. to include BLE headphones), or a head unit display. It can also comprise a mobile device including a smartphone, tablet, laptop, or wearable device. The experience device 3 is configured to provide an audio output, a visual output, or a combined audiovisual output, including immersive content presented in augmented reality, virtual reality, extended reality, or mixed reality formats. For example, the experience device 3 presents a story in augmented reality via a smartphone display and headphones.

[0138] The experience device 3 as well as the vehicle 2 is communicatively coupled to an external server 13. The server can also be internal or not a server but an integrated unit. The server 13 is configured to orchestrate, synchronize, and distribute content components to the experience device 3. The experience device 3 can show content adapted to a physical position of the user or the platform, including a seat position inside a vehicle or an orientation of a handheld device or a position of the platform. For example, a story is rendered louder on the left speaker when the user is seated on the left side or a story rendered louder on the left speaker when an event occurs on the left side of the platform. The experience device 3 can be located outside a vehicle and configured to present context-aware information during pedestrian movement. For example, a pedestrian receives travel-related audio cues based on the route ahead. The experience device 3 can alternatively be located inside the vehicle 2 as the multimedia system of the vehicle 2 or as an additional multimedia system.

[0139] A plurality of experience devices 3 can be used simultaneously, each configured to present an individually tailored experience session for different users. For example, the front passenger hears a narrative while the backseat user receives a trivia quiz, both based on the same detected events or on different events if for example the users have different profiles and / or interests. Events can be prioritized differently for different users.holoride technologies Europe GmbH 29 93970

[0140] The orchestration logic 11 is rule-based and configured to map detected conditions and / or events to content components. The orchestration logic 11 is configured to structure content components in hierarchical storytelling levels. The storytelling levels include a meta-level defining general themes or user scope, a macro-level defining overarching chapters or tasks, a meso-level defining scenes or episodes, a microlevel defining moment-to-moment narrative changes, and a sub-micro-level defining dialogue clauses or narrative beats.

[0141] Further, the content components mapped by the orchestration logic are not limited to fully predefined or static content elements. In an alternative embodiment, the content components can comprise predefined content blocks, such as recorded audio segments and / or podcasts and / or content components that are generated or modified at runtime, for example using artificial intelligence or algorithmic content generation. In such cases, the orchestration logic applies rule-based constraints, parameters, and / or contextual boundaries that control, focus, and / or condition the generation of the content, ensuring deterministic orchestration behavior despite dynamic content creation. Accordingly, the orchestration logic maps detected conditions or events to controlled content components whose structure, scope, or activation behavior is defined by orchestration rules, irrespective of whether the underlying content is statically stored or dynamically generated.

[0142] The orchestration logic 11 can filter or select content components based on an estimated cognitive state of the user, including high mental workload, low mental workload, or transitional states. For example, during urban traffic, the user is assumed to be under high workload and is presented with simplified narration. The orchestration logic 11 can be at least partially author-defined such that an author predetermines constraints or content pools to control which components may be selected at runtime.

[0143] The orchestration logic 11 selects the next content component from the pool of candidate components by applying one of: deterministic selection of the highest-priority candidate or stochastic / randomized selection to increase variability of the experience.holoride technologies Europe GmbH 30 93970

[0144] The orchestration of content components is performed on the device 13 at the computing unit 310, which is configured to generate personalized content streams and to distribute them to one or more experience devices 3.

[0145] The experience can comprise an informational experience including a travel guide, educational content, or productivity-related information, or a fictional or gamified experience including a narrative storyline or interactive gameplay. The experience is presented in an auditory format, a visual format, or a combined audiovisual format, including immersive formats such as augmented reality, virtual reality, mixed reality, or extended reality.

[0146] The experience can be structured in content components, including audio storytelling, trivia questions, riddles, mini-games, new, narrative, dialogue, environmental sound effects, or synchronized visual elements. For example, a trivia question about the passing city is played when the vehicle slows down. The experience can be synchronized with movement of a platform or vehicle, such that acceleration, braking, or directional changes are reflected in the audio or visual output.

[0147] It is to be understood that the platform illustrated in Figure 1 is not limited to a vehicle. In alternative embodiments, the platform may comprise a human user carrying or interacting with a mobile experience device, such as a smartphone, tablet, wearable device, or similar portable computing unit. In such configurations, the event device may be integrated into or coupled with the mobile device and configured to detect conditions or events based on the motion, position, orientation, or interaction of the user. The experience device may correspond to the same mobile device or to an accessory connected thereto, such that all methods, processes, and orchestration functions described with reference to the vehicle-based embodiment can be executed analogously in a user-centric, pedestrian, or handheld-device scenario. Accordingly, the system architecture shown in Figure 1 supports both vehicle-based and user-based implementations without limitation.

[0148] Figure 2 schematically illustrates an embodiment of a device 200 according to the present disclosure.holoride technologies Europe GmbH 31 93970

[0149] Figure 2 shows the device 200 for generating at least one experience to at least one user. The device 200 comprises an event receiving interface 210, a processing unit 220, the orchestration logic 11 , and an experience interface 230.

[0150] The event receiving interface 210 is configured to receive at least one condition and / or event. The received condition and / or event is based on contextual condition data. The event receiving interface 210 is configured to interact with the event device 1.

[0151] The contextual condition data can comprise motion data including velocity, acceleration, deceleration, turning maneuvers, lane changes, or driving patterns. For example, the motion data include deceleration during an urban stop. The contextual condition data can also comprise location data including global positioning data, relative position data, route or navigation data, or proximity to a point of interest. For example, the location data include a global positioning coordinate in proximity to a museum. The contextual condition data can comprise environmental data including weather conditions, daylight or time-of-day information, traffic data, or pollution levels. For example, the weather conditions comprise real-time rain probability. The contextual condition data can further comprise user profile data including demographic information, age, interest profile, usage history, navigation, or preferred language. For example, the user profile comprises a selected preferred language set to French. The contextual condition data can also comprise user interaction data including touch screen input, controller input, voice commands, or pointing gestures. For example, the user gives a voice command to request information about a nearby location.

[0152] The contextual condition data can be derived from a single sensor or combination or fusion of multiple sensor sources including inertial sensors, satellite-based navigation, optical sensors, and external data services. For example, data from a gyroscope and a satellite navigation module are combined. The contextual condition data can be derived from a temporal sequence of measurements to identify movement patterns, driving behavior, or recurring user interactions. For example, a repeated morning commute pattern is detected based on past travel data. Theholoride technologies Europe GmbH 32 93970

[0153] contextual condition data can also obtained at least in part from external servers or web-based services including map services, weather services, or traffic information services. For example, traffic congestion information is obtained from a remote traffic information server.

[0154] The event receiving interface 210 is coupled to at least one event device 1 that provides contextual condition data. The event device 1 comprises inertial sensors including an inertial measurement unit, accelerometers, gyroscopes, or magnetometers. For example, the inertial measurement unit measures lateral acceleration. The event device 1 also comprises positioning sensors including a global navigation satellite system receiver, global positioning system receiver, or ultra-wideband sensors. For example, a GNSS module delivers positioning data. The event device 1 also comprises optical or imaging sensors including cameras, laser sensors, or radar sensors. For example, a radar sensor detects a nearby vehicle. The event device 1 further comprises environmental sensors including weather sensors, air quality sensors, or temperature sensors. For example, a temperature sensor detects exterior temperature.

[0155] The event device 1 is configured to obtain contextual condition data from external sources including map databases, traffic information services, or web-based data services. For example, an online map service provides metadata about nearby landmarks. The event device 1 is integrated in a mobile device including a smartphone or tablet. For example, a smartphone’s internal sensors are used for event detection. The event device 1 is coupled to a moving platform 2, such as a vehicle, and is configured to receive sensor data from the vehicle including wheel speed sensors, steering angle sensors, position sensors, inertial sensors, optical sensors or infotainment sensors. For example, the device receives wheel speed and steering angle data from a vehicle’s internal communication system.

[0156] The processing unit 220 comprises an orchestration logic 11 or is configured to host the orchestration logic 11. The orchestration logic 11 is configured to determine at least one content component as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event. Each content componentholoride technologies Europe GmbH 33 93970

[0157] is associated with a set of entry conditions, and a content component is raised into a candidate state only when all entry conditions are fulfilled.

[0158] The processing unit 220 is further configured to prioritize a plurality of candidate content components based on one or more priority rules. The priority rules include predefined rules, heuristic functions, or machine learning models. The prioritization is based on a rarity or uniqueness of the fulfilled conditions, such that rare conditions are assigned a higher priority than frequent conditions. For example, a content component associated with the rare combination of snowfall and nighttime is prioritized. The prioritization is also based on contextual relevance including user profile data, geographic context, or time of day. For example, historical profile data indicating a user's interest in architecture is used to prioritize historical content during urban driving. The prioritization is updated dynamically during runtime depending on user responses, interaction outcomes, or changing contextual condition data. For example, if a user frequently interacts with story content but not with quizzes, the system prioritizes storytelling components.

[0159] The orchestration logic 11 is rule-based and configured to map detected conditions and / or events to content components. The orchestration logic 11 is further configured to structure content components in hierarchical storytelling levels. The hierarchical storytelling levels include a meta-level defining general themes or user scope, a macro-level defining overarching chapters or tasks, a meso-level defining scenes or episodes, a micro-level defining moment-to-moment narrative changes, and a sub-micro-level defining dialogue clauses or narrative beats. For example, a meso-level scene about a forest is activated when the vehicle approaches a wooded area.

[0160] The orchestration logic 11 filters or selects content components based on an estimated cognitive state of the user, including high mental workload, low mental workload, or transitional states. For example, during high traffic density, components with low complexity are selected. The orchestration logic 11 is at least partially author-defined such that an author predetermines constraints or content pools to control which components may be selected at runtime. For example, an author restricts content to child-friendly options when the user profile includes a minor.holoride technologies Europe GmbH 34 93970

[0161] The orchestration logic 11 selects the next content component from the pool of candidate components by applying deterministic selection of the highest-priority candidate or stochastic selection to increase variability of the experience. For example, a randomized selection introduces narrative variation between similar travel routes.

[0162] The experience interface 230 is operatively coupled to the processing unit 220. The experience interface 230 is configured to interact with the experience device 3. The experience interface 230 is configured to provide a prioritized candidate component to at least one experience device 3. The selected content component is presented as the at least one experience. The experience comprises an audio or visual output. Further the experience comprises a combined audiovisual format, or immersive formats including augmented reality, virtual reality, mixed reality, or extended reality.

[0163] The experience device 3 comprises an infotainment system of a vehicle, vehicle speakers, a head unit display, or a mobile device including a smartphone, tablet, laptop, or wearable device. The experience device 3 is configured to provide an audio output, a visual output, or a combined audiovisual output, including immersive content presented in augmented reality, virtual reality, or mixed reality formats. For example, immersive story elements are rendered visually and aurally using a headmounted display. The experience device 3 can be a device externally located from the vehicle 2. The experience device 3 can be a device held by a pedestrian.

[0164] The experience device 3 is communicatively coupled to an external server or integrated unit 13. The external server 13 is configured to orchestrate, synchronize, and distribute content components to the experience device 3. The experience device 3 adapts content to a physical position of the user, including a seat position inside a vehicle or an orientation of a handheld device. For example, audio panning is adjusted based on seat position.

[0165] The experience device 3 is alternatively located outside of the vehicle 2 and is configured to present context-aware information during pedestrian movement. For example, a tourist walking through a city receives real-time historical narratives through a headset. A plurality of experience devices 3 may be used simultaneously,holoride technologies Europe GmbH 35 93970

[0166] and each experience device 3 presents an individually tailored experience session to a different user. For example, a driver receives a short factual narration while a pedestrian receives a fictional story about the same location or other locations.

[0167] Figure 3 schematically illustrates a flow diagram of an embodiment of the method 100 according to the disclosure.

[0168] Fig. 3 shows a computer-implemented method 100 for generating at least one experience to at least one user. The method 100 comprises several steps.

[0169] In step 110, at least one condition and / or event is detected using one or more event devices 1. The detected condition and / or event is based on contextual condition data.

[0170] The contextual condition data comprise motion data including velocity, acceleration, deceleration, turning maneuvers, lane changes, or driving patterns. For example, a detected deceleration may indicate an upcoming stop. The contextual condition data comprise location data including global positioning data, relative position data, route or navigation data, or proximity to a point of interest. For example, a point of interest such as a monument is detected via navigation data. The contextual condition data also comprise environmental data including weather conditions, daylight or time-of-day information, traffic data, or pollution levels. For example, a time-of-day entry at 18:00 and weather data indicating sunset are included. The contextual condition data further comprise user profile data including demographic information, age, interest profile, usage history, navigation, or preferred language. For example, the profile contains a previous history of requesting trivia content and a language preference of Spanish. The contextual condition data also comprise user interaction data including touch screen input, controller input, voice commands, or pointing gestures. For example, the user selects a building by pointing a device camera at it.

[0171] The contextual condition data are derived from individual sensor sources, a combination or fusion of multiple sensor sources including inertial sensors, satellitebased navigation, optical sensors, and external data services. For example, gyroscope data and satellite navigation data are fused to estimate movement direction. The contextual condition data are derived from a temporal sequence ofholoride technologies Europe GmbH 36 93970

[0172] measurements to identify movement patterns, driving behavior, or recurring user interactions. For example, a recurring detour is identified based on historical path data. The contextual condition data are also obtained at least in part from external servers or web-based services including map services, weather services, or traffic information services.

[0173] In step 120, using an orchestration logic 11 , at least one content component is determined as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event. For example, entry conditions may specify that the user is driving on a highway in clear weather at daytime. If all conditions are fulfilled, the corresponding content component is raised into a candidate state.

[0174] In step 130, a plurality of candidate content components is prioritized based on one or more priority rules. The priority rules include predefined rules, heuristic functions, or machine learning models. The prioritization is based on a rarity or uniqueness of the fulfilled conditions, such that rare conditions are assigned a higher priority than frequent conditions. For example, the rare event of passing a historic battlefield result in high priority for a corresponding content component. The prioritization is further based on contextual relevance including user profile data, geographic context, or time of day. For example, content about night-time legends is prioritized when the local time exceeds 20:00. The prioritization is dynamically updated during runtime depending on user responses, interaction outcomes, or changing contextual condition data. For example, if the user remains passive for a defined period, the system may prioritize passive storytelling over interactive challenges.

[0175] In step 140, a prioritized candidate component, selected from the plurality of candidate content components, is output to the at least one experience device 3. The experience device 3 is configured to generate the experience in the form of an audio and / or visual output.

[0176] The experience device 3 comprises an infotainment system of a vehicle, vehicle speakers, a head unit display, or a mobile device including a smartphone, tablet,holoride technologies Europe GmbH 37 93970

[0177] laptop, or wearable device. For example, a smartphone outputs the audio narrative through connected headphones.

[0178] The experience device 3 is configured to provide an audio output, a visual output, or a combined audiovisual output, including immersive content presented in augmented reality, virtual reality, or mixed reality formats. For example, during a scenic drive, the experience device overlays virtual narrative characters over real-world camera input.

[0179] The experience device 3 is communicatively coupled to an external server 13 configured to orchestrate, synchronize, and distribute content components to the experience device 3. The experience device 3 adapts content to a physical position of the user, including a seat position inside a vehicle or an orientation of a handheld device. For example, the direction of visual overlays is adapted based on the seat orientation. The experience device 3 is also configured to present context-aware information during pedestrian movement. For example, a pedestrian exploring a historical town receives immersive AR audio-visual narration via a wearable display.

[0180] A plurality of experience devices 3 can be used simultaneously, each configured to present an individually tailored experience session to different users. For example, the same route produces a historical narration for one user and an educational quiz for another user. For example, a user in Europe listens to an experience, while another or other users listen to other experiences in other locations in the world.

[0181] Figure 4 schematically illustrates a further embodiment of a system 300 indicating the component that an event is related to. An example of experience 7 is illustrated in Figure 4, calculated using orchestration of multiple events. In this example, the experience can be presented in an audible format by e.g. an Al agent. In a first step, performing at least one measurement to determine a pose and / or motion and / or acceleration and / or (relative and / or global) location and / or weather and / or another event / s takes place. For this, one or more event devices may be used. An example of event (e.g. motion and / or location event) is illustrated in Figure 4, with event frame 5 indicating that the event can be related to the experience device 3, world frame 6 indicating that the event may be global (e.g. with respect to a world frame), and the arrow indicating the example of motion.holoride technologies Europe GmbH 38 93970

[0182] The respective event device 1 can comprise at least one or a combination of sensors and / or data receivers including inertial measurement unit / s, global navigation satellite system receiver / s, antenna / s, platform sensors, such as wheel data and / or steering data, velocity data, visual sensors (e.g. camera / s), optical sensor / s (e.g., laser / s and / or radar / s), ultra-wideband, magnetometer / s, accelerometer / s, weather sensors, Internet and / or public and / or private information (e.g. weather data, traffic data). The event device 1 can comprise for example a beacon, a set of LEDs, a QR code and / or similar. The event device 1 can use map data. Data can be about the interactions between the device / s and / or users involved in the system and / or can be independent. Data can be filtered and / or used raw. Data can be fused and / or combined. For example, an event device can use map data in combination with sensor values to calculate events, e.g. presence near a specific store.

[0183] Leveraging one or many sensors and / or data receivers can enhance the accuracy of measurements, improve the reliability of subsequent measurements, improve the robustness and / or redundancy of the system and / or optimize system performance. Furthermore, this step can reduce computational complexity in later stages by providing clear initial conditions for the experience, thus enabling more efficient data processing and analysis.

[0184] Figure 5 illustrates a further embodiment of a system 300 on the platform 2. In a further step, the measurement can establish a state and / or event for the platform 2 (e.g., a vehicle) and / or external device and / or location (e.g. distance to a point of interest), enabling awareness and subsequent calculations for the experience. For example, like e.g. illustrated in Figure 5, there may be a platform 2, e.g. a vehicle, an event device 1 and an experience device 3 may be in the vehicle 2. The event device 1 may measure motion, e.g. a lateral and / or forward acceleration event, and / or may calculate, based on those measurements, that a lane change event is happening related to the vehicle 2 as e.g. indicated by event frame 5 in Figure 2. The same and / or another event device 1 may measure visually the event of overtaking a vehicle 2 and / or validate and / or measure the lane change event. The event device 1 may pass the event information to the experience device 3, resulting in that the experience can be influenced (e.g. in a motion-synchronized manner). By leveragingholoride technologies Europe GmbH 39 93970

[0185] the events, the experience can effectively differentiate and / or become unique with respect to time and / or space. Events can be calculated leveraging artificial intelligence (Al) and / or mathematically and / or heuristically and / or experimentally and / or with machine learning and / or manually and / or with a device and / or a combination of these. Events can be one or multiple and / or can be related to one or multiple components, e.g. to the experience device and / or the platform 2 and / or can be events external to the platform 2 and / or the device. This is illustrated as an example in Figure 5 and / or Figure 6 with the frames 5-x.

[0186] Figure 6 schematically illustrates a further implementation scheme of the method 100. In a further step, leveraging the measurement to enable event-synchronized and / or aware experience / s on the at least one experience device takes place.

[0187] Continuing with the example above, this step can result in setting a parameter of the experience, like e.g. the volume and / or the panning and / or virtual spatial positioning and / or virtual acoustic room properties (like reverb and / or echo) in the experience and / or the content of the audio, depending on the overtaking event. This provides the advantage that the listener is provided with acoustical feedback regarding the overtaking event. In another example, an audio parameter, like e.g. language and / or text of the audio, can be set depending on e.g. a geometric quantity, like e.g. the distance and / or direction to a location, e.g. the driving destination and / or a point of interest. This provides the advantage that the listener is provided with acoustical feedback regarding the relative and / or global position of the reference location (e.g. in a location-aware manner). For example, experiences can be adapted and / or refined in a manner that a fictional element can take place in a setting that can fit an event of the real vehicle (e.g. a narration can have a villain and the event of the real vehicle driving near a forest can influence the narration that can have the villain running out of the woods). For example, a fictional element can be the symbol of a store as a coin within a rewarding system that can be artificially collected in proximity of the store. Synchronization and / or awareness can be calculated leveraging artificial intelligence (Al) and / or by a user and / or a device and / or a combination of these. Synchronization and / or awareness can be automated. This provides the advantage that relevant (fictional or non-fictional) information can be offered to the user without the need for them to request and / or interact e.g. via user interfaces. This can beholoride technologies Europe GmbH 40 93970

[0188] beneficial for drivers and / or passengers that may suffer of motion sickness symptoms.

[0189] Figure 7 schematically illustrates a flow diagram of a further embodiment of the method 100. In a further step, components of the experience / s can be orchestrated, e.g. using the event device and / or the experience device and / or the platform and / or an external device (e.g. a server). Components can be provided in one or multiple manners:

[0190] selected from a database (e.g. a database of pre-recorded audio files) streamed live and / or non-live (e.g. news, sport events, concerts, podcasts, videos, and / or similar)

[0191] generated at runtime (e.g. based on events)

[0192] Each experience component has a certain set of entry conditions. Only if all conditions are met, the component becomes a candidate that can be selected for subsequent playback. The rule set that maps conditions to raise components into the candidate state for an upcoming selection is called ‘orchestration logic’.

[0193] Thus, the orchestration logic combines components in real time to provide a dynamic, condition- and event aware experience.

[0194] Components may be nested in a hierarchical structure. I.e. one component can contain sub-components that may only become candidates if their parent component is currently selected. This hierarchical structure can leverage common storytelling practices, like e.g. layered and / or varying granularities and / or stages of the experience, like e.g. meta-level changes (themes), macro-level changes (chapters), meso-level changes (paragraphs), micro-level changes (lines of dialogue), and / or sub-micro- or beat-level changes (individual clauses or narrative moments). For example, events may trigger awareness of situations and / or adaptations and / or changes in the experience that can be orchestrated (e.g. speed limit changes may have a meso-scope as they may result in significant developments within a section of the experience). The audio parameters, like e.g. audio text, may change based on a set of vehicle driving situations, like e.g. driving in the user’s home neighborhood may result in a warm-up phase of an audio experience, with components that may be an introductory and / or welcome section of the experience, and / or an introductoryholoride technologies Europe GmbH 41 93970

[0195] section to the destination and / or the current location and / or other locations, and / or in a gaming section (e.g. a trivia about the destination). The driving situation may change, like e.g. driving in a city, the city can be busy and / or the user may have low mental capacity. This may result in prioritizing simpler components of the experience like e.g. relaxing audio and / or music and / or visual. Other examples of driving situations may be on the freeway and / or in the countryside and / or about to arrive at the destination. Situations may cause varying mental capacities for the user / s (e.g. high, low, mindful, transitioning) and / or varying types of contents may be prioritized (e.g. relaxed, thoughtful, hectic). This provides the advantage that the user is provided with feedback that accommodates the state of mind.

[0196] The orchestration logic can be determined by leveraging artificial intelligence (Al) and / or by a user (e.g. a designer) and / or a device and / or using graph methods and / or machine learning and / or heuristics and / or mathematical approaches and / or a combination of these. The orchestration can be calculated at runtime and / or be predetermined. In the case a large language model is used for the orchestration, the command prompt is procedurally generated and contains the current set of relevant conditions and ongoing events so that the desired situation-aware response is likely.

[0197] Since more than one component can be in the candidate state at the same time, an automatic prioritization is required so that the most relevant events are presented in the experience, and / or other content (e.g. stones, music, news, information, books, visuals) can participate in longer experiences. This provides the advantage that experience can fit the situation / s and / or events particularly well.

[0198] The prioritization of which candidate to select next can either be determined by simply comparing pre-defined priority values, by a more complex selection heuristic or by a machine-learning model. The less likely a set of conditions is, the more surprising and exciting the content of the corresponding candidate appears to the user. E.g. a candidate referring to the cloudy weather - which is likely to occur almost anywhere - should have a smaller selection priority than a candidate that is referring to unique nearby landmarks.holoride technologies Europe GmbH 42 93970

[0199] An example of experience 7 is illustrated in Figure 7, calculated using orchestration of multiple events. In this example, the experience can be presented in an audible format by e.g. an Al agent.

[0200] Examples of storytelling practices and / or concepts may be represented by one or more levels and / or scopes, like e.g. meta-level, macro-level, meso-level, micro-level, and / or sub-micro- or beat-level. A meta-level change / effect can be outside the direct boundaries of the narrative and / or deal with the broader story context and / or how it interacts with external factors like e.g. audience perception, cultural significance, and / or thematic resonance. For example, a meta-level effect like defining age scope and / or general theme of an experience (e.g. how playful, educational, mindful) can be influenced by the age and / or interests of the listener / s (i.e. the relevant context for this example is a user profile event). A macro-level change / effect can be an overarching change that defines the experience’s structure over its entirety. For example, a macro-level effect like assigning roles and / or tasks to listeners as participants in the experience can be influenced by an event like the duration of the drive. A meso-level change / effect can occur at the scene and / or sequence level, marking significant developments within a chapter, episode, and / or section of the experience. For example, a meso-level effect like being attacked by a villain can be triggered by the event of entering a forest. A micro-level change / effect can be a smaller shift that happens moment-to-moment, e.g. within a single scene and / or conversation. For example, a micro-level effect like staying silent as there is a villain nearby can be influenced by being waiting at a red traffic light. A sub-micro- (or beatlevel) change can occur within individual sentences, actions, and / or lines of dialogue. For example, a sub-micro-level effect like a sudden noise can be triggered by the event of a sudden acceleration.

[0201] In a further step, at least one or more experiences can be presented. The presentation / s and / or output can be audio, visual, virtual, augmented, extended, and / or mixed. For example, the audio may be presented leveraging text to speech techniques and / or other Al methods.

[0202] In a further step, at least one or more experiences can be available on the one or more experience devices. Experience devices comprise units for presenting audioholoride technologies Europe GmbH 43 93970

[0203] and / or visual content and / or content capable of stimulating the human body (e.g. reactive motion like in a simulator), including spatial and / or VR content and / or AR content and / or MR content and / or XR content, and / or a display unit for 2D content, and / or a vehicle infotainment system, and / or a device capable of presenting the experience (e.g. tablets, smartphones, headphones, speakers, stereos, displays). Experiences can be audio and / or visual (e.g. text, images) and / or perceivable via other senses (e.g. stimulation to the vestibular system).

[0204] Figure 8 schematically illustrates a scene for an experience generated by the method 100 according to the present disclosure.

[0205] Fig. 8 shows an example of an interactive experience presented on an experience device 3, wherein the experience device 3 comprises a smartphone. The experience device 3 is configured to generate at least one experience for at least one user. The experience is presented as a visual and / or audiovisual output and is influenced by motion and / or position of the experience device and / or a vehicle 2 to which the experience device 3 is coupled.

[0206] The experience device 3 is communicatively coupled to an external server 13, the server being configured to orchestrate, synchronize, and distribute content components to the experience device. The experience device is further configured to adapt content to a physical position of the user, including an orientation of the handheld device.

[0207] In the left part of Figure 8, at least one game element is shown to react to a driving direction. The driving direction is detected by at least one event device 1 , the event device 1 being configured to detect at least one condition and / or event based on contextual condition data. The contextual condition data comprise motion data including directional change, acceleration, or turning maneuvers. The data are evaluated by an orchestration logic configured to determine at least one content component as a candidate when a corresponding set of entry conditions associated with the content component is fulfilled. The orchestration logic 11 is further configured to prioritize a plurality of candidate content components based on one or more priority rules.holoride technologies Europe GmbH 44 93970

[0208] In the right part of Figure 8, the experience device 3 functions as a visual window into another world. The visual output is synchronized with at least one motion of the vehicle 2 or of the handheld device 1. The content component shown in the output is selected dynamically based on the detected contextual condition data. The experience comprises a rendered immersive environment, which is displayed through the visual interface of the experience device 3.

[0209] The selection and output of the content component is based on a processing step performed by the orchestration logic 11. The orchestration logic evaluates current motion state, position, and optionally user interaction data. The user interaction data may include motion of the handheld device or orientation changes relative to the surrounding environment.

[0210] The experience may comprise a game scenario, wherein interactive or narrative content is selected and adapted in real time. The experience is generated through detection of contextual data, orchestration based on predefined entry conditions, prioritization of eligible content components, and output of a selected component to the user via the experience device 3.

[0211] Figure 9 schematically illustrates a further scene for an experience generated by the method 100 according to the present disclosure.

[0212] Fig. 9 shows a navigation interface on the experience device 3, wherein the experience device 3 is configured to generate at least one experience for at least one user. The output of the experience is based on detected motion, position, and orientation of a platform 2, the platform comprising a vehicle, or of a smartphone.

[0213] The experience device 3 is configured to receive contextual condition data via at least one event device 1. The contextual condition data include motion data such as vehicle velocity, acceleration, or turning maneuvers, and location data such as global positioning data or route information. For example, a current turn or a specific road segment is detected and processed. For example, a point of interest in proximity of aholoride technologies Europe GmbH 45 93970

[0214] platform 2 is highlighted in Figure 9 and included in the experience. The travel guide is describing based on the current platform location and motion.

[0215] The contextual condition data are evaluated by an orchestration logic 11. The orchestration logic is configured to determine at least one content component as a candidate for presentation when one or more entry conditions are fulfilled. A plurality of candidate content components is prioritized using one or more priority rules, the priority rules comprising predefined rules or heuristics based on spatial relevance, user profile, or time-of-day context.

[0216] The experience device 3 is configured to output the selected prioritized candidate component as an audio and / or visual experience. In Figure 9, the output comprises a visual navigation interface and may optionally include spoken directions or description of places, objects that the vehicle 2 drives by. The experience is adapted to the current route and driving situation.

[0217] The experience device 3 is further configured to adapt the presentation to a physical position of the user and may include auditory, visual, or audiovisual output. For example, guidance to a point of interest may be provided both on the screen and through a voice-based narration. The content output is dynamically updated depending on the detected position and movement of the vehicle.

[0218] The experience device 3 may operate in conjunction with the external server 11 configured to orchestrate and distribute content components based on real-time contextual inputs. The navigation-based experience may incorporate functional and informational content components depending on the situation.

[0219] Overall, the examples show how condition aware experiences can be provided.holoride technologies Europe GmbH 46 93970

[0220] LIST OF REFERENCE NUMBERS

[0221] 1 event device

[0222] 2 platform

[0223] 3 experience device

[0224] 4 motion and / or location in world frame

[0225] 5 event frame

[0226] 6 world frame

[0227] 7 experiences

[0228] 11 orchestration logic

[0229] 13 external server

[0230] 100 method

[0231] 110-140 method steps

[0232] 200 device

[0233] 210 event receiving device

[0234] 220 processing unit

[0235] 230 experience interface

[0236] 300 system

[0237] 310 computing unit

Claims

holoride technologies Europe GmbH 47 93970CLAIMS1. A computer-implemented method (100) for generating at least one experience to at least one user, the method (100) comprising the steps of:- detecting (110) at least one condition and / or event using one or more event devices (1), wherein the condition and / or event is based on contextual condition data;- determining (120), using an orchestration logic (11), at least one content component as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event;- prioritizing (130) a plurality of candidate content components based on one or more priority rules; and- outputting (140) a prioritized candidate component, which has been selected from the plurality of candidate content components, to at least one experience device (3), wherein the experience device (3) is configured to generate as the at least one experience an audio and / or visual output.

2. The method (100) according to the direct preceding claim, wherein the contextual condition data comprise at least one of:- motion data including at least one of velocity, acceleration, deceleration, turning maneuvers, lane changes, or driving patterns, or walking patterns; - location data including at least one of global positioning data, relative position data, orientation, route or navigation data or road signs, or proximity to a point of interest, or proximity to a neighborhood, or proximity to a type of street; - environmental data including at least one of weather conditions, daylight or time-of-day information, traffic data, or pollution levels, or historical data;- interaction data with vehicles, objects or people;- user profile data including at least one of demographic information, age, interest profile, usage history, time, navigation, or preferred language, and / or - user interaction data including at least one of touch screen input, controller input, voice commands, or pointing gestures, or other gestures or body signals.holoride technologies Europe GmbH 48 939703. The method (100) according to any of the preceding claims, wherein the contextual condition data are derived from a sensor source or combination or fusion of multiple sensor sources including inertial sensors, satellite-based navigation, optical sensors, and data services, and / or are derived from a temporal sequence of measurements to identify movement patterns, driving behavior, or recurring user interactions, and / or are obtained at least in part from internal or external servers or web-based services including map services, weather services, or traffic information services.

4. The method (100) according to any of the preceding claims, wherein the at least one event device (1 ) comprises:- inertial sensors including an inertial measurement unit, accelerometers, gyroscopes, or magnetometers;- positioning sensors including a global navigation satellite system receiver, global positioning system receiver, or ultra-wideband sensors, or dead reckoning sensors including wheel sensors or steering sensors;- optical or imaging sensors including at least one of cameras, laser sensors, or radar sensors, and / or- environmental sensors including weather sensors, air quality sensors, humidity sensors, or temperature sensors.

5. The method (100) according to any of the preceding claims, wherein the at least one event device (1 ) is:- configured to obtain contextual condition data from storage or external sources including map databases, traffic information services, or web-based data services, including services for historical data or forecasted data provision;- integrated in a mobile device including a smartphone or tablet, and / or - coupled to a moving platform including a vehicle, and is configured to receive sensor data from the vehicle including wheel speed sensors, steering angle sensors, inertial sensors, positioning sensors, optical or imaging sensors, environmental sensors and / or infotainment sensors.holoride technologies Europe GmbH 49 939706. The method (100) according to any of the preceding claims, wherein the at least one experience device (3) comprises an infotainment system of a vehicle, vehicle speakers, connected speakers or a head unit display and / or a mobile device including a smartphone, tablet, laptop, or wearable device, and wherein the at least one experience device (3) is configured to provide an audio output, a visual output, or a combined audiovisual output, including immersive content presented in augmented reality, virtual reality, extended reality or mixed reality formats, and wherein the at least one experience device (3) is communicatively coupled to an external unit or server or to an integrated unit, the unit / server being configured to orchestrate, synchronize, and distribute content components to the experience device (3), and wherein the experience device (3) presents content adapted based on events including a physical position of the user, including a seat position inside a vehicle or an orientation of a handheld device or a location of a vehicle hosting the user, or wherein the at least one experience device (3) is located outside a vehicle, and is configured to present context-aware information during pedestrian movement.

7. The method (100) according to the direct preceding claim, wherein a plurality of the experience device (3) is used simultaneously, and wherein each experience device (3) of the plurality of experience devices (3) being configured to present an individually tailored experience session for different users.

8. The method (100) according to any of the preceding claims, wherein the orchestration logic (11) is rule-based and configured to map detected conditions and / or events to controlled content components.

9. The method (100) according to any of the preceding claims, wherein the orchestration logic (11) is configured to structure content components in hierarchical storytelling levels including at least one of:a) a meta-level defining general themes or user scope,b) a macro-level defining overarching chapters or tasks,c) a meso-level defining scenes or episodes,holoride technologies Europe GmbH 50 93970d) a micro-level defining moment-to-moment narrative changes, and e) a sub-micro-level defining dialogue clauses or narrative beats.

10. The method (100) according to any of the preceding claims, wherein the orchestration logic (11 ) filters or selects content components based on an estimated cognitive state of the user, including high mental workload, low mental workload, or transitional states, and / or wherein the orchestration logic (11) is at least partially author-defined, such that an author predetermines constraints or content pools to control which components may be selected at runtime.

11. The method (100) according to any of the preceding claims, wherein each content component is associated with a set of entry conditions, and wherein the content component is raised into a candidate state only when all its entry conditions are fulfilled.

12. The method (100) according to any of the preceding claims, wherein the prioritization of candidate content components is performed according to the priority rules including predefined rules, heuristic functions, mathematical functions, and / or machine learning models, and wherein the prioritization of candidate content components is based on a rarity or uniqueness of the fulfilled conditions, such that rare conditions are assigned a higher priority than frequent conditions, and / or wherein the prioritization of candidate content components is further based on contextual relevance including at least one of: user profile data, geographic context, time of day, or other realtime events (e.g. driving events, change in location, etc.), and / or wherein the prioritization of candidate content components is updated dynamically during runtime depending on user responses, interaction outcomes, or changing contextual condition data.

13. The method (100) according to any of the preceding claims, wherein the orchestration logic selects the next content component from the pool of candidate components by applying one of:a) deterministic selection of the highest-priority candidate, orholoride technologies Europe GmbH 51 93970b) stochastic / randomized selection to increase variability of the experience, or c) probabilistic selection.

14. The method (100) according to any of the preceding claims, wherein the orchestration of content components is performed on an external server (13) and / or on an integrated server unit (13), the external server (13) and / or the integrated server unit (13) being configured to generate personalized content streams and to distribute them to one or a plurality of experience devices (3).

15. The method (100) according to any of the preceding claims, wherein the experience comprises an informational experience including a travel guide, educational content, or productivity-related information, or alternatively a fictional or gamified experience including a narrative storyline or interactive gameplay, and wherein the experience is presented in an auditory format, a visual format, or a combined audiovisual format, and optionally in immersive formats including augmented reality, virtual reality, mixed reality, or extended reality.

16. The method (100) according to any of the preceding claims, wherein the experience comprises an immersive experience including a relaxation experience, or design experience, or theme experience, wherein the experience is presented in an auditory format, a visual format, or a combined audiovisual format, including colors and / or images.

17. The method (100) according to any of the preceding claims, wherein the experience is structured in content components, and wherein the content components of the experience include at least one of: audio storytelling, trivia questions, riddles, mini-games, news, narrative audio, interactive audio, dialogues, podcasts, music, audio and / or visual assistance, environmental sound effects, or synchronized visual elements.

18. The method (100) according to any of the preceding claims, wherein the experience is synchronized with movement and / or location of a platform or vehicle, such that acceleration, braking, or directional changes, and / or globalholoride technologies Europe GmbH 52 93970location, relative location, global orientation, or relative orientation are reflected in the audio or visual output.

19. A device (200) for generating at least one experience to at least one user, the device (200) comprising:- at least one event receiving interface (210) configured to receive at least one condition and / or event, wherein the condition and / or event is based on contextual condition data;- at least one processing unit (220) comprising an orchestration logic (11), the orchestration logic (11) being configured to determine at least one content component as a candidate for presentation based on whether a corresponding set of entry conditions associated with the content component are fulfilled by the detected at least one condition and / or event, and wherein the processing unit (220) is further configured to prioritize a plurality of candidate content components based on one or more priority rules; and- at least one experience interface (230) operatively coupled to the processing unit (220), wherein the experience interface (230) is configured to provide a prioritized candidate component to an experience device (3), which has been selected from the plurality of candidate content components, as the at least one experience, wherein the at least one experience comprises an audio or visual output, or a combined audiovisual format, or immersive formats including augmented reality, virtual reality, mixed reality, or extended reality.

20. A system (300) for generating at least one experience for at least one user, comprising:- at least one event device (1 ) configured to detect at least one condition and / or event, wherein the condition and / or event is based on contextual condition data:- at least one computing unit (310) configured to:i) determine at least one content component as a candidate based on a mapping of the at least one detected condition and / or event to one or more entry conditions associated with said component;ii) prioritize a plurality of candidate content components using one or more priority rules;holoride technologies Europe GmbH 53 93970- at least one experience device (3) configured to present a prioritized candidate component, which has been selected from the plurality of candidate content components, to the user in an audio and / or visual form, or a combined audiovisual format, and optionally in immersive formats including augmented reality, virtual reality, mixed reality, or extended reality.

21. Computer program comprising instructions which, when executed by a computer, cause the computer to carry out the method according to any of the preceding method claims.

Images