Method and apparatus for managing virtual session

Abstract

The invention provides a method, a device and a system for managing a virtual session. In some embodiments, the method includes identifying a current activity performed by a user in a virtual session, determining at least one first parameter of the virtual session associated with the current activity, detecting an occurrence of at least one event in a real-world environment, determining a correlation between the at least one event and the at least one first parameter, determining at least one second parameter to be associated with the current activity based on the correlation, and translating the virtual session by modifying the at least one first parameter based on the at least one second parameter.

Description

Technical Field

[0001] The present disclosure relates generally to virtual environments, and more particularly, to methods and apparatus for managing virtual sessions based on external events. Background Art

[0002] Users have begun replicating their real lives in virtual environments in various areas such as, but not limited to, office workspaces, shopping malls, etc. A virtual environment can create a simulated environment that a user can inhabit. For example, a virtual environment (which may also be referred to as virtual reality) can immerse a user in a three-dimensional (3D) experience. That is, a user can be immersed in and / or can interact with the 3D world created by the virtual environment, rather than viewing a two-dimensional (2D) screen in front of the user.

[0003] For example, a metaverse may represent a form of a virtual environment in which a user may create an avatar to interact with the metaverse and / or create an online presence that may integrate virtual locations and / or environments. The associated metaverse may provide an integrated network of 3D virtual worlds. These virtual worlds may be accessed through one or more virtual reality devices, such as, but not limited to, a head mounted display unit and / or headphones, a 3D mouse, an optical tracker, a wired glove (e.g., a haptic glove), and an omnidirectional treadmill. A user may navigate the associated metaverse using at least one of eye movements, feedback controllers, and voice commands. For example, headphones may immerse a user in a virtual world by stimulating the user's senses (which may be referred to as telepresence), which may be created by producing a physical sensation of actually being in the virtual environment.

[0004] An immersed user (e.g., immersed in a metaverse session) may not be aware of the user's actual physical environment, such as, but not limited to, events occurring in the real world. As a result, the user may be hindered from responding to real-world events, such as, but not limited to, events occurring on at least one of the plurality of electronic devices in the real world.

[0005] For example, if an immersed user wishes to interact with the user's physical surroundings in the real world, the immersed user may need to abandon (e.g., pause) their current task in the metaverse and / or end the current metaverse session in order to interact with the real world. Alternatively or additionally, if an event occurs in the real world that can be detected by an Internet of Things (IoT) device, inconvenience to the immersed user may not be avoided by modifying the metaverse session based on the event occurring in the real world. That is, the related art may only provide notifications related to real-world events to the immersed user in the metaverse session, which may not be sufficient and / or may not properly interrupt the user's immersion in the metaverse session.

[0006] Related technologies may be limited to collecting user-related events (e.g., emotional states, physical movements) and reflecting the events in a metaverse session. For example, the state of an IoT device in a metaverse session may be updated by replicating the physical properties of the IoT device in the metaverse session. Other related technologies may display the current real-world state in a metaverse session in front of the user (e.g., within the user's front field of view). However, displaying the state may distract and / or destroy the user's immersion in the metaverse session. Therefore, since the metaverse session may be stopped to temporarily display the real world, it may impose a large cognitive burden on the user and / or result in a poor experience in the virtual world.

[0007] Therefore, when a user is in a metaverse session, the user may be immersed in the metaverse session, but the occurrence of real-world events (e.g., IoT device events) may require the user's attention and / or focus. Therefore, the user may feel inconvenienced in the metaverse session because the user may be forced to cater to events in the real world.

[0008] Related art may fail to provide natural synchronization between the metaverse session and real-world events by requiring the user to switch between pausing and playing the metaverse session to switch between the metaverse session and the real world. As such, the metaverse session may not represent the user's real-time situation corresponding to the real world and may be limited in providing an immersive experience to the user.

[0009] To this end, it may be desirable to have a natural and / or seamless switch between the Metaverse session and the user's reality in the real world. That is, the user may wish to not lose immersion in the Metaverse session and still be able to perform the intended task in the Metaverse session without being affected by real-world events. For example, it may be desirable for the Metaverse session to transition based on real-world events so that the user is not inconvenienced by completing the intended task in the Metaverse session and caters to real-world events.

[0010] Virtual environments need further improvement, as the demand for immersive virtual environments may be limited by the lack of synchronization between the user's real life and the metaverse session. Summary of the invention

[0011] This summary is used to introduce a series of concepts that are further described in the detailed description of the present disclosure in a simplified format. This summary is neither intended to identify the key or essential inventive concepts of the present disclosure nor to determine the scope of the present disclosure.

[0012] According to one aspect of the present disclosure, a method for managing a virtual session is provided. The method may include: identifying a current activity performed by a user in a virtual session. The method may include: determining at least one first parameter of the virtual session associated with the current activity. The method may include: detecting the occurrence of at least one event in a real-world environment. The method may include: determining a correlation between at least one event and at least one first parameter, and determining at least one second parameter to be associated with the current activity based on the correlation between at least one event and at least one first parameter. The method may include: converting the virtual session by modifying at least one first parameter based on at least one second parameter.

[0013] According to one aspect of the present disclosure, a device for converting a virtual session is provided. The device includes a memory and a processor communicatively coupled to the memory. The processor may be configured to identify a current activity performed by a user in a virtual session. The processor may be configured to determine at least one first parameter of the virtual session associated with the current activity. The processor may be configured to detect the occurrence of at least one event in a real-world environment. The processor may be configured to determine a correlation between at least one event and at least one first parameter. The processor may be configured to determine at least one second parameter to be associated with the current activity based on the correlation between at least one event and at least one first parameter. The processor may be configured to convert the virtual session by modifying at least one first parameter based on at least one second parameter.

[0014] According to one aspect of the present disclosure, a non-transitory computer-readable storage medium storing instructions is provided, which, when executed by a processor of a device, causes the device to perform operations. The operation may include identifying a current activity performed by a user in a virtual session. The operation may include determining at least one first parameter of the virtual session associated with the current activity. The operation may include detecting the occurrence of at least one event in a real-world environment. The operation may include determining a correlation between at least one event and at least one first parameter. The operation may include determining at least one second parameter to be associated with the current activity based on the correlation between at least one event and at least one first parameter. The operation may include converting the virtual session by modifying at least one first parameter based on at least one second parameter.

[0015] According to one aspect of the present disclosure, a system for converting a virtual session is provided. The system includes a controller configured to: detect a current activity performed by a user in a virtual session, select at least one first parameter of the virtual session associated with the current activity, detect the occurrence of at least one event in a real-world environment, determine a correlation between the at least one event and the at least one first parameter, calculate at least one second parameter to be associated with the current activity based on the correlation, and convert the virtual session by modifying at least one first parameter based on the at least one second parameter.

[0016] According to one aspect of the present disclosure, a method for enhancing the experience of a user immersed in a virtual session is provided. The method includes: identifying the occurrence of at least one event in a real-world environment near the user while the user is immersed in the virtual session. The method also includes: analyzing at least one entity of the virtual session currently being accessed by the user with reference to the occurrence of the at least one event. The method also includes: generating a change in at least one entity of the virtual session so that at least one impact on the user caused by the occurrence of the at least one event is controlled. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0018] Figure 1 A block diagram depicting an environment of a system for translating a virtual session based on events in a real-world environment according to an embodiment of the present disclosure is shown;

[0019] Figure 2 A block diagram of a system according to an embodiment of the present disclosure is shown;

[0020] Figure 3 A block diagram of a controller of a system according to an embodiment of the present disclosure is shown;

[0021] Figure 4A and Figure 4B An exemplary use case of depicting a virtual session conversion based on an event in the real world according to an embodiment of the present disclosure is shown;

[0022] Figure 5A and Figure 5B Another exemplary use case of depicting a virtual session conversion based on an event in the real world according to an embodiment of the present disclosure is shown;

[0023] Fig. 6A and Figure 6B Another exemplary use case of depicting a virtual session conversion based on an event in the real world according to an embodiment of the present disclosure is shown;

[0024] Fig. 7A and Figure 7B Another exemplary use case of depicting a virtual session conversion based on an event in the real world according to an embodiment of the present disclosure is shown;

[0025] Fig. 8A and Figure 8B Another exemplary use case of depicting a virtual session conversion based on an event in the real world according to an embodiment of the present disclosure is shown;

[0026] Fig. 9A and Fig. 9B Another exemplary use case of depicting a virtual session conversion based on an event in the real world according to an embodiment of the present disclosure is shown; and

[0027] Fig.10 A flow chart depicting an exemplary method for translating a virtual session based on events in a real-world environment according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0028] In order to promote an understanding of the principles of the present disclosure, reference is made to various embodiments and the language used to describe these embodiments. It should be understood that this is not meant to limit the scope of the present disclosure, and such changes and / or further modifications to the described system, and / or such further applications of the principles of the present disclosure described herein, are all generally contemplated by those skilled in the art to which the present disclosure relates.

[0029] It should be understood by those skilled in the art that the foregoing general description and the following detailed description are intended to explain the present disclosure but are not intended to limit the present disclosure.

[0030] In addition, those skilled in the art will recognize that the elements in the drawings are shown for the sake of brevity and may not necessarily be drawn to scale. For example, the flow charts illustrate the methods in terms of the most prominent steps involved in order to help improve the understanding of various aspects of the present disclosure. In addition, with respect to the construction of the device, one or more components of the device may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details relevant to understanding the embodiments of the present disclosure so as not to obscure the drawings with details that will be clear to those of ordinary skill in the art having the benefit of the description herein.

[0031] References throughout this specification to "on one hand," "on the other hand," or similar language indicate that a particular feature, structure, or characteristic described in conjunction with an embodiment is included in at least one embodiment of the present disclosure. Thus, the phrases "in an embodiment," "in another embodiment," and similar language appearing throughout this specification may, but do not necessarily, all refer to the same embodiment.

[0032] The terms "comprises", "includes" or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process or method that includes a list of steps includes not only those steps but may also include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or subsystems or elements or structures or components preceded by "comprises ..." does not exclude the presence of other devices or other subsystems or other elements or other structures or other components or additional devices or additional subsystems or additional elements or additional structures or additional components, without further constraints.

[0033] The present disclosure is generally directed to a method, apparatus, and system for converting a virtual session based on the occurrence of an event in the real world, wherein the real world may include an Internet of Things (IoT) environment. For example, when a user is immersed in a virtual session, an event that occurs may cause an inconvenient impact on the user's current activity in the virtual session. Therefore, the present disclosure can convert the virtual session so that the user continues to perform the current activity without the inconvenience and / or with reduced inconvenience.

[0034] Figure 1 A block diagram of a real-world environment 100 depicting a system for translating a virtual session based on events in the real-world environment 100 according to an embodiment of the present disclosure is shown. Figure 2 A block diagram of a system 200 for converting a virtual session based on an event in a real world environment 100 according to an embodiment of the present disclosure is shown. For simplicity, the system 200 for converting a virtual session based on an event in a real world environment 100 is interchangeably referred to as the system 200 hereinafter.

[0035] refer to Figure 1 and Figure 2 The system 200 may be implemented between a user 102a wearing a virtual session device 104 and an electronic device 108 in a real world environment 100. The virtual session device 104 may be configured to display a virtual session 106 within a field of view of the user 102a.

[0036] In an embodiment, the electronic device 108 may be provided in a real world environment 100 such as, but not limited to, a residential location or a commercial location. The electronic device 108 may be referred to as a smart device, and may include, but is not limited to, a refrigerator, an air conditioner, a microwave oven, a television, a smart watch, a wearable device, a voice-controlled virtual assistant, an IoT device, etc. The electronic device 108 may have the ability to interact with the user 102a and / or the virtual session device 104. For example, the electronic device 108 may trigger the occurrence of an event and / or may detect that an event has occurred in the real world environment 100.

[0037] The system 200 may include a virtual session device 104. The virtual session device 104 may include, for example, a head mounted display (HMD) configured to display images of both the physical world and / or virtual objects within the user's field of view. For example, the user 102a may wear the virtual session device 104 on the forehead to immerse in a virtual session 106, such as but not limited to a metaverse session. In an embodiment, the virtual session device 104 may include, but is not limited to, a tablet personal computer (PC), a personal digital assistant (PDA), a mobile device, a palm computer, a laptop computer, a desktop computer, a server, a cloud server, a remote server, a communication device, an HMD, or any other device that can be controlled via a network (e.g., wired or wireless) and / or is capable of executing a set of instructions (sequential or otherwise) that specifies actions to be taken by the device.

[0038] In an embodiment, the system 200 may be connected to a network 210 for storing information related to the virtual session, such as, but not limited to, a cloud or edge network.

[0039] The system 200 may include an application 202 configured to be installed in the virtual session device 104. In an embodiment, the application 202 may be communicatively coupled to the electronic device 108. In an alternative or additional embodiment, the system 200 may receive user input through the application 202. The application may also be configured to render an immersive experience of the virtual session 106 for the user 102a on a display unit 208 of the system 200. The display unit 208 may be an integrated part of the virtual session device 104, providing the user 102a with an immersive experience of the virtual session 106. For example, when the user 102a is immersed in the virtual session 106, the user 102a may perform a current activity in the virtual session 106.

[0040] The system 200 may include a storage unit 204 configured to store data related to the operation of the system 200. For example, the storage unit 204 may be configured to save a user profile specific to the virtual session 106. In an embodiment, the storage unit 204 may include a non-transitory computer-readable medium, including but not limited to volatile memory (e.g., static random access memory (SRAM) and dynamic random access memory (DRAM)) and / or non-volatile memory (e.g., read-only memory (ROM), erasable programmable ROM (EEPROM), flash memory, hard disk, optical disk, magnetic tape, etc.).

[0041] In an embodiment, system 200 may include a controller 206 in communication with application 202 , display unit 208 , and storage unit 204 . Figure 32 shows a block diagram of the controller 206 according to an embodiment of the present disclosure. The controller 206 may include, but is not limited to, a processor 302, a memory 304, a module 306, and a data module 308. The module 306 and the memory 304 may be coupled to the processor 302.

[0042] In an embodiment, the processor 302 may include a single processing unit. In an optional or additional embodiment, the processor 302 may include multiple processing units. Alternatively or additionally, each processing unit may include multiple computing units. The processor 302 may include one or more microprocessors, microcomputers, microcontrollers, digital signal processors (DSPs), central processing units (CPUs), state machines, logic circuits, and / or any device that can manipulate signals based on operational instructions. In other capabilities, the processor 302 may be configured to obtain and execute computer-readable instructions and data stored in the memory 304.

[0043] Memory 304 may include non-transitory computer-readable media including, but not limited to, volatile memory (eg, SRAM, DRAM) and / or non-volatile memory (eg, ROM, EEPROM, flash memory, hard disk, optical disk, tape, etc.).

[0044] Module 306 may include routines, programs, objects, components, data structures, etc. that can perform specific tasks and / or implement data types. Alternatively or additionally, module 306 may be implemented as one or more signal processors, one or more state machines, logic circuits, and / or other devices or components that can manipulate signals based on operating instructions.

[0045] In some embodiments, module 306 may be implemented in hardware, instructions executed by a processing unit, and / or a combination thereof. The processing unit may include a computer, a processor (e.g., processor 302), a state machine, a logic array, or other suitable device capable of processing instructions. The processing unit may include a general-purpose processor (GPU) that can execute instructions to enable the general-purpose processor to perform the required tasks, or the processing unit may be dedicated to performing the required functions. In another optional or additional embodiment, module 306 may include machine-readable instructions (e.g., software) that, when executed by a processor / processing unit, can perform any of the described functions.

[0046] In an embodiment, the module 306 may include a detection module 310, a determination module 312, and a conversion module 314. The detection module 310, the determination module 312, and the conversion module 314 may communicate with each other. The data module 308 may serve as a repository for storing data processed, received, and / or generated by one or more modules 306.

[0047] refer to Figures 1 to 3, the detection module 310 may be configured to detect a current activity performed by the user 102a in the virtual session 106. That is, the current activity may represent an ongoing activity that may be similar to an activity in the real world, but may be performed in the virtual session 106 (e.g., a metaverse session). For example, the avatar 102b may be performing a current activity in the metaverse session, such as, but not limited to, shopping in a mall, playing a game, meeting with other users and / or user avatars, etc.

[0048] In an embodiment, the detection module 310 may be configured to detect a current activity performed by the user 102a in the virtual session 106 based on at least one or more of (but not limited to) audio signals, location, time, avatar, and event information associated with the virtual session 106 .

[0049] In an alternative or additional embodiment, the detection module 310 can be configured to determine a first parameter associated with the current activity. The first parameter can represent a set of conditions that the user 102a can perceive through the avatar 102b in the virtual session 106 to achieve the user's intention. For example, the first parameter associated with the current activity can include, but is not limited to, the speed of the avatar 102b, the exploration area, the current volume of the avatar 102b or the virtual session 106. That is, the first parameter can be dependent and can affect the current activity, so that changes in the first parameter can transform the current activity in the virtual session 106.

[0050] Alternatively or additionally, the detection module 310 may be configured to detect a user intent to perform a current activity in the virtual session 106. The user intent may indicate a goal and / or task that the user 102a may be trying to achieve in the virtual session. For example, while performing the current activity, the user 102a may have a user intent to purchase a smartphone from a virtual electronics store present in the virtual session 106. In such an example, a first parameter associated with the current activity may affect the user intent in the virtual session 106. That is, for example, when the first parameter includes an exploration area in the virtual session 106, the first parameter may affect the user's intent to purchase a smartphone by affecting the time it takes the user 102a to complete the goal and / or task of purchasing a smartphone.

[0051] In an embodiment, the detection module 310 may be configured to detect the occurrence of an event in the real-world environment 100. The event may indicate a real-world occurrence while the user 102a is immersed in the virtual session 106. For example, the event may include an upcoming taxi notification, a doorbell ringing, a body vital sign notification from a smartwatch, a microwave humming, etc. That is, the event may generally involve an occurrence in the real world, which may affect the immersive experience of the user 102a in the virtual session 106. For example, the user 102a may want to pay attention to the real-world event, but doing so may cause inconvenience to the user 102a in the ongoing virtual session 106. As another example, the event may occur due to an electronic device 108 in the real-world environment 100. In such an example, the electronic device 108 (e.g., a washing machine) may generate a notification beep, which may be considered an event that causes inconvenience to the user 102a who is immersed in the ongoing virtual session 106. Due to the notification beep, the user 102a may wish to stop and / or pause the ongoing virtual session 106 and stop (and / or address) the notification beep that inconveniences the user 102a. In an embodiment, the detection module 310 may be in communication with the determination module 312.

[0052] In an embodiment, the determination module 312 may be configured to determine a correlation between an event occurring in the real world environment 100 and a first parameter associated with a current activity performed by the user 102a in the virtual session 106. The correlation may indicate an impact of the event occurring on the first parameter. Alternatively or additionally, the determination module 312 may be configured to predict an impact on the current activity performed by the user 102a in the virtual session 106 triggered in response to the event occurring. For example, the impact may indicate an impact level of inconvenience caused by the event occurring. Since the event may also occur due to the electronic device 108, the determination module 312 may be configured to associate the impact, the device parameter, and the first parameter associated with the current activity. For example, the correlation determined by the determination module 312 may provide the system 200 with a threshold value of an inconvenience impact level caused by the real world event and / or the real world event in the virtual session 106. In an embodiment, the determination module 312 may be configured to determine a second parameter to be associated with the current activity based on the correlation.

[0053] Similar to the first parameter, the second parameter may represent a set of conditions that implement a change in the user's intention that the user 102a may perceive through the avatar 102b in the virtual session 106 when predicting an impact and / or inconvenience due to an event in the real world. In an embodiment, the second parameter associated with the current activity may include, but is not limited to, a changing speed of the avatar 102b, a changing location hint, an exploration area, a change in the current volume of the avatar 102b and / or the virtual session 106, and the like. For example, while performing a current activity (e.g., shopping), the user 102a may have a user intention to purchase a smartphone from a virtual electronic store present in the virtual session 106. In such an example, when an event occurs in the real world that causes inconvenience to the user 102a, the second parameter (e.g., exploration area) may be modified and / or reduced so that the user 102a can complete the user's intention to purchase, and thus can quickly focus on (e.g., process) the event occurring in the real world (e.g., focus on a taxi arriving in the real world).

[0054] That is, the second parameter determined by the determination module 312 may be different from the first parameter and may transform the virtual session 106 for the user 102a. The second parameter may be determined to reduce inconvenience caused by real-world events that may further affect the user's goals and / or tasks in the metaverse session. In an embodiment, the determination module 312 may communicate with the transformation module 314.

[0055] In an embodiment, the transition module 314 can be configured to transition the virtual session 106 by modifying the first parameter associated with the current activity based on the determined second parameter. Therefore, the second parameter can be used to form a set of conditions configured to transition the virtual session 106 so that the user 102a can continue to perform the current activity without being affected by events occurring in the real world on the virtual session 106.

[0056] Figure 4A and Figure 4B An exemplary use case depicting transitioning a virtual session 106 based on events in a real-world environment 100 according to an embodiment of the present disclosure is shown.

[0057] refer to Figure 4A, the user 102a may be immersed in the virtual session 106. For example, the virtual session 106 may represent a shopping mall. In such an example, while the user 102a, through the avatar 102b, may be performing a current activity of shopping in the shopping mall of the virtual session 106, the electronic device 108, which may be a smartphone, may determine that the user 102a has booked a taxi that may be expected to arrive in 15 minutes. That is, the system 200 in communication with the electronic device 108 may detect an upcoming taxi as an event occurring in the real world that may cause inconvenience to the current activity (e.g., shopping by the user 102a in the virtual session 106).

[0058] [Table 1]

[0059]

[0060] For example, with reference to Table 1, parameters associated with the current activity may be provided. Obviously, for example purposes, only limited parameters are provided. The controller 206 may determine a first parameter associated with shopping to include the following parameters: for example, but not limited to, the avatar 102b may move normally, and the exploration area may include a wide area, which may include stores 402a, 402b, 402c, and 402d. Alternatively or additionally, the controller 206 may detect that the user's intention may be to arrive at the store 402d to complete the goal and / or task associated with shopping. In addition, the controller 206 in communication with the electronic device 108 may detect that a taxi arrives within 15 minutes as an event that may cause inconvenience to the user 102a. For example, the inconvenience may be related to the user 102a being unable to complete shopping in the virtual session 106. Therefore, the controller 206 may calculate the impact level of such an event to associate the event with the first parameter.

[0061] refer to Figure 4B , the controller 206 may predict an impact triggered in response to a real-world event (e.g., a taxi arriving in 15 minutes) as equivalent to a high priority and / or high threshold event. Therefore, the controller 206 may determine a second parameter to be associated with the current activity (e.g., shopping) so that the user 102a can complete the user intent of purchasing a smartphone before the taxi arrives.

[0062] [Table 2]

[0063]

[0064] For example, referring to Table 2 showing modification parameters associated with the current activity, the controller 206 may modify the first parameter. As shown in Table 2, the controller 206 may increase the speed of the avatar 102b, and / or may modify the exploration area to a small area so that the store 402d may be closer to the avatar 102b. That is, the modification of the first parameter may help the user 102a perform the shopping task before the taxi arrives, thereby reducing the impact level of the inconvenience.

[0065] Figure 5A and Figure 5B Another exemplary use case depicting transitioning a virtual session 106 based on events in a real-world environment 100 according to an embodiment of the present disclosure is shown.

[0066] refer to Figure 5A , the user 102a may be immersed in a virtual session 106. For example, the virtual session 106 may represent a virtual conference room. Figure 5A , table 502a may provide a first parameter of the current activity and a value corresponding to the first parameter. For example, table 502a may provide a first parameter determined to be associated with the current activity of the virtual meeting, such as, but not limited to, "number of avatars displayed", "audio of the virtual session", and "captions". The corresponding value may indicate a characteristic of the first parameter.

[0067] refer to Figure 5B , while the user 102a, through the avatar 102b, may be performing a current activity of meeting with other different avatars in the virtual session 106, the electronic device 108 may include an electronic buzzer / alarm, which may begin to buzz an alarm and / or make a noise.

[0068] Because an event occurred in the real world that may cause inconvenience to the current activity (e.g., the meeting of the user 102a in the virtual session 106), the controller 206 in communication with the electronic device 108 may detect a buzzing alarm in the electronic buzzer. Alternatively or additionally, the controller 206 may detect that the intention of the user 102a may be to listen to the narration of other avatars present in the virtual session 106. In addition, the system 200 in communication with the electronic device 108 may detect the buzzing alarm as an inconvenience caused to the user 102a immersed in the virtual session 106. This inconvenience may be that the user 102a cannot listen to the narration of other avatars in the virtual session 106 due to the noise generated by the buzzing alarm. Therefore, the controller 206 may calculate the impact level of such an event to associate the event with the first parameter.

[0069] In an embodiment, the controller 206 may predict an impact triggered in response to a real-world event (e.g., a buzzing alarm) as equivalent to a high priority and / or high threshold event. Accordingly, the controller 206 may determine a second parameter to be associated with the current activity (e.g., the user 102a is unable to listen to the narration of other avatars).

[0070] For example, referring to table 502b, the controller 206 may be configured to modify the value of the first parameter to transform the virtual session 106 so that the user 102a can continue to perform the current activity in the virtual session 106 without being affected by the real-world events. For example, the "number of avatars displayed" may be reduced (e.g., from "all" to four (4)), the "audio of the virtual session" may be increased (e.g., from medium volume to high volume), and / or "captions" may be enabled. Therefore, the modification of the first parameter may help the user 102a conduct the virtual meeting and may reduce the level of inconvenience.

[0071] Fig. 6A and Figure 6B Another exemplary use case depicting transitioning a virtual session 106 based on events in a real-world environment 100 according to an embodiment of the present disclosure is shown.

[0072] refer to Fig. 6A , user 102a may be immersed in a virtual session 106. For example, virtual session 106 may represent a virtual conference room where user 102a is participating in a current activity of talking with several other avatars. Fig. 6A , table 602a may provide a first parameter of the current activity and a value corresponding to the first parameter. For example, table 602a may provide a first parameter determined to be associated with the current activity of the virtual meeting, such as, but not limited to, "number of avatars displayed", "audio of virtual session", "avatar focus", and "captions". The corresponding value may indicate a characteristic of the first parameter.

[0073] refer to Figure 6B , while the user 102a, through the avatar 102b, may be performing a current activity of meeting with other different avatars in the virtual session 106, the user 102a may feel inconvenienced. For example, the inconvenience may be caused by the surrounding conditions of the real world environment 100. The inconvenience may include, but is not limited to, an increased heart rate, palpitations, and sweating. In an embodiment, the user 102a may be wearing a smart watch that can detect the inconvenience of the user 102a. Therefore, the controller 206 can determine the correlation between the inconvenience felt by the user 102a and the current activity.

[0074] As shown in table 602b, the controller 206 may be configured to modify the value of the first parameter to transition the virtual session 106 so that the user 102a may continue to perform the current activity in the virtual session 106 without being affected by the real-world events. For example, the "number of avatars displayed" may be reduced (e.g., from "all" to four (4)), the "audio of the virtual session" may be increased (e.g., from a medium volume to a high volume), "avatar focus" may be enabled, and / or "subtitles" may be enabled. Thus, the impact level of the inconvenience caused to the user 102a may be reduced.

[0075] Fig. 7A and Figure 7B Another exemplary use case depicting transitioning a virtual session 106 based on events in a real-world environment 100 according to an embodiment of the present disclosure is shown.

[0076] refer to Fig. 7A , the user 102a may be immersed in a virtual session 106. For example, the virtual session 106 may represent a virtual conference room where the user 102a may participate in the current activity of viewing presentations presented by several other avatars in the same virtual session 106. Fig. 7A , table 702a may provide a first parameter of the current activity and a value corresponding to the first parameter. For example, table 702a may provide a first parameter determined to be associated with the current activity of the virtual meeting, such as, but not limited to, "number of avatars displayed", "status of the virtual session", "virtual session recording", and "captions". The corresponding value may indicate a characteristic of the first parameter.

[0077] refer to Figure 7B , the doorbell 701 of the user's home may ring. Therefore, the controller 206 can determine the event of the doorbell 701 ringing and its impact on the inconvenience caused in the virtual session 106. The inconvenience may be caused by, for example, noise. In an embodiment, the controller 206 can determine the occurrence of the doorbell 701 ringing as a high priority event. Alternatively or additionally, the controller 206 can determine the correlation between the inconvenience experienced by the user 102a and the current activity.

[0078] As shown in table 702b, the controller 206 may be configured to modify the value of the first parameter to transform the virtual session 106 so that the user 102a may continue to perform the current activity in the virtual session 106 without being affected by the real-world events. For example, the "number of avatars displayed" may be reduced (e.g., from "all" to four (4)), the "status of the virtual session" may be paused (e.g., from "in progress" to "paused"), the "virtual session recording" may be enabled, and / or the "captioning" may be enabled. Thus, the impact level of the inconvenience caused to the user 102a may be reduced.

[0079] Fig. 8A and Figure 8B Another exemplary use case depicting transitioning a virtual session 106 based on events in a real-world environment 100 according to an embodiment of the present disclosure is shown.

[0080] refer to Fig. 8A , the user 102a may be immersed in the virtual session 106. For example, the virtual session 106 may represent an exhibition, where the user 102a may participate in the current activities of visiting booths / kiosks to view the items on display. Fig. 8A , table 802a may provide a first parameter of the current activity and a value corresponding to the first parameter. For example, table 802a may provide a first parameter determined to be associated with the current activity of the virtual meeting, such as, but not limited to, "number of avatars displayed", "status of the virtual session", "follow voice cursor", and / or "navigation". The corresponding value may indicate a characteristic of the first parameter.

[0081] refer to Figure 8B , while the user 102a, through the avatar 102b, may be performing a current activity of visiting a stall / kiosk, the user 102a may be inconvenienced. For example, the inconvenience may be due to water spilled on the floor near the user 102a, such that the user 102a may be inconvenienced while walking. In an embodiment, the inconvenience may affect the user's ability to focus and / or provide attention when viewing items displayed in the virtual session 106. Therefore, the controller 206 may detect the water spillage in the real world environment 100 and the related effects of the inconvenience. Alternatively or additionally, the controller 206 may determine a correlation between the inconvenience felt by the user 102a and the current activity.

[0082] As shown in table 802b, the controller 206 may be configured to modify the value of the first parameter to convert the virtual session 106 so that the user 102a can continue to perform the current activity in the virtual session 106 without being affected by the real-world events. For example, the "number of avatars displayed" may be reduced (e.g., from "all" to "none"), the "status of the virtual session" may be paused (e.g., from "in progress" to "paused"), the "follow voice cursor" may be enabled, and / or the "navigation" may be enabled. Thus, the impact level of the inconvenience caused to the user 102a may be reduced.

[0083] Fig. 9A and Fig. 9B Another exemplary use case depicting transitioning a virtual session 106 based on events in a real-world environment 100 according to an embodiment of the present disclosure is shown.

[0084] refer to Fig. 9A, the user 102a may be immersed in the virtual session 106. For example, the virtual session 106 may include a video game, wherein the user 102a may be immersed in playing the video game and / or experiencing the video game. Fig. 9A , table 902a may provide a first parameter of the current activity and a value corresponding to the first parameter. For example, table 902a may provide a first parameter determined to be associated with the current activity of the virtual meeting, such as, but not limited to, "speed of the virtual session", "level", "number of objects", and / or "direction". The corresponding value may indicate a characteristic of the first parameter.

[0085] refer to Fig. 9B , in the real world environment 100, another user may be cooking in the surrounding area of ​​the user 102a, while the user 102a may be immersed in playing a video game through the virtual session 106. In an embodiment, the user 102a may experience coughing, sneezing and / or sudden behavioral and physiological changes due to the smoke generated by cooking. Therefore, the user 102a may feel inconvenienced when playing the video game. That is, the behavioral and physiological changes that cause inconvenience may affect the user's ability to play the video game in the virtual session 106. Therefore, the controller 206 can detect the behavioral and physiological changes in the real world environment 100 and the related effects of inconvenience. Alternatively or additionally, the controller 206 can determine the correlation between the inconvenience felt by the user 102a and the current activity. In an embodiment, the controller 206 can convert the virtual session 106 by modifying some parameters of the video game.

[0086] As shown in table 902b, the controller 206 may be configured to modify the value of the first parameter to convert the virtual session 106 so that the user 102a can continue to perform the current activity in the virtual session 106 without being affected by the real-world events. For example, the "speed of the virtual session" may be reduced (e.g., from "default" to "slow"), the "level" may be reduced (e.g., from "professional" to "easy"), the "number of objects" may be reduced (e.g., from 56 / minute to 28 / minute), and / or the "direction" may be changed. Thus, the impact level of the inconvenience caused to the user 102a may be reduced.

[0087] Fig.10 1 is a flowchart depicting a method 1000 for converting a virtual session 106 based on an event in a real world environment 100 according to an embodiment of the present disclosure. The method 1000 may be a computer-implemented method, for example, executed by the controller 206. For simplicity, the method 1000 may be described in detail in FIG. Fig.10 The above reference is omitted in the description Figures 1 to 3 The structural and operational features of system 200 are described.

[0088] At block 1002, the method 1000 may include detecting a current activity performed by the user 102a in the virtual session 106 and a first parameter associated with the current activity. In an embodiment, the method 1000 may include determining the current activity performed by the user 102a in the virtual session 106 based on one or more of (but not limited to) an audio signal, a location, a time, an avatar, and event information associated with the virtual session 106.

[0089] Alternatively or additionally, the method 1000 can include deriving a user's intent to perform a current activity in the virtual session 102. In an alternative or additional embodiment, the method 1000 can include determining a first parameter that affects the user's intent in the virtual session 106.

[0090] At block 1004 , the method 1000 may include detecting an occurrence of an event in the real-world environment 100 . For example, the occurring event may indicate an event in the real world that may have an impact that may inconvenience the immersive experience of the user 102 a in the virtual session 106 .

[0091] In an embodiment, the method 1000 may include detecting an electronic device 108 in the real world environment 100. In an alternative or additional embodiment, the method 1000 may include detecting a device parameter associated with the detected electronic device 108. For example, the method 1000 may include detecting an event and / or changing a device parameter when an impact is detected in the real world. That is, the device parameter may be affecting a current activity being performed by the user 102a in the virtual session 106.

[0092] At block 1006, the method 1000 may include determining a correlation between an event in the real-world environment 100 and a first parameter associated with a current activity performed by the user 102a in the virtual session 106. In an embodiment, the method 1000 may include predicting an impact triggered in response to the event on the current activity performed by the user 102a in the virtual session 106. For example, the impact may indicate an inconvenience that may affect the user 102a immersed in the virtual session 106.

[0093] At block 1008, method 1000 may include determining a second parameter to be associated with the current activity based on the correlation. For example, method 1000 may include associating an effect that may be triggered in response to an event in the real world, a device parameter, and a first parameter associated with the current activity to determine the second parameter. In an embodiment, the second parameter may be associated with the current activity.

[0094] At block 1010, the method 1000 may include converting the virtual session 106 by modifying a first parameter associated with the current activity based on the determined second parameter. For example, the virtual session 106 may be converted based on the second parameter. That is, the virtual session 106 may be modified based on the second parameter so that the user 102a can continue to perform the current activity without being affected by events occurring in the real world on the virtual session 106.

[0095] Advantageously, as described above, aspects of the present disclosure may provide for detection of events in the real world and / or other external events that may inconvenience a user who may be immersed in a virtual session. In addition, aspects of the present disclosure may provide for determining the goals and / or tasks of a user immersed in a virtual session, and may change the parameters of the virtual session accordingly. Such changes in the parameters of the virtual session may help the immersed user complete the goals and / or tasks in the virtual session with reduced inconvenience. Alternatively or additionally, aspects of the present disclosure may provide an enhanced user experience for an immersed user in the metaverse, because the user may continue and / or complete the goals and / or tasks in the metaverse session when events occur in the real world environment. In addition, aspects of the present disclosure provide for changes in metaverse parameters, which may provide a customized experience for the immersed user based on the current activity of the immersed user and the impact of external events that may inconvenience the immersed user.

[0096] Although specific language has been used to describe the present disclosure, no limitation is intended thereby. It will be apparent to those skilled in the art that various working modifications may be made to the methods to implement the inventive concepts taught herein.

[0097] The accompanying drawings and the foregoing description give examples of embodiments. It will be appreciated by those skilled in the art that one or more of the elements described may be well combined into a single functional element. Alternatively, some elements may be divided into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, the order of the processing described herein may be changed and is not limited to the manner described herein.

Claims

1. A method for managing a virtual session, the method comprising: identifying ( 1002 ) a current activity performed by a user in the virtual session; determining at least one first parameter of the virtual session associated with the current activity; detecting (1004) the occurrence of at least one event in the real-world environment; determining (1006) a correlation between the at least one event and the at least one first parameter; determining ( 1008 ) at least one second parameter to be associated with the current activity based on a correlation between the at least one event and the at least one first parameter; as well as The virtual session is transformed (1010) by modifying the at least one first parameter based on the at least one second parameter.

2. The method according to claim 1, wherein: Selecting the at least one first parameter comprises: identifying a user intent to perform the current activity in the virtual session; and The at least one first parameter that influences the user intent in the virtual session is determined.

3. The method according to claim 1, further comprising: detecting at least one electronic device in the real-world environment; as well as At least one device parameter associated with at least one detected electronic device that affects the current activity is detected.

4. The method according to claim 3, further comprising: In response to the at least one event, predicting at least one impact on the current activity; as well as associating the at least one influence, the at least one device parameter and the at least one first parameter, Therein, the at least one second parameter to be associated with the current activity is determined based on a correlation among the at least one influence, the at least one device parameter, and the at least one first parameter.

5. The method according to claim 1, wherein: The correlation indicates an impact of the at least one event on the at least one first parameter.

6. The method according to claim 5, wherein: The impact indicates an impact level of inconvenience caused by the at least one event to the user.

7. The method according to claim 1, wherein: Converting the virtual session includes: The virtual session is modified based on the at least one second parameter so that the user continues to perform the current activity in the virtual session.

8. The method according to claim 1, further comprising: The virtual session is modified so that the user continues to perform the current activity in the virtual session and the influence of the at least one event in the virtual session is reduced.

9. The method according to claim 1, further comprising: The current activity performed by the user in the virtual session is determined based on at least one audio signal, location, time, and event information associated with the virtual session.

10. The method according to claim 1, further comprising: tracking an occurrence of said at least one event in said real-world environment, Wherein, the at least one first parameter is determined based on determining that the at least one event has occurred in the real-world environment.

11. An apparatus (200) for managing a virtual session, the apparatus comprising: Memory (304); as well as A processor (302) is communicatively coupled to the memory and is configured to: identifying a current activity performed by a user in the virtual session; determining at least one first parameter of the virtual session associated with the current activity; detecting the occurrence of at least one event in a real-world environment; determining a correlation between the at least one event and the at least one first parameter; determining at least one second parameter to be associated with the current activity based on a correlation between the at least one event and the at least one first parameter; as well as The virtual session is transformed by modifying the at least one first parameter based on the at least one second parameter.

12. The device according to claim 11, wherein The controller is further configured to operate according to the method of one of claims 2 to 10 .

13. A non-transitory computer-readable storage medium storing instructions which, when executed by a processor (302) of a device (200), cause the device (200) to perform operations comprising: identifying a current activity performed by the user in the virtual session; determining at least one first parameter of the virtual session associated with the current activity; detecting the occurrence of at least one event in a real-world environment; determining a correlation between the at least one event and the at least one first parameter; determining at least one second parameter to be associated with the current activity based on a correlation between the at least one event and the at least one first parameter; as well as The virtual session is transformed by modifying the at least one first parameter based on the at least one second parameter.

14. The non-transitory computer-readable storage medium of claim 13, wherein: The operations also include at least one operation according to the method of one of claims 2 to 10.

Images