An apparatus, method and computer program for generating a virtual environment

Abstract

In accordance with the present disclosure, an apparatus for generating a virtual environment, the apparatus comprising circuitry configured to: acquire first data corresponding to a simulation which recreates a first real‐world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real‐world environment; acquire second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real‐world environment; generate a virtual environment corresponding to a virtual location, and display, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real world environment.

Description

[0001] AN APPARATUS, METHOD AND COMPUTER PROGRAM FOR GENERATING A VIRTUAL ENVIRONMENT

[0002] BACKGROUND

[0003] Field of the Disclosure

[0004] The present invention relates to an apparatus, method and computer program for generating a virtual environment.

[0005] Description of the Related Art

[0006] The "background" description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in the background section, as well as aspects of the description which may not otherwise qualify as prior art at the time of filing, are neither expressly or impliedly admitted as prior art against the present invention.

[0007] Motion tracking data can be acquired to track the movement of an object. There are many different ways by which such motion tracking data (or tracking data) can be obtained. For example, tracking data can be obtained using a tracking device (such as a sensor) attached to an object. Such a sensor can include an inertial measurement unit (IMU) sensor, for example. Alternatively, tracking data can be obtained from captured image data.

[0008] The tracking data can be used to generate a simulation of an object in a virtual environment. This is particularly advantageous when applied to certain events - such as sporting events - as additional visualisations or analysis can be performed using the simulation of the object. This can lead to a greater understanding and appreciation of the event.

[0009] However, there can be a problem in that it is difficult to combine virtual objects based on tracking data acquired from different sources for display in a single virtual environment. In particular, it can be difficult to manage interactions between objects in such an environment.

[0010] It is an aim of the present disclosure to address these issues.

[0011] SUMMARY:

[0012] Embodiments of the present disclosure are defined by the appended claims. Further aspects of the present disclosure are defined by the dependent claims.

[0013] In accordance with embodiments of the disclosure, virtual objects based on tracking data acquired from different sources can be easily and efficiently combined in a single virtual environment. Indeed, use of a container within the virtual environment allows interactions between the objects in the virtual environment to be easily and appropriately managed. The present disclosure is not particularly limited to these technical effects. Other technical effects will become apparent to the skilled person when reading the disclosure.

[0014] Indeed, the foregoing paragraphs have been provided by way of general introduction, and are not intended to limit the scope of the following claims. The described embodiments, together with further advantages, will be best understood by reference to the following detailed description taken in conjunction with the accompanying drawings.

[0015] BRIEF DESCRIPTION OF THE DRAWINGS:

[0016] A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:

[0017] Figure 1 illustrates an apparatus in accordance with embodiments of the disclosure;

[0018] Figure 2 illustrates an example sporting event in accordance with embodiments of the disclosure;

[0019] Figure 3 illustrates an example apparatus in accordance with embodiments of the disclosure;

[0020] Figure 4 illustrates an example situation in accordance with embodiments of the present disclosure;

[0021] Figure 5 illustrates an example implementation of an apparatus in accordance with embodiments of the disclosure;

[0022] Figure 6 illustrates an example process flow in accordance with embodiments of the disclosure;

[0023] Figure 7 illustrates an example method in accordance with embodiments of the disclosure.

[0024] DESCRIPTION OF THE EMBODIMENTS

[0025] Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views.

[0026] Referring to Figure 1, an apparatus 1000 according to embodiments of the disclosure is shown. Typically, an apparatus 1000 according to embodiments of the disclosure is a computer device such as a personal computer or a terminal connected to a server. Indeed, in embodiments, the apparatus may also be a server. The apparatus 1000 is controlled using a microprocessor or other processing circuitry 1002. In some examples, the apparatus 1000 may be a portable computing device such as a mobile phone, laptop computer or tablet computing device.

[0027] The processing circuitry 1002 may be a microprocessor carrying out computer instructions or may be an Application Specific Integrated Circuit. The computer instructions are stored on storage medium 1004 which maybe a magnetically readable medium, optically readable medium or solid state type circuitry. The storage medium 1004 may be integrated into the apparatus 1000 or may be separate to the apparatus 1000 and connected thereto using either a wired or wireless connection. The computer instructions may be embodied as computer software that contains computer readable code which, when loaded onto the processor circuitry 1002, configures the processor circuitry 1002 to perform a method according to embodiments of the disclosure.

[0028] Additionally, an optional user input device 1006 is shown connected to the processing circuitry 1002. The user input device 1006 may be a touch screen or may be a mouse or stylist type input device. The user input device 1006 may also be a keyboard or any combination of these devices. Voice input may also be provided through a user input device 1006 such as a microphone, for example.

[0029] A network connection 1008 may optionally be coupled to the processor circuitry 1002. The network connection 1008 may be a connection to a Local Area Network or a Wide Area Network such as the Internet or a Virtual Private Network or the like. The network connection 1008 may be connected to a server allowing the processor circuitry 1002 to communicate with another apparatus in order to obtain or provide relevant data. The network connection 1002 may be behind a firewall or some other form of network security.

[0030] Additionally, shown coupled to the processing circuitry 1002, is a display device 1010. The display device 1010, although shown integrated into the apparatus 1000, may additionally be separate to the apparatus 1000 and may be a monitor or some kind of device allowing the user to visualise the operation of the system. In addition, the display device 1010 may be a printer, projector or some other device allowing relevant information generated by the apparatus 1000 to be viewed by the user or by a third party.

[0031] As explained in the Background, motion tracking data can be acquired to track the movement of an object. Motion tracking data can be used in order to generate a simulation of an object in a virtual environment. This is particularly advantageous when applied to certain events - such as sporting events - as additional visualisations or analysis can be performed using the simulation of the object. This can lead to a greater understanding and appreciation of the event.

[0032] Consider, now, Figure 2 of the present disclosure. Figure 2 of the present disclosure illustrates an example sporting event in accordance with embodiments of the disclosure. In Figure 2, the example sporting event is a soccer match. However, the sporting event may be any sport and is not particularly limited to soccer. For example, the sporting event may be ice-hockey, American football, baseball, motorsport, tennis, rugby, cricket or basketball, for example.

[0033] In this example, a first player 2002 is located on a pitch (the area on which the sporting event (here, the soccer match) is played). The first player 2002 may be playing as part of a first team. A second player 2004 is also located on the pitch. The second player 2004 may be playing as part of a second team (the second team being different from the first team).

[0034] While only two players are shown in this example, it will be appreciated that the present disclosure is not particularly limited in this regard. More generally, any number of players may be included as part of the sporting event. For example, in a soccer match, each team may comprise 11 players (so a total of 22 players may be taking part in the soccer match at any given time). In addition, a number of additional people may also be present on the pitch who are not part of either of the teams taking part in the sporting event. The additional people may include officials who are adjudicating the sporting event (such as a referee, for example).

[0035] As shown in Figure 2 of the present disclosure, one or more objects may also be included as part of the sporting event. For example, an object such as a football 2006 may be included on the pitch.

[0036] In this example - where the sporting event is a soccer match - each player may aim to control the football by kicking the football such that it moves into a predefined area (the goal area). If a player moves the football such that it is located in this predefined area, then the team on which the player is playing will score a goal. The winner of the soccer match will be the team who score the most goals during the duration of the match.

[0037] A player who does not currently control the possession of the football (such as player 2002 in this example) will tackle the player 2004 who is currently in possession of the football, such that they gain possession of the football.

[0038] Tracking data can be obtained to track the movement of the players 2002, 2004 and the football 2006 during the course of the soccer match. The tracking data can be obtained using a tracking device (such as a sensor). Alternatively, or in addition, the tracking data can be obtained from captured image data. This tracking data can be used in order to generate a simulation of the sporting event.

[0039] The way in which the tracking data from the soccer match is used in order to generate a simulation of the soccer match is not particularly limited in the present disclosure. For example, a virtual character may be animated (within the simulation) using tracking data from the soccer match (the real-world environment). Virtual objects (such as a ball) may also be animated using tracking data from the soccer match (i.e. based on the tracking data of a ball within the real-world environment).

[0040] Thus, any suitable method for generating the simulation based on the tracking data known in the art may be used as required.

[0041] Once generated, the simulation can be used in order to explore the sporting event in more detail. However, while the simulation can be generated based on the tracking data acquired from the sporting event, it can be difficult to fully realise the potential for further analysis of the sporting event through the simulation. That is, it can be difficult for a person who is not part of the sporting event to perform analysis and visualisations using the simulation.

[0042] For example, it can be very difficult when a person (such as a commentator) wishes to perform visualisations or analysis of the simulation which can be viewed by another person.

[0043] More generally, it can be very difficult to combine virtual objects based on tracking data acquired from different sources for display in a single virtual environment. Furthermore, it can be difficult to manage interactions between these virtual objects in a single virtual environment while retaining authenticity of the virtual objects.

[0044] As such, for at least these reasons, an apparatus, method and computer program for generating a virtual environment are provided in accordance with embodiments of the disclosure.

[0045] <Apparatus>

[0046] As noted, an apparatus for generating a virtual environment is provided in accordance with embodiments of the disclosure. Figure 3 illustrates an example apparatus in accordance with embodiments of the disclosure.

[0047] The apparatus 3000 comprises a acquiring unit 3002, a second acquiring unit 3004 and a generating unit 3006.

[0048] The acquiring unit 3002 of apparatus 3000 is configured to acquire first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment.

[0049] The second acquiring unit 3004 of apparatus 3000 is configured to acquire second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding person in a second real-world environment.

[0050] The generating unit 3006 of apparatus 3000 is configured to generate a virtual environment corresponding to a virtual location, and display, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment. In this example, the generating unit 3006 is configured to generate the virtual environment such that the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real world environment. In this way, a single virtual environment can be easily and efficiently generated, even when different virtual objects (i.e. the avatar and the simulation) are based on tracking data acquired from different sources. The use of the container for display of the simulation or the avatar within the virtual environment ensures that interactions between the objects in the virtual environment can be easily and appropriately managed. That is, since the scaling factor is applied to the container (and not the simulation or avatar itself), the simulation or avatar can always assume that there is no scaling applied to any instance it needs. Furthermore, any incoming input can be modified to ensure it is called to the correct proportions within the container. Therefore, interactions between the objects and the virtual environment can be appropriately managed. This will be explained in more detail later.

[0051] The simulation to which the first data corresponds may comprise a virtual environment (such as a three dimensional virtual environment) in which a virtual representation of the sporting event is shown. Indeed, in this context, a simulation is a specific type of virtual environment - discussed in more detail below - which is used in order to emulate a specific real-world environment.

[0052] In examples, the simulation may be a simulation of a sporting event. That is, the first real-world environment may be a sporting environment (or sporting event). In examples, the sporting event may optionally include ice-hockey, soccer (football), American football, baseball, motorsport, tennis, rugby, cricket or basketball. Of course, embodiments of the disclosure may also be applied to other sporting events and / or events other than sporting events. Indeed, embodiments of the disclosure may more generally be applied to any physical (real-world) environment (including, for example, an environment such as a concert, a theatre performance or the like).

[0053] Tracking data can be acquired to track the movement of an object. There are many different ways by which such motion tracking data (or tracking data) can be obtained. For example, tracking data can be obtained using a tracking device (such as a sensor) attached to an object. Such a sensor can include an inertial measurement unit (IMU) sensor, for example. Alternatively, tracking data can be obtained from captured image data (e.g. using motion capture techniques, for example).

[0054] The way in which the tracking data from the sporting event (or other first real-world environment) is used in order to generate a simulation of the sporting event is not particularly limited in the present disclosure. For example, a virtual character may be animated (within the simulation) using tracking data from the sporting event (the first real-world environment). Virtual objects (such as a ball) may also be animated using tracking data from the sporting event (i.e. based on the tracking data of a ball within the real-world environment). Any suitable method for generating the simulation based on the tracking data known in the art may be used as required.

[0055] In examples, the avatar is a graphical representation of a character which is controllable by a target within second real-world environment. The target may include a person and / or an object within second real-world environment. Indeed, as an example, the target may be a person (such as a commentator or the like) holding an object which is used as part of a demonstration or illustration. In examples, the object may be a sporting object. For example, when the sporting event is a hockey match, the object may be a hockey stick. In other examples, the target may be an object such as a robot or controllable device in the real-world. However, it will be appreciated that the present disclosure is not particularly limited in this regard. The avatar may be a two-dimensional graphical representation. Alternatively, the avatar may be a three-dimensional graphical representation. The avatar may be manipulated by the target it represents. In examples, the manipulation of the avatar may be based upon the movement of the target in the real-world. That is, in examples, the movement of the target in the real-world is based on tracking data of the corresponding target in the real-world. The tracking data of the corresponding target in the real-world may be any suitable type of tracking data. For example, the tacking data can be obtained from captured image data. Alternatively, tracking data can be obtained from a sensor such as an inertial measurement unit (IMU) sensor, for example.

[0056] The simulation of the environment (such as the simulation of the sporting event) is a virtual environment which simulates an environment in the real-world. For example, when the environment is a sporting event such as an ice-hockey match, the simulation may simulate the rink, the puck, the goals and the players. On the other hand, the avatar is a single graphical representation of a character which is controllable by a person. Players within the sporting event may be represented, within the simulation, by avatars. However, the simulation may include many additional objects in addition to these players.

[0057] The tracking data for the simulation (i.e. the tracking data of the sporting event) and the tracking data for the avatar (i.e. the tracking data of the corresponding person) may be a same or a different type of tracking data. However, it will be appreciated that the tracking data of the simulation and the tracking data of the avatar may be acquired from different streams (i.e. from different devices and / or different devices located at different locations). Therefore, a source of the first data (corresponding to the simulation) and a source of the second data (corresponding to the avatar) may be different. The apparatus 3000 of the present disclosure thus combines these different sources of data within a single virtual environment (thus facilitating interactions between these different virtual objects). It will be appreciated that the virtual environment is a virtual space (or environment) which is modelled or simulated by a computer. Virtual reality is an example of a virtual environment. The virtual environment may be populated with certain objects or models. A person may perceive the virtual environment through use of a device such as a Head-Mounted Display (HMD). Alternatively, a person may perceive the virtual environment when it is displayed on a display device such as a display screen. In examples, a person may perceive the simulation from the vantage point of a virtual camera within the virtual environment.

[0058] In examples, the virtual environment may be an entirely imagined environment, which is not based on any specific real-world environment.

[0059] Furthermore, it will be appreciated that the container is a construct within the virtual environment which can be used for efficient display of a virtual object within the virtual environment. In examples, the container is a wrapper that encapsulates and contains all calculations for the display of the virtual object within the virtual environment. For example, the container may be a scale wrapper that contains all calculations for the visual-scale for the end-user in comparison to the lifesize scale that it simulates. Thus, a scaling factor can be applied to the container itself which means that no alternations or modifications are required within the container for the display of the virtual object.

[0060] While the acquiring unit 3002, second acquiring unit 3004 and generating unit 3006 are described as different units within the apparatus 3000, it will be appreciated that the present disclosure is not particularly limited in this regard. In examples, the acquiring unit 3002, second acquiring unit 3004 and generating unit 3006 may be provided as circuitry within the apparatus 3000. In examples, the may be a microprocessor carrying out computer instructions or may be an Application Specific Integrated Circuit. In examples, a single circuitry may be provided in order to perform the functions of the acquiring unit 3002, the second acquiring unit 3004 and the generating unit 3006. In examples, the functions of these units may be performed across a number of different circuits within the apparatus 3000.

[0061] Further details will now be described with reference to an example situation to which embodiments of the disclosure can be applied.

[0062] <Example Situation>

[0063] Consider, now Figure 4 of the present disclosure. Figure 4 of the present disclosure illustrates an example situation to which embodiments of the disclosure can be applied. In this example situation, an apparatus 3000 is used in order to generate a virtual environment. Indeed, in this example, the virtual environment to be generated is a studio (such as a television studio) from which a person's avatar will provide commentary on the sporting event. However, it will be appreciated that the present disclosure is not particularly limited in this respect and the virtual environment may include any suitable environment as required.

[0064] In the example of Figure 4, a target 4002 is present in the real-world. The target, in this example, is a commentator who is commentating on a sporting event taking place in a sporting environment. The target (or person) 4002 is located in a first location, which may be separate and distinct from the location at which the sporting event is taking place.

[0065] The person 4002 is, in this example, surrounded by a number of image capture devices 4000. The image capture devices 4000 capture image data of the person 4002 which are converted to tracking data of the person 4002. That is, movements made by the person 4002 are reflected in the tracking data generated from the image data of the person 4000 captured by the image capture devices 4000.

[0066] While four image capture devices are shown in this example, it will be appreciated that the present disclosure is not particularly limited in this regard. Any number of image capture devices to capture images of the person 4000 may be provided in accordance with embodiments of the disclosure. Indeed, in examples, the motion tracking data of the person 4002 may be generated without the use of the image capture devices 4000. That is, in examples, the motion tracking data of the person 4002 may be obtained through a device such as an IMU sensor.

[0067] The tracking data of the person is used in order to manipulate an avatar of that person 4002. That is, when the person 4002 moves, a corresponding movement is made also by the avatar. As previously explained, the avatar is a graphical representation of a character which is controllable by a person. The avatar may be a two-dimensional graphical representation. Alternatively, the avatar may be a three-dimensional graphical representation. In examples, the avatar may be a realistic representation of the person 4002. However, in examples, the avatar may be a graphical representation of a character which takes the place of that person.

[0068] As noted, the person 4002 is performing analysis of the sporting event taking place in the sporting environment.

[0069] In this example, the sporting event taking place in the sporting environment is a soccer match as described with reference to Figure 2 of the present disclosure. However, the present disclosure is not particularly limited in this regard. Tracking data from the sporting event in the sporting environment (such as the location of players) is used in order to generate a simulation of the sporting event. The simulation of the environment (such as the simulation of the sporting event) is a virtual environment which simulates the soccer match. The way in which the tracking data from the soccer match is used in order to generate the simulation of the soccer match is not particularly limited in the present disclosure. Indeed, any suitable method for generating the simulation based on the tracking data known in the art may be used in order to generate the simulation as required.

[0070] It will be appreciated that person 4002 may be located in a separate location which is geographically distinct from the location at which the sporting event is taking place (the sporting environment). For example, the person 4002 may be located in a building or studio separate from the sporting event (which may, for example, be located in a stadium or sporting arena). Furthermore, it will be appreciated that the tracking data used in order to generate the avatar of the person 4002 may be of a different type.

[0071] Once generated, the data corresponding to the simulation and the data corresponding to the avatar are passed to apparatus 3000. That is, in accordance with embodiments of the present disclosure, the apparatus 3000 is configured to acquire first data corresponding to a simulation which recreates a first real-world environment, the movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment and acquire second data corresponding to an avatar, the movement of the avatar being determined on the basis of tracking data of a corresponding person in a second real-world environment.

[0072] The way in which the apparatus 3000 is configured to acquire the data corresponding to the simulation and the avatar is not particularly limited in accordance with embodiments of the disclosure. In examples, the apparatus 3000 may be configured to acquire the data corresponding to the simulation and the avatar is not particularly limited in accordance with embodiments of the present disclosure. As an example, the acquiring unit 3002 and second acquiring unit 3004 of apparatus 3000 may comprise a network connection. The network connection may be a connection to a Local Area Network or a Wide Area Network such as the Internet or a Virtual Private Network or the like. The network connection may be connected to a server allowing the apparatus 3000 to communicate with another apparatus in order to obtain or provide relevant data. More generally, the apparatus 3000 may be configured to acquire the first data corresponding to the simulation and the second data corresponding to the avatar via any suitable wired or wireless connection. In examples, the first data corresponding to the simulation and the second data corresponding to the avatar may be acquired in a substantially real-time environment (i.e. as they are generated). In examples, at least one of the first data corresponding to the simulation and the second data corresponding to the avatar may be acquired at a time after the time at which they have been generated (e.g. after being held in a storage (such as a buffer), for example).

[0073] In examples, synchronization is performed between the first data corresponding to the simulation and the second data corresponding to the avatar. In examples, the second data, corresponding to the avatar, can be used as a leading time, which is directly replicated as a real-time environment. The first data corresponding to the simulation can then be synchronised against the second data of the avatar. This can be performed by comparison of the timestamps between the first data and the second data. Indeed, in examples, all tracking data includes corresponding time stamp information which can be used in order to perform synchronisation. In examples, playback of the simulation can be fully controlled and synchronised within the virtual environment. In addition, pauses, slow motion playback, rewind and replay functionality can also be controlled via an operator as the avatar.

[0074] Once the apparatus 3000 has acquired the first data corresponding to the simulation and the second data corresponding to the avatar, the generating unit 3006 of apparatus 3000 is configured to generate a virtual environment corresponding to a virtual location and display, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment.

[0075] An example virtual environment 4004 is illustrated in Figure 4 of the present disclosure.

[0076] The virtual environment is a virtual space (or environment) which is modelled or simulated by a computer. Virtual reality is an example of a virtual environment. The virtual environment may be populated with certain objects or models. Indeed, in this example, the generating unit 3006 of apparatus 3000 is configured to generate the virtual environment such that it contains both the avatar of the person 4002 and the simulation of the sporting event. The generating unit 3006 is configured to generate the virtual environment in accordance with the first data and the second data which have been acquired. Thus, the avatar 4004A of the person 4002 and the simulation 4004B of the sporting event are displayed within a single virtual space which has been generated by the apparatus 3000.

[0077] More specifically, in this example, the generating unit 3006 is configured to generate the virtual environment such that the simulation is displayed within a container within the virtual environment and a scaling factor is applied to the container such that the scale of the simulation is modified within the virtual environment relative to the first real-world environment.

[0078] More generally, it will be appreciated that either the simulation or the avatar may be displayed within the container within the virtual environment (such that the scaling can be applied to either the simulation or the avatar). Therefore, while this example is described with reference to a situation whereby the (first) container is used to display a simulation in the virtual environment, the present disclosure is not particularly limited in this respect. Rather, either of the simulation or the avatar may be displayed within this (first) container. Furthermore, as described in more detail later, the other of the simulation or the avatar can be displayed within a second, separate, container within the virtual environment, such that an independent scaling of the simulation and the avatar can be easily and efficiently performed, if required. Indeed, in embodiments, multiple related objects may also be displayed within a single container within the virtual environment, such that those objects can be scaled together within the virtual environment.

[0079] The container is not necessarily visible in the virtual environment; it is a construct that can be used in order to efficiently manage the display of the simulation within the new virtual environment alongside the avatar of the person. The container is a wrapper that encapsulates and contains all calculations for the display of the virtual object (here, the simulation) within the virtual environment. For example, the container may be a scale wrapper that contains all calculations for the visual-scale for the end-user in comparison to the life-size scale that it simulates. Thus, a scaling factor can be applied to the container itself which means that no alternations or modifications are required within the container for the display of the virtual object.

[0080] Indeed, it will be appreciated that the simulation may be generated on a 1:1 scale with the tracking data of the sporting event. Therefore, the simulation is a "life-size" simulation of the sporting event. This means that were the simulation to be directly displayed in the virtual environment alongside the avatar, it would be much bigger than the avatar. This would make it difficult for the avatar of the person 4002 to perform necessary analysis of the sporting event through the simulation displayed in the virtual environment. Accordingly, in the present disclosure, a scaling is applied to the container in which the simulation is displayed, in order to change the scale of the simulation within the new virtual environment generated by the apparatus 3000. In particular, the apparatus 3000 may be configured to perform modification of the scale of the simulation, whereby modification of the scale is a reduction in size of the simulation within the virtual environment. This means that the simulation can be displayed at reduced scale compared to the first real-world environment. As an example, the scale of the simulation in the virtual environment generated by the apparatus 3000 may be only 1:30 compared to the actual size of the sporting event. Advantageously, since the simulation is scaled by scaling the container, the simulation can be scaled independently of the avatar within the virtual environment. Accordingly, the avatar can be displayed at a scale (such as 1:1 with the person 4002) which is different from the scale at which the simulation is displayed within the virtual environment (such as 1:30 with the sporting event). This situation is illustrated in the example virtual environment 4004 of Figure 4 of the present disclosure.

[0081] Indeed, in this example, the virtual environment which is generated by the apparatus 3000 is (or corresponds to) a virtual studio. The avatar 4004A is an avatar of the person 4002 who is commentating on the sporting event. As the simulation 4004B is displayed at a reduced scale within the virtual environment, it can be placed on a surface (such as a table) within the virtual environment. This means that the avatar 4004A can be seen next to the simulation of the sporting event placed on the table (as illustrated in Figure 4 of the present disclosure).

[0082] In examples, the virtual environment 4004 which is generated by the apparatus 3000 may be perceived by one or more additional persons. In examples, the one or more additional persons may be viewers. The viewers are people who are viewing commentary of the sporting event being provided by the person 4002. The viewers can view the virtual environment 4004 which has been generated from a viewpoint within the virtual environment. The viewpoint from within the virtual environment may be fixed or may be controllable by the viewers. In this example, the viewpoint of the virtual environment from which the viewers can view the virtual environment is a fixed camera location within the virtual environment (i.e. a fixed viewpoint). This fixed viewpoint is determined such that it contains the avatar 4004A of the person 4002 and the simulation 4004B (displayed on the table). Accordingly, the viewer sees the avatar 4004A of the person 4002 in the virtual environment and can see the avatar 4004A of the person 4002 in the virtual environment move around and interact with the simulation of the sporting event as the person 4002 provides commentary on the sporting event.

[0083] In addition, the person 4002 can perceive the virtual environment. In some examples, the person 4002 may see the same viewpoint as the viewers of the virtual environment. However, in other examples, the person 4002 may view the virtual environment from their own location within the virtual environment.

[0084] Indeed, in this example, the person 4002 can perceive the virtual environment from a viewpoint of the avatar 4004A through a display device. Indeed, in this example, the person 4002 is wearing a display device such as a HMD. Therefore, the person 4002 can see the virtual environment from the viewpoint of their avatar 4004A by using the HMD. The person 4002 therefore sees the simulation of the sporting event displayed on the table within the virtual environment. Therefore, they can view the simulation in the virtual environment as it progresses (in accordance with the progression of the sporting event in the real-world).

[0085] As such, in embodiments, the apparatus 3000 is further configured to generate a video corresponding to a view seen by the avatar within the virtual environment; and control display of the video at least on a display device visible to the corresponding person in the second real-world environment. Furthermore, in examples the apparatus 3000 is configured to control display of the video on a virtual reality headset configured to be worn by the corresponding person in the second real-world environment.

[0086] Not only can the person 4002 see the simulation from the viewpoint of their avatar 4004A, they can also move the avatar within the virtual environment through respective movements in the real- world. That is, since the avatar is based on the tracking data which has been captured of the person 4002 in the real-world, a movement of the person in the real-world is replicated by movement of the avatar in the virtual environment. Accordingly, the person 4002 can control their avatar through movement in the real-world in order to move the avatar (and thus their viewpoint) around the virtual environment. This means that the person 4002 (who can perceive the virtual environment through the HMD) can move around in order to view the simulation from different angles within the virtual environment as it progresses. Indeed, the person may move to cause their avatar 4004A to lean in towards the simulation, such that they see it up close. Alternatively, the person 4002 may move to cause their avatar 4004A to walk around the table upon which the simulation is displayed in order that they can view the simulation from different angles (e.g. to get a better view of a particular moment (such as a player scoring a goal)).

[0087] As the simulation is displayed within a container within the virtual environment, it is also possible for the avatar 4004A of the person 4002 to interact with the simulation 4004B in the virtual environment - even though the scale of the simulation has been reduced during generation of the virtual environment. That is, the container may be a scale wrapper that contains all calculations for the visual-scale in comparison to the life-size scale that it simulates. That is, the scaling factor is applied to the container itself which means that no alternations or modifications are required within the container for the display of the virtual object.

[0088] For example, the person 4002 may move in order to cause their avatar 4004A to reach out and interact with the simulation 4004B in the virtual environment. The apparatus 3000 is configured to apply a conversion to data passing into and / or out of the container, to retain consistency of scale inside the container with a scale of the simulation. Therefore, when the avatar 4004A reaches out to interact with the simulation 4004B, it does so through an interface which converts the movement of the avatar (at a 1:1 scale with the real-world in this example) to the scale of the simulation (at a 1:30 scale with the real-world at this example) in order that appropriate determination of the interaction can be performed. Thus, in embodiments of the disclosure, the avatar can interact within the simulation in the virtual environment under control of the corresponding person in the second real- world environment.

[0089] The interaction itself is not particularly limited in accordance with embodiments of the disclosure. For example, the interaction may include at least one of: highlighting an object within the simulation, drawing a line around an object within the simulation, placing an additional object within the simulation, annotating the simulation, rotating the simulation, pausing the progression of the simulation, and / or winding or re-winding the progression of the simulation. Thus, the avatar 4004A can interact with the simulation in order to manipulate the simulation and / or emphasise certain portions or moments within the simulation.

[0090] In the example described with reference to Figure 4, the person 4002 is a commentator providing commentary on the sporting event (which is displayed in the virtual environment 4004 by the simulation 4004B). Therefore, as an example, the person 4002 may move (or otherwise control their avatar) to cause highlight a player within the simulation. The person 4002 may then provide commentary concerning the highlighted player in order to discuss a certain action being performed by that player or to emphasise a certain movement of that player within the virtual environment. This enables the person 4002 to interact with the simulation in order to enhance a viewer's experience.

[0091] It will be appreciated that the person 4002 may also provide audio commentary which can be provided to the viewers in order to accompany the commentary which is provided through the virtual environment. Therefore, the person 4002 may talk to provide commentary of the sporting event at the same time as interacting with the simulation in the virtual environment (through their avatar). In examples, the avatar may also be controlled to reflect the speech of the person 4002. For example, the mouth of the avatar may be controlled to move in accordance with the speech of the person 4002 in the real-world.

[0092] Furthermore, it will be appreciated that the simulation 4004B which is displayed in the virtual environment which has been generated by the apparatus 3000 alongside the avatar 4004A is not a video of the simulation. Rather, the simulation is displayed in the generated virtual environment based on the first data corresponding to the simulation itself. This means that the simulation can be manipulated within the virtual environment by the avatar 4004B of the person 4002 in novel ways in order to provide a greater understanding and analysis of the sporting event simulated by the simulation. For example, the simulation can be rotated or viewed from any angle which is desired. Alternatively or in addition, the simulation can be paused and replayed as desired. Alternatively or in addition, certain virtual objects in the simulation (such as a player) can be replaced by one or more other objects within the simulation (such as an avatar of that player). Thus, the simulation and its provision within the virtual environment which is generated by the apparatus 3000 provides novel ways of exploring and analysing the sporting event.

[0093] While the example of Figure 4 of the present disclosure has been described with reference to an example situation whereby the person 4002 is a person who is providing commentary of the sporting event which is taking place, it will be appreciated that the present disclosure is not particularly limited in this regard. For example, the person 4002 may be a person who wishes to view the sporting event in the sporting environment; indeed, the person 4002 may be a viewer of the sporting event in the virtual environment (and not necessarily a commentator as described with reference to the example of Figure 4). In this situation, the viewer may gain an enhanced viewing experience of the sporting event through interacting with the simulation - via their avatar - within the virtual environment.

[0094] Furthermore, the example of Figure 4 has been described with reference to a situation whereby a single simulation is shown within the virtual environment. However, the present disclosure is not particularly limited in this respect. In some examples, the apparatus 3000 may acquire data corresponding to a plurality of simulations. These simulations may be individually displayed within respective containers within the virtual environment. Indeed, each of these simulations may then be scaled, through scaling of the respective containers, such that they are displayed at reduced scale within the virtual environment. In examples, each of the plurality of simulations (corresponding to different sporting events, for example) may be displayed on different surfaces (e.g. different tables) within the virtual environment. A person may then control their avatar (e.g. by movement in the real world) in order to navigate through the virtual environment and view or interact with any of the plurality of simulations which are displayed within the virtual environment at any given time. Thus, it becomes possible for a person to easily interact with and enjoy the different sporting events taking place through interaction with the corresponding simulation which is displayed in the virtual environment generated by the apparatus 3000.

[0095] Furthermore, in some examples, a plurality of avatars may also be displayed (in addition to the simulation or simulations) within the virtual environment. For example, a plurality of avatars - each corresponding to a different person within the real-world - may be generated and displayed within the virtual environment by apparatus 3000. Indeed, these avatars may occupy a shared space within the virtual environment. This means that the different avatars, corresponding to the different people in the real-world, may also move and interact with each other as they move and interact with each other within the virtual environment.

[0096] Furthermore, in this example, the virtual environment has been generated with the simulation 4004B displayed at a reduced scale compared to the avatar 4004A. That is, the avatar is displayed at a 1:1 scale compared to the person 4002 in the real-world, while the simulation is displayed at a reduced size compared to the sporting event in the real-world. This is achieved through a scaling applied to the container which contains the simulation in the virtual environment. However, in examples, it will be appreciated that the avatar 4004A of the person 4002 may also be displayed within a container within the virtual environment, such that a scaling factor can be applied to the avatar within the virtual environment in addition to the scaling factor applied to the virtual environment.

[0097] That is, the apparatus 3000 may be configured to place the avatar in a second container within the virtual environment. Moreover, the apparatus may further be configured to apply a second scaling factor to the second container such that the scale of the avatar is modified within the virtual environment relative to the corresponding person in the second real-world environment. This means that the avatar can be displayed at a reduced size (or an increased size) with respect to the person 4002 in the real-world.

[0098] While the present example describes a situation whereby the avatar is displayed within the second container in the virtual environment, it will be appreciated that the present disclosure is not particularly limited in this regard. That is, in this example, the avatar is displayed in the second container in the virtual environment because the simulation was displayed in the first container in the virtual environment. However, when the avatar is displayed in the first container in the virtual environment, the simulation may in turn be displayed in the second container in the virtual environment if required.

[0099] Accordingly, more generally, the apparatus may be configured such that the other of the simulation or the avatar is placed in a second container within the virtual environment. Furthermore, the apparatus may be configured such that a second scaling factor is applied to the second container such that the scale of the other of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real-world environment.

[0100] With reference to the example situation where the avatar is displayed in the second container - and as described with reference to the container used to display the simulation within the virtual environment - it will be appreciated that the use of the container to display the avatar within the virtual environment is advantageous, since the scaling factor to change the scale of the avatar can be applied to the container itself. Accordingly, within the container, the consistency of scale is maintained, such that no modification of calculations within the container are required. In other words, as previously described, the container may be a wrapper that encapsulates and contains all calculations for the display of the virtual object (here, the avatar) within the virtual environment.

[0101] Indeed, in examples, the apparatus is configured to apply a conversion to data passing into and / or out of the container, to retain consistency of scale inside the second container with a scale of the avatar. An example of data passing into and / or out of the container is data corresponding to an interaction between the avatar and another virtual object (e.g. another avatar, the simulation or the like) within the virtual environment. Since a conversion is applied in this way to data passing into and / or out of the container, interactions between objects in the virtual environment can be easily and efficiently managed, even when those objects are displayed at different scales within the virtual environment.

[0102] Consider the situation as described with reference to Figure 4 of the present disclosure, for example. Here, the person 4002 is providing commentary on a sporting event which is taking place (for the benefit of one or more viewers), with this commentary being provided within the new virtual environment generated by apparatus 3000. Within the new virtual environment 4004 generated by apparatus 3000, the simulation 4004B corresponding to the sporting event is displayed on a surface (such as a table). The avatar 4004A of the person 4002 is displayed in this new virtual environment 4004 next to the table. Accordingly, they can interact with the simulation via respective control of their avatar 4004A in order to perform certain actions (such as highlighting an important feature within the simulation (such as the movement of a player before they score a goal)).

[0103] However, at a certain point during the simulation, the commentator may wish to "step-inside" the simulation. That is, they may wish that their avatar becomes the same or similar scale as an object (such as a person) within the simulation. Accordingly, apparatus 3000 may apply a scale to the container in which the avatar is displayed and / or a scale to the container in which the simulation is displayed in order that the avatar is displayed at a same or similar scale to the simulation. For example, the avatar 4004A of the person 4002 may then move around within the simulation in the virtual environment while providing commentary on the sporting event. Since interactions between the objects are managed through their respective scale containers, this operation can be easily performed while maintaining appropriate visual scale of respective objects in the virtual environment. Once the avatar of the person has illustrated a certain point within the simulation (while being at a same scale as the simulation) they may then "step-outside" the simulation again to return to a lifesize scale next to the simulation (displayed on a surface) within the virtual environment.

[0104] <Container>

[0105] Consider, now, Figure 5 of the present disclosure. Figure 5 of the present disclosure illustrates an example implementation of an apparatus in accordance with embodiments of the disclosure. More specifically, Figure 5 of the present disclosure illustrates the use of containers to manage interactions of virtual objects within a virtual environment in accordance with embodiments of the disclosure.

[0106] In this example, there are two virtual objects (a simulation and an avatar) displayed within the virtual environment. The simulation is a simulation of a sporting event in a sporting environment, while the avatar is the avatar of a person who is providing commentary on the sporting event. However, the present disclosure is not particularly limited to this specific example (which is merely provided in order to illustrate embodiments of the disclosure).

[0107] In this example, the simulation is provided within a first container within the virtual environment. Furthermore, in this example, the avatar is provided within a second container within the virtual environment.

[0108] As previously explained, the container is a wrapper that encapsulates and contains all calculations for the display of the virtual object within the virtual environment. Accordingly, within its container, a virtual object (e.g. the simulation or the avatar) can be computed on the assumption that there is no scaling applied. That is, the container (or scale wrapper) encapsulates and contains all calculations for the visual-scale for the virtual environment. This ensures that the calculations and visuals inside the container can always assume that there is no scaling applied to any instance it needs. Any incoming input will be modified to ensure it is scaled to the correct proportions inside the wrapper. On the other hand, any outgoing data will pass through the container to a "normal" scale system (where the data can then be ingested by the reset of the system, or by a different container.

[0109] Take the container for the simulation of the sporting event, as an example. The simulation of the sporting event is encapsulated within this container. Accordingly, no scale (or transform) needs to be applied to the tracking data used in order to compute the simulation (the tracking data from the sporting event). The container keeps everything at 1:1 scale between the simulation and the sporting event on which is it based. However, a scaling factor may be applied to the container itself, in order to modify the size of the simulation within the virtual environment. For example, as described with reference to Figure 4 of the present disclosure, the simulation may be displayed at reduced scale within the virtual environment (such that it can be displayed, for example, on a surface - such as a table - within the virtual environment). The scaling interface of the container then manages the flow of data between the inside and outside of that container. As an example, a interaction with an object in the virtual environment (at the normal scale of the virtual environment) passes through the scaling interface such that it scaled to the correct proportions inside the wrapper. This interaction (appropriately scaled) can then be fed into the simulation within the container.

[0110] Alternatively, consider the container of the avatar. The avatar is encapsulated within this container. Accordingly, no scale (or transform) needs to be applied to the tracking data used to compute the avatar (i.e. the tracking data of the corresponding person) in order to computer the avatar. That is, the container keeps everything at 1:1 scale between the avatar and the person on which the avatar is based. However, a scaling factor may be applied to the container itself, in order to modify the size of the avatar within the virtual environment. For example, as described with reference to Figure 4 of the present disclosure, the scale of the avatar may be modified in order to enable the avatar to "step-inside" the simulation within the virtual environment. The scaling interface of the container then manages the flow of data between the inside and outside of that container. As an example, when the person (here, a commentator) provides an input to interact with the simulation within the virtual environment, that input (from the commentator) passes first through the scaling interface of the avatar's container. This converts the input data from the commentator to the normal scale of the virtual environment. This input data then passes through the corresponding scaling interface of the simulation's container such that it is converted to the appropriate scale within the simulation's container. Accordingly, even though the simulation and the avatar may be displayed at different scales within the virtual environment, consistency of scale is maintained within respective containers, such that no modification of calculations within the container are required.

[0111] Accordingly, interactions between virtual objects within the virtual environment can be appropriately managed.

[0112] Consider, now, Figure 6 of the present disclosure. Figure 6 of the present disclosure illustrates an example process flow in accordance with embodiments of the disclosure. In particular, this Figure illustrates an example of an interaction between an avatar of a person and a simulation of a sporting event within a virtual environment.

[0113] In this example, the person is a person who is viewing the simulation in the virtual environment through the perspective of their avatar within the virtual environment. The person perceives the perspective of the avatar in the real-world through a virtual reality device (such as a HMD). In this example, the user will then be referred to as a VR-user.

[0114] In this example, the scale of the simulation within the virtual environment is set at 1:30, while the scale of the avatar within the virtual environment is set at 1:10.

[0115] In a first step of this example situation, a VR-user (the person who is viewing the simulation in the virtual environment) performs an interaction with the simulation in the virtual environment. Specifically, the VR-user selects a player within the simulation (via interaction between the VR-user' s avatar and the player in the simulation) and moves that player within the virtual environment. From the perspective of the VR-user (who perceives the virtual environment through their avatar) the movement corresponds to a movement of one meter to left. In the real world, however, this movement is caused by a movement of the VR-user (the person who is viewing the simulation in the virtual environment) by 10cm (since the scale of the avatar within the virtual environment, compared to the person in the real-world, is 1:10).

[0116] In other words, in the first step, the user provides an input, with that input being at a 1:10 scale with the real-world.

[0117] Then, in the next step, the relative position to the virtual environment (the "normal" scale for which is 1:1 with the real-world) must be calculated. This requires a conversion to scale the targets up by 10:1 (since the avatar of the person is displayed at 1:10 within the virtual environment).

[0118] This movement data, which has been scaled to 1:1 (the normal scale for the virtual environment) must then be calculated as a movement of the simulation (with which the avatar is interacting). This requires a calculation of the relative position of the movement in the 1:1 normal scale virtual environment, to the 1:30 scale of the simulation itself (e.g. by the scaling interface of the container of the simulation as previously described).

[0119] Within the simulation container, the simulation can thus assume that no further modification of the calculation (such as additional scaling) needs to be applied. Therefore, the simulation moves the player 3 meters to the left relative to the tracking data (from the sporting event) in accordance with the interaction which has been made by the movement of the person's avatar. Within the virtual environment, on the normal scale of the virtual environment, the player therefore moves 3.33cm (since the simulation is at a scale of 1:30).

[0120] Thus, a movement of the person in the real world by 10cm results in an eventual movement of the player in the simulation (through interaction with the person's avatar) by 3 meters within the simulation (which equates to a movement of 3.33cm in the virtual environment, e.g. on the surface at which the simulation is displayed at reduced scale). Therefore, since the virtual objects - namely, the person's avatar and the simulation in this example - are displayed within their respective container and since the scaling is applied to these containers within the virtual environment, interaction between the virtual objects in the virtual environment can be efficiently managed.

[0121] While the some examples of the present disclosure, such as the example of Figure 6 of the present disclosure, have been described with reference to a situation whereby the virtual objects are an avatar of a person viewing the virtual environment and a simulation of a sporting event, it will be appreciated that the present disclosure is not particularly limited in this regard. Furthermore, while the simulation has been described as at a scale of 1:30 and the avatar has been described at a scale of 1:10, it will be appreciated that the present disclosure is not particularly limited in this regard. These numbers are only one specific example of a scaling which can be applied to virtual objects within a virtual environment in accordance with embodiments of the disclosure. Indeed, the scale of the objects may be considerably different from the scale of the objects as described in this example.

[0122] <Method>

[0123] In accordance with embodiments of the disclosure, a method of generating a virtual environment is provided.

[0124] Consider now Figure 7 of the present disclosure. Figure 7 illustrates an example method in accordance with embodiments of the disclosure. In examples, the method of Figure 7 may be implemented by an apparatus such as apparatus 1000 as described with reference to Figure 1 of the present disclosure or an apparatus such as apparatus 3000 as described with reference to Figure 3 of the present disclosure.

[0125] The example method starts at step S7000 and proceeds to step S7002.

[0126] In step S7002, the method comprises acquiring first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment.

[0127] Then, in step S7004, the method comprises acquired second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding person in a second real-world environment.

[0128] In step S7006, the method comprises generating a virtual environment corresponding to a virtual location, and displaying, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment. In this example, the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real-world environment.

[0129] The method then proceeds to and ends with step S7008.

[0130] While the example of Figure 7 of the present disclosure illustrates an example method, it will be appreciated that the present disclosure is not particularly limited in this regard. That is, the method of embodiments of the disclosure is not particularly limited to the example method illustrated in Figure 7 of the present disclosure. One or more additional steps may be included within the method which are not shown in Figure 7 of the present disclosure. In addition, one or more steps of the method shown in Figure 7 of the present disclosure may be repeated as required. In addition, the steps shown in Figure 7 may be performed in a different order than shown in Figure 7; indeed, in some examples, at least a number of the steps of the method may be performed either in sequence or in parallel.

[0131] <Computer Program>

[0132] Furthermore, it will be appreciated that the methods of the present disclosure may be carried out on conventional hardware (such as that described previously herein) suitably adapted as applicable by software instruction or by the inclusion or substitution of dedicated hardware. Thus, the required adaptation to existing parts of a conventional equivalent device may be implemented in the form of a computer program product comprising processor implementable instructions stored on a non- transitory machine-readable medium such as a floppy disk, optical disk, hard disk, PROM, RAM, flash memory or any combination of these or other storage media, or realized in hardware as an ASIC (application specific integrated circuit) or an FPGA (field programmable gate array) or other configurable circuit suitable to use in adapting the conventional equivalent device. Separately, such a computer program may be transmitted via data signals on a network such as an Ethernet, a wireless network, the Internet, or any combination of these or other networks.

[0133] <Clauses>

[0134] In addition, embodiments of the present disclosure can be arranged in accordance with the following numbered clauses:

[0135] 1) An apparatus for generating a virtual environment, the apparatus comprising circuitry configured to: acquire first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment; acquire second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real-world environment; generate a virtual environment corresponding to a virtual location, and display, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real world environment.

[0136] 2) The apparatus according to clause 1, wherein the virtual location is a virtual studio.

[0137] 3) The apparatus according to clause 1 or 2, wherein the corresponding target is a person and / or object in the second real-world environment.

[0138] 4) The apparatus according to any preceding clause, wherein the first real-world environment is a sporting event.

[0139] 5) The apparatus according to any preceding clause, wherein the simulation is at a 1:1 scale with the first real-world environment.

[0140] 6) The apparatus according to any preceding clause, wherein the avatar is at a 1:1 scale with the corresponding target in the second real-world environment.

[0141] 7) The apparatus according to any preceding clause, wherein the modification of the scale is a reduction in size of the simulation or the avatar within the virtual environment, such that the simulation or the avatar is displayed at reduced scale compared the corresponding real-world environment.

[0142] 8) The apparatus according to any preceding clause, wherein the first container is placed on a surface within the virtual environment.

[0143] 9) The apparatus according to clause 8, wherein the surface is a table-top within the virtual environment. 10) The apparatus according to any preceding clause, wherein the apparatus is configured to apply a conversion to data passing into and / or out of the first container, to retain consistency of scale inside the container with a scale of the simulation or avatar.

[0144] 11) The apparatus according to any preceding clause, wherein the other of the simulation or the avatar is placed in a second container within the virtual environment.

[0145] 12) The apparatus according to clause 11, wherein a second scaling factor is applied to the second container such that the scale of the other of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real-world environment .

[0146] 13) The apparatus according to clause 12, wherein the apparatus is configured to apply a conversion to data passing into and / or out of the container, to retain consistency of scale inside the second container with a scale of the other of the simulation or the avatar.

[0147] 14) The apparatus according to any preceding clause, wherein the circuitry is further configured to generate a video corresponding to a view seen by the avatar within the virtual environment; and control display of the video at least on a display device visible to the corresponding target in the second real-world environment.

[0148] 15) The apparatus according to clause 14, wherein the apparatus is configured to control display of the video on a virtual reality headset configured to be worn by the corresponding target in the second real-world environment.

[0149] 16) The apparatus according to any preceding clause, wherein the circuitry is further configured to generate video of the virtual environment form a view point, wherein the view point is controllable independently of a location of the avatar within the virtual environment.

[0150] 17) The apparatus according to any preceding clause, wherein the avatar is placed in the virtual environment such that the avatar takes a location within the simulation at a scale corresponding to a target within the simulation.

[0151] 18) The apparatus according to any preceding clause, wherein the avatar can interact within the simulation in the virtual environment under control of the corresponding target in the second real- world environment.

[0152] 19) The apparatus according to clause 18, wherein the interaction includes at least one of: highlighting an object within the simulation, drawing a line around an object within the simulation, placing an additional object within the simulation, annotating the simulation, rotating the simulation, pausing the progression of the simulation, and / or winding or re-winding the progression of the simulation. 20) A method of generating a virtual environment, the method comprising: acquiring first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment; acquiring second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real-world environment; generating a virtual environment corresponding to a virtual location, and displaying, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real- world environment.

[0153] 21) A computer program comprising instructions which, when implemented by a computer, cause the computer to perform a method of generating a virtual environment, the method comprising: acquiring first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment; acquiring second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real-world environment; generating a virtual environment corresponding to a virtual location, and displaying, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real world environment.

[0154] 22) A non-transitory computer readable storage medium which stores the computer program according to clause 21. Obviously, numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the disclosure may be practiced otherwise than as specifically described herein.

[0155] In so far as embodiments of the disclosure have been described as being implemented, at least in part, by software-controlled data processing apparatus, it will be appreciated that a non-transitory machine-readable medium carrying such software, such as an optical disk, a magnetic disk, semiconductor memory or the like, is also considered to represent an embodiment of the present disclosure.

[0156] It will be appreciated that the above description for clarity has described embodiments with reference to different functional units, circuitry and / or processors. However, it will be apparent that any suitable distribution of functionality between different functional units, circuitry and / or processors may be used without detracting from the embodiments.

[0157] Described embodiments may be implemented in any suitable form including hardware, software, firmware or any combination of these. Described embodiments may optionally be implemented at least partly as computer software running on one or more data processors and / or digital signal processors. The elements and components of any embodiment may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the disclosed embodiments may be implemented in a single unit or may be physically and functionally distributed between different units, circuitry and / or processors.

[0158] Although the present disclosure has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Additionally, although a feature may appear to be described in connection with particular embodiments, one skilled in the art would recognize that various features of the described embodiments may be combined in any manner suitable to implement the technique. 1

Claims

CLAIMS:

1. An apparatus for generating a virtual environment, the apparatus comprising circuitry configured to: acquire first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment; acquire second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real-world environment; generate a virtual environment corresponding to a virtual location, and display, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real world environment.

2. The apparatus according to claim 1, wherein the virtual location is a virtual studio.

3. The apparatus according to claim 1, wherein the corresponding target is a person and / or object in the second real-world environment.

4. The apparatus according to claim 1, wherein the first real-world environment is a sporting event.

5. The apparatus according to claim 1, wherein the simulation is at a 1:1 scale with the first real-world environment.

6. The apparatus according to claim 1, i) wherein the avatar is at a 1:1 scale with the corresponding target in the second real-world environment; or ii) wherein the modification of the scale is a reduction in size of the simulation or the avatar within the virtual environment, such that the simulation or the avatar is displayed at reduced scale compared the corresponding real-world environment.

7. The apparatus according to claim 1, wherein the first container is placed on a surface within the virtual environment.

288. The apparatus according to claim 7 , wherein the surface is a table-top within the virtual environment.

9. The apparatus according to claim 1, wherein the apparatus is configured to apply a conversion to data passing into and / or out of the first container, to retain consistency of scale inside the container with a scale of the simulation or avatar.

10. The apparatus according to claim 1, wherein the other of the simulation or the avatar is placed in a second container within the virtual environment.

11. The apparatus according to claim 10, wherein a second scaling factor is applied to the second container such that the scale of the other of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real-world environment .

12. The apparatus according to claim 11, wherein the apparatus is configured to apply a conversion to data passing into and / or out of the container, to retain consistency of scale inside the second container with a scale of the other of the simulation or the avatar.

13. The apparatus according to claim 1, wherein the circuitry is further configured to generate a video corresponding to a view seen by the avatar within the virtual environment; and control display of the video at least on a display device visible to the corresponding target in the second real-world environment.

14. The apparatus according to claim 13, wherein the apparatus is configured to control display of the video on a virtual reality headset configured to be worn by the corresponding target in the second real-world environment.

15. The apparatus according to claim 1, i) wherein the circuitry is further configured to generate video of the virtual environment form a view point, wherein the view point is controllable independently of a location of the avatar within the virtual environment; or ii) wherein the avatar is placed in the virtual environment such that the avatar takes a location within the simulation at a scale corresponding to a target within the simulation.

16. The apparatus according to claim 1, wherein the avatar can interact within the simulation in the virtual environment under control of the corresponding target in the second real-world environment.

17. The apparatus according to claim 16, wherein the interaction includes at least one of: highlighting an object within the simulation, drawing a line around an object within the simulation,placing an additional object within the simulation, annotating the simulation, rotating the simulation, pausing the progression of the simulation, and / or winding or re-winding the progression of the simulation.

18. A method of generating a virtual environment, the method comprising: acquiring first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment; acquiring second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real-world environment; generating a virtual environment corresponding to a virtual location, and displaying, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulation or the avatar is modified within the virtual environment relative to its size in the corresponding real- world environment.

19. A computer program comprising instructions which, when implemented by a computer, cause the computer to perform a method of generating a virtual environment, the method comprising: acquiring first data corresponding to a simulation which recreates a first real-world environment, movement and location of objects within the simulation being determined on the basis of tracking data of corresponding objects in the first real-world environment; acquiring second data corresponding to an avatar, movement of the avatar being determined on the basis of tracking data of a corresponding target in a second real-world environment; generating a virtual environment corresponding to a virtual location, and displaying, on the basis of the first data and the second data respectively, the simulation and the avatar within the virtual environment; wherein the simulation or the avatar is displayed within a first container within the virtual environment and a scaling factor is applied to the first container such that a scale of the simulationor the avatar is modified within the virtual environment relative to its size in the corresponding real world environment.

20. A non-transitory computer readable storage medium which stores the computer program according to claim 19.

Images