Special Effects Communication Technology

JP7637414B2Active Publication Date: 2025-02-28UNIVERSAL CITY STUDIOS LLC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021517343
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-05-16
Filing Date
2019-09-18
Publication Date
2025-02-28
Estimated Expiration
2039-09-18

Smart Images

  • Figure 0007637414000001
    Figure 0007637414000001
  • Figure 0007637414000002
    Figure 0007637414000002
  • Figure 0007637414000003
    Figure 0007637414000003
Patent Text Reader

Abstract

The special effects communication system 10 may include a camera system at a first location that generates a first data set based on one or more images or impressions of a first user at a first location. The special effects communication system 10 may also include a control system 66 communicatively coupled to the camera system and the special effects system 68. The control system 66 may receive a second data set corresponding to a second user at a second location or one or more users at one or more locations while the first user is at the first location. The control system 66 may also provide one or more control signals to the special effects system 68 at the first location to generate special effects and present the visual and / or aural appearance of the second user using special effects materials and / or media. [Selected Figure] Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates generally to communications technologies, and more particularly to systems and methods for providing an immersive and / or transformable communication experience to a user of a communication system. [Background technology]

[0002] Many communication systems allow a first user to communicate with a second user at a different location. During the conversation, the first user can talk to the second user and, in some cases, can visually and audibly communicate with the second user via voice and video communication devices. Even though the communication system allows these users to communicate with each other, the communication system may not provide the users with an immersive communication experience. As modern electronic devices and communication technologies become more sophisticated and complex, improved, more immersive and / or transformable communication experiences are desired. Summary of the Invention

[0003] Certain embodiments falling within the scope of the initially claimed invention are summarized below. These embodiments are not intended to limit the scope of the disclosure, but merely to provide a brief overview of certain embodiments of the inventive subject matter. Indeed, the inventive subject matter may encompass a variety of forms that may be similar to or different from the embodiments set forth below.

[0004] In one embodiment, the special effects communication system can include a camera system at a first location that generates a first data set based on one or more images of a first user at a first location. The special effects communication system can also include a special effects system at the first location that generates special effects using special effects material. The special effects communication system can also include a control system communicatively coupled to the camera system and the special effects system. The control system can receive a second data set corresponding to a second user at a second location when the first user is at the first location. The control system can also provide one or more control signals to cause the special effects system at the first location to generate special effects to present a likeness of the second user using the special effects material.

[0005] In another embodiment, a special effects communication system can include a camera system that captures one or more images of a first user at a first location and communication circuitry that can transmit a first data set corresponding to the one or more images of the first user and receive a second data set from a destination device that corresponds to one or more images of a second user at a second location. The special effects communication system can also include a special effects system that generates one or more control signals based on the second data set to drive three-dimensional manipulation of a physical medium to present the appearance of the second user.

[0006] In yet another embodiment, a method can include capturing a first data set including first audio data and first image data associated with a first location and establishing a communications link with an origin device or central device that controls all effects systems. The method can also include transmitting the first data set to the origin device and, during the transmission of the first data set, receiving a second data set including second audio data and second image data associated with a second location. The method can also include generating one or more control signals based at least in part on the second data set and driving three-dimensional manipulation of a physical medium based at least in part on the one or more control signals.

[0007] These and other features, aspects, and advantages of the present disclosure will become better understood from the following detailed description when taken in conjunction with the accompanying drawings, in which like reference characters refer to like elements throughout. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates a first special effects communication system that transmits a first user's appearance to a second special effects communication system that receives and displays the first user's appearance along with one or more special effects, according to an embodiment of the present disclosure. [Diagram 2] 2 illustrates the first special effects communication system of FIG. 1 receiving and displaying the appearance of a second user while transmitting the appearance of a first user along with one or more special effects, according to an embodiment of the present disclosure. [Diagram 3] 2 illustrates the second special effect communication system of FIG. 1 receiving the appearance of a first user while transmitting the appearance of a second user along with one or more special effects, according to an embodiment of the present disclosure. [Figure 4]FIG. 2 illustrates an embodiment of the second special effect communication system of FIG. 1 receiving and displaying the appearance of a first user while transmitting the appearance of a second user along with one or more special effects in accordance with an aspect of the present disclosure. [Diagram 5] 2 is a block diagram illustrating the special effects communication system of FIG. 1 according to an aspect of the present disclosure. [Figure 6] 1 is a flow diagram illustrating a process for providing an immersive and / or transformable communication system according to an aspect of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] One or more specific embodiments of the present disclosure are described below. In order to provide a concise description of these embodiments, not all of the features of an actual implementation may be described herein. It will be appreciated that in developing any such actual implementation, as with any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's particular goals, including compliance with system-related and business-related constraints that may vary from implementation to implementation. It will be further appreciated that such a development effort may be complex and time-consuming, but is nevertheless a routine exercise in design, engineering and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0010] A communication system may include various communication experiences, such as instant messaging capabilities, the ability to add emoticons to text to convey feelings or emotions, video communication options, or the like. These various communication experiences may enhance the user experience with the communication system. For example, emoticons may facilitate emotional communication over a purely text-based communication system, enhancing the user experience with the communication system by enhancing the conversation between a user and a different user. However, these communication systems may continue to provide semi-immersive communication experiences. Thus, it may be desirable to provide immersive and / or transformable communication experiences to users of the communication system, improving the quality of the conversation between users and the overall user experience.

[0011] Accordingly, the present disclosure relates to systems and methods that utilize material actuation, sensor data, and / or special effects to enhance conversation quality and enhance user experience between users of a communication system. More particularly, the present disclosure relates to a special effects communication system that includes one or more capture and display systems (e.g., image, video, or spatial capture systems, projection systems). The capture and projection systems can facilitate an enhancement of conversation quality between users and can immerse a first user in the respective environment of a second user with whom the user is communicating. By immersing the user in the environment with which the user is communicating, the first user at a first location can at least in part experience the illusion of being immersed at a second location corresponding to the second user with whom the first user is communicating. In this manner, the second user can receive a projection or impression of the first user to enhance communication and further immerse the second user in the conversation (e.g., by having the second user at least in part believe that the first user is in the environment in which the second user is interacting). For example, if a first user is in a pasture, a second user can not only experience the sights and sounds of the pasture using audio / video communications, but the special effects communications system can also trigger wind effects and olfactory effects for the second user that provide the illusion that parts of the first user's environment move with the first user and that the first user is physically present and not merely visible via an audio / visual display at a remote location.

[0012] In one embodiment, the origin special effects communication system establishes a communication link with a destination device (e.g., a second special effects communication system). In response to the established communication link, one or both of the origin special effects communication system or the destination special effects communication system can transmit audio data, image data, and in embodiments, additional sensor data to each other, and can communicate and convey the appearance of the respective users (e.g., visual depictions and associated audio and / or environmental conditions). The audio data is transmitted and presented (e.g., played with audio) substantially simultaneously with the image data and with one or more special effects to provide an immersive and / or transformable communication experience to one or both users of the special effects communication systems. Additionally, the appearance of one or both of the users (i.e., origin or destination) can be displayed or projected in a manner that enhances the simultaneous special effects. For example, the appearance of the users of the special effects communication system can be generated at the origin or destination device via the manipulation of fire, water, fog, putty, stereoscopic displays, and / or holographic displays, or any suitable physical material or medium, to present the appearance to the user of the destination device. In these examples, the additional sensor data and / or special effects generated by the special effects communication system can convey the temperature or quality of the physical medium, such as mist and cold air for water or warm air for fire and additional sounds (e.g., crackling sounds). Additionally, some embodiments can generate various control signals based on the image data. The control signals can be used to manipulate the operation of the physical medium and / or components. For example, pins or bladders (e.g., air contained within plastic) can be activated and modified in response to the control signals, where in some embodiments the pins or bladders are covered with a flexible and / or stretchable material (e.g., rubber skin, fabric, leather).In this manner, a flexible material can be formed that appears to move in response to actuation based on a control signal and can be used to convey movements associated with a user of a special effects communication system (e.g., associated with head movements and / or facial expressions, associated with speech) to provide the illusion of speaking with an avatar of the user rendered in the physical medium.

[0013] As can be appreciated, in some embodiments, the destination device may not have a user, and thus the appearance of the environment surrounding the destination device may be transmitted to the special effects communication system. For example, the appearance associated with an empty room may be transmitted to the special effects communication system for presentation to a corresponding user. As can be appreciated, the special effects communication system that initiates the communication linking may not present special effects. Instead, the special effects communication system acting as the destination device may present special effects.

[0014] In certain embodiments, the disclosed special effects communication system is provided within an entertainment venue, such as an amusement or theme park. The theme park provides a controlled environment that can be associated with impressive effects that enhance the immersive and / or transformable experience. That is, a particular attraction environment can have ice, fire, smoke, light, and other sensory thematic elements that are at least partially reproduced to a user of the special effects communication system, providing the user with a sense of being in the environment and / or communicating with individuals within the environment. Thus, certain embodiments of the present disclosure are disclosed in the context of special effects that are part of the entertainment story and enhance the immersive and / or transformable entertainment experience of the user. In one embodiment, a user can select characters associated with an attraction within a theme park, such as aliens that have various physical characteristics and operate in the environment of a fictional planet. Thus, communication effects and special effects are selected and operate in concert to enhance the desired story. It should be understood that communication effects and special effects can be selected to fit other story environments and that the depicted alien story is merely exemplary.

[0015] Referring now to the figures, FIG. 1 is a diagram of an embodiment of a system 20 including one or more special effects communication systems 10 (e.g., a first special effects communication system 10A). The first special effects communication system 10A can include one or more capture and display systems 12 (e.g., capture / display system 12) that capture and transmit the appearance of a first user located at the location of the first special effects communication system 10A to a second special effects communication system 10B. In the illustrated example, the first user is located on a platform that extends a story in which the first user will be transported to a second location. The second special effects communication system 10B at the second location can receive a data set indicative of the appearance of the first user and can be operated to present an image 14 using the data set to display or otherwise communicate the appearance of the first user to a second user. The image 14 can be presented in response to supporting special effects provided herein. Additionally, depending on the desired narrative or illusion effect, the system 20 can process or modify the appearance to present the illusion to the second user. For example, an image can present the facial features of the first user stretched or fading at the edges to enhance the illusion of the user being carried away by a holographic display or light beam. In other embodiments, the displayed image can be based on extracted facial features from the first user. The system 20 can incorporate these extracted features into a portion of a desired character avatar (e.g., a character from the story) that resembles the user. A particular character avatar can be associated with a particular special effect, such as appearing / disappearing with a puff of smoke, and the combination of displaying an image of the avatar and triggering the special effect (e.g., emitting smoke around the projection) can enhance a particular narrative feature of the communication. In the illustrated embodiment, the user is rendered or presented as an alien at the destination or second special effect communication system 10B and surrounded by a fog beam special effect.

[0016] The appearance of the first user transmitted from the first special effects communication system 10A to the second special effects communication system 10B may include any suitable digital and / or analog data to convey the appearance and / or presence of the first user, including, but not limited to, image data, audio data, sensor data, etc. In this manner, image data corresponding to the first user may be transmitted by the second special effects communication system 10B substantially simultaneously with audio data, sensor data, or any other suitable digital and / or analog data to convey the appearance and / or presence of the first user to the second user. Similarly, the second special effects communication system 10B may capture and transmit the appearance of the second user to the first user.

[0017] As shown, a first user is located within or adjacent to a first special effects communication system 10A. In response to detecting the presence of the first user, the first special effects communication system 10A can establish a communication link (e.g., initiated communication) with a second special effects communication system 10B. When a communication link is established between the special effects communication systems 10, an appearance of one or both of the users is transmitted between the special effects communication systems 10. Thus, the first special effects communication system 10A receives data associated with the appearance of the second user while transmitting the appearance of the first user to the second special effects communication system 10B. Data transmitted between the special effects communication systems 10 (e.g., 10A, 10B) can include data used to provide special effects, such as temperature sensor data, to communicate to one of the users the ambient environmental temperature corresponding to the location of each respective user. Other examples of data that can be provided as input to the special effects subsystem can include location tracking data, humidity or moisture data, pressure data, any suitable data for communicating environmental conditions, and the like.

[0018] The first special effects communication system 10A and the second special effects communication system 10B can transmit one or more data sets via a real-time graphics engine 16C of the system 20. The one or more data sets can also include various suitable metadata, including a destination identifier, an origin identifier, an illusion identifier, and the like, to facilitate transmission and / or processing of the data sets to provide an immersive and / or transformable entertainment experience for one or more users. The real-time graphics engine 16C, the first special effects communication system 10A, and / or the second special effects communication system 10B can each include processing circuitry and memory circuitry to process one or more data sets transmitted between the special effects communication systems 10. The processing circuitry can be used to execute programs, execute instructions, interpret inputs, generate control signals, and / or perform other similar functions. The memory circuitry can be used to store data, programs, instructions, and the like. In other embodiments, the processing and memory functions can reside at least in part in a central controller. Additionally, the special effects communication systems 10 can each include a respective real-time graphics engine 16 (e.g., 16A, 16B) in some embodiments. Thus, one of the special effects communication systems 10 may use the real-time graphics engine 16 to alter, process, modify, adjust, etc., one or more data sets prior to transmitting the one or more data sets to the other of the special effects communication systems 10.

[0019] The data sets (e.g., audio data, image data, and additional sensor data) can be transmitted between the components via a communication network 18. The communication network 18 can include any number of input / output (I / O) interfaces and / or network interfaces. Such communication networks can enable data transmission over a variety of wired or wireless networks, such as a personal area network (PAN) such as Bluetooth, a local area network (LAN) such as Wi-Fi or a wireless local area network (WLAN), and / or a wide area network (WAN) such as a cellular network. In some embodiments, the memory circuitry of the second special effects communication system 10B can store one or more data sets for a duration before transmitting the data sets to the first special effects communication system 10A. Thus, in some embodiments, the first special effects communication system 10A can provide a pre-recorded listening and / or viewing experience to a user of the first special effects communication system 10A.

[0020] In some embodiments, the second special effects communication system 10B includes a special effects system that uses special effects materials (e.g., physical materials) to generate or create the appearance of the first user. Data associated with providing the three-dimensional appearance of the first user via the second special effects communication system 10B can be generated by the first special effects communication system 10A or by the real-time graphics engine 16 and transmitted to the second special effects communication system 10B, or can be generated in real time by the second special effects communication system 10B in response to data received from the first special effects communication system 10A. For example, the second special effects communication system 10B can receive one or more control signals to manipulate physical materials, such as varying the power of a laser or fog, to generate a depiction of the first user. As shown, the second special effects communication system 10B provides a representation of the first user projected onto a fog screen or fog beam, however, it should be understood that any suitable physical material may be used in combination with a light output (e.g., a projection system) to provide a three-dimensional or two-dimensional image of the first user. For example, fire, water, fog, smoke, putty, etc. may be used as physical materials. In general, the appearance of the first user and / or second user may be modified as part of one or more illusions based on one or more images and / or impressions of the users.

[0021] 2 illustrates an example of a first special effects communication system 10A taken generally from the perspective of a first user. As shown, the first special effects communication system 10A has previously established a communication link with a second special effects communication system 10B and is therefore receiving the appearance of the second user. As described above, while receiving the appearance of the second user, the first special effects communication system 10A simultaneously captures and transmits the appearance of the first user via transmission of data collected from a combination of camera sensors, audio sensors, and any suitable additional sensors.

[0022] The first special effects communication system 10A can receive and transmit audio data, image data, and / or additional sensor data to receive and transmit the appearance of the user. The audio data can be interpreted by processing circuitry internal to the first special effects communication system 10A or other suitable circuitry communicatively coupled to the first special effects communication system 10A via the communication network 18. If the audio data is received, the first special effects communication system 10A can process the audio data (e.g., improve signal integrity or prepare the audio data for output) and present the audio data (e.g., via a speaker) to the first user to facilitate communication between the first user and the second user. This processing promotes an illusion based on the appearance of the second user presented to the first user. In this manner, as shown, the second user (e.g., a human) is presented to the first user as an illusion or in a distorted manner (e.g., an alien with distorted or different characteristics that is not human, has sound effects, emits one or more non-human sounds, is generated through filtering, speech recognition transliteration, etc.).

[0023] Similarly, the image data may be received and / or interpreted by processing circuitry within the first special effects communication system 10A or other suitable circuitry communicatively coupled to the first special effects communication system 10A via the communication network 18, such as the real-time graphics engine 16. This processing circuitry may receive the image data and generate one or more control signals to cause the presentation of the second user's appearance to the first user (e.g., example presentation 28). These control signals may control pixels, projection systems, physical media, etc. to enable the presentation of the second user's appearance in, on, or outside of any suitable physical material or lighting. Additionally, these control signals may be generated based at least in part on additional sensor data. For example, the additional sensor data may communicate the orientation of the second user relative to the capture / display system 12B of the second special effects communication system 10B, and thus may be used to change how the second user's appearance is presented to the first user. The additional sensor data can also be used to facilitate special effects within the first special effect communication system 10A, such as dynamically adjusting the temperature output associated with the mist generated to touch the first user.

[0024] As shown, the capture / display system 12A captures one or more images of a first user while within or near a close range of the first special effects communication system 10A. The first special effects communication system 10A transmits and receives audio data, image data, and / or additional sensor data to enable the first user to communicate with a second user. In response to the received image data and additional sensor data, the capture / display system 12A of the first special effects communication system 10A operates to present an appearance of the second user substantially simultaneously with outputting audio data from the second user. In addition, the special effects system 30A can substantially simultaneously output one or more special effects during output of the received audio data and image data, which facilitates conveying the surrounding environment at a location to the first user. In this manner, the first special effects communication system 10A operates to provide an immersive and / or transformable communication experience to the first user. Special effects system 30 can drive the manipulation of special effects materials or physical media (e.g., water, fog, smoke, fire, putty, etc.) in conjunction with other sensory effects such as haptics, light, and / or sound effects to enhance the desired illusion.

[0025] While a first user is using the first special effects communication system 10A, a second user can use the second special effects communication system 10B. FIG. 3 is a diagram of an embodiment of the second special effects communication system 10B taken generally from the second user's perspective. As shown, the second special effects communication system 10B has previously established a communication link with the first special effects communication system 10A and thus receives the first user's appearance. As described above, while receiving the first user's appearance, the second special effects communication system 10B simultaneously captures and transmits the second user's appearance via transmission of data collected from a combination of camera sensors, audio sensors, and any suitable additional sensors.

[0026] The second special effects communication system 10B may include a capture and display system 12B as well as a special effects system 30B. It should be understood that while both special effects communication systems 10 may include a special effects system 30B, at any one time, a special effect may be communicated along with the appearance of one user. The special effect may be transmitted to the first user at the same time that a projection into, on, or out of a physical medium is presented to the second user. In some embodiments, one or more special effects may be transmitted simultaneously via each special effects communication system 10. Thus, in some embodiments, both special effects communication systems 10 may not transmit special effects to their respective users at the same time. However, in some embodiments, both special effects communication systems 10 may transmit one or more special effects to their respective users at the same time, and the one or more special effects may be the same or different.

[0027] As shown, the special effects shown in FIG. 2 are presented substantially simultaneously with the projection of the first user into, on, or out of the physical medium presented to the second user shown in FIG. 3. The second special effects communication system 10B presents an illusion based on the first user's appearance (e.g., an alien) to the second user via presentation techniques such as fog manipulation. In this manner, a three-dimensional illusion of the first user's appearance is transmitted via image projection onto an illuminated fog cone (e.g., presentation 40) or fog screen. Although shown performing image projection onto an illuminated fog cone, it will be understood that any suitable projection and / or presentation method and / or technique may be used to provide the first user's appearance via the second special effects communication system 10B.

[0028] 2 and 3, example presentation 40 can occur substantially simultaneously with example presentation 28 of FIG. 2. That is, for example, the first user sees a two-dimensional projection of the second user transmitted via an array of lights projected onto a water curtain while the second user of FIG. 3 sees a three-dimensional projection of the first user. The two-dimensional projection can be transmitted simultaneously with special effects such as additional audio or light wind (e.g., initiated by one or more fans in response to a control signal). Additional sensor data can be used to track the orientation of the first user such that as the first user moves his or her head or body, the three-dimensional projection of FIG. 3 moves substantially simultaneously with the first user's movements. The combination of special effects, two-dimensional projection, and three-dimensional projection can further immerse both users in the conversation, thus enhancing and / or enhancing the conversation.

[0029] FIG. 4 is a diagram of another example of the second special effects communication system 10B taken generally from the field of view of the second user. This example of the second special effects communication system 10B shows an example three-dimensional illusion presentation 50 of the first user emerging from a wall-mounted projection system 52. The example three-dimensional illusion presentation 50 is based on the captured appearance of the first participant. The capture / display system 12B can manipulate a data set associated with the captured appearance to convey the illusion of a different appearance. In this example, the first user (e.g., a human) turns into an alien or other suitable illusion for presentation to the second user (human). As mentioned above, in some embodiments, the second special effects communication system 10B includes one or more items associated with a controllable physical medium, such as pins, air bladders, or putty, that are actuated to form a recognizable representative outline of the first user (e.g., a remote user) to the second user. One or more items operate in response to control signals generated in response to image data received by the first special effects communication system 10A to the second special effects communication system 10B.

[0030] As shown, the second special effects communication system 10B has previously received at least a portion of the image data from the first special effects communication system 10A and operates one or more items under control or to drive or control signals to act based on the image data. In this manner, the one or more items create a three-dimensional representation of the first user. Additional sensor data can be used to track the orientation of the first user and thus adjust one or more output control signals to appropriately adjust the actuation of one or more items in response to the movement. For example, the first user can orient themselves closer to the capture system and thus be presented to the second user in a different manner (e.g., to convey relative position) than when oriented or positioned away from the capture system.

[0031] 4 with respect to FIGURES 2-3, presentation 50 can occur at the same time or at approximately the same time as presentation 28. In this manner, second special effects communication system 10B can transmit image data, audio data, spatial data, and / or additional sensor data (e.g., via capture / display system 12B) to first special effects communication system 10A at the same time as receiving a similar data set from first special effects communication system 10A. Furthermore, presentation 50 can also occur simultaneously with the special effect (or special effects) of first special effects communication system 10A.

[0032] With the above in mind, Figure 5 is a block diagram of a special effects communication system 10 (e.g., 10A, 10B). The special effects communication system 10 includes a capture system 62 (e.g., 62A, 62B), a display system 64 (e.g., 64A, 64B), a control system 66 (e.g., 66A, 66B), and a special effects system 68 (e.g., 68A, 68B). Each of these systems (e.g., 10, 62, 64, 66, 68) can communicate with one another via a communications network 18. Furthermore, data transmitted between the special effects communication system 10 can optionally be processed by a real-time graphics engine 16 and / or additional or alternative real-time graphics engines either within and / or external to the special effects communication system 10 endpoints.

[0033] As mentioned above, the real-time graphics engine 16 and the control system 66 may include processing circuitry 70 (e.g., 70A, 70B, 70C) and memory circuitry 72 (e.g., 72A, 72B, 72C) for processing one or more data sets transmitted between the special effects communication system 10. The processing circuitry 70 may be used to execute programs, execute instructions, interpret inputs, generate control signals, and / or perform other similar functions, and may include a combination of hardware-based and / or software-based functions or applications to do so. The memory circuitry 72 may be used to store data, programs, instructions, diagnostic data, final data, and the like, in a variety of suitable memory or storage types, such as random access memory, read-only memory, flash memory, hard drives, future storage technologies both known and unknown at this time (e.g., deoxyribonucleic acid (DNA) data storage, etc.), and others.

[0034] Data sets (e.g., audio data, image data, and additional sensor data) may be transmitted between components via a communications network 18. The communications network may include any number of input / output (I / O) interfaces and / or network interfaces. Communications network 18, as described above, may enable data transmission over a variety of wired or wireless networks. In this manner, data sets may be recorded or sensed in the analog or digital domain and transmitted between special effects communications system 10 in the analog or digital domain or any combination thereof.

[0035] Control system 66 can operate capture system 62, display system 64, and special effects system 68 to provide an immersive and / or transformable communication experience for a user. Accordingly, control system 66 can generate one or more control signals to control various functions of each capture system 62, display system 64, and special effects system 68, respectively. For example, control system 66A can send one or more control signals to special effects system 68A to cause the performance of a special effect that corresponds at least in part to the control signal.

[0036] Continuing with the description of each subsystem of the special effects communication system 10 (e.g., capture system 62, display system 64, and special effects system 68), the capture system 62 can sense and record (e.g., capture) the appearance of the users (e.g., capture system 62A senses the appearance of a first user). Accordingly, the control system 66 can operate each capture system 62 to sense the appearance of each user. The control system 66 can operate image capture devices 74 (e.g., 74A, 74B) to sense (e.g., capture an image) the visual appearance of each user. The collected data set can include not only graphical information but also data corresponding to the heat, volume, and / or shape of each user. The image capture devices 74 can be any suitable image capture device, such as a two-dimensional capture system, a three-dimensional capture system, a video capture system, etc. In response to sensing the visual appearance of each user, image data is transmitted from the capture system over the communication network 18 between the special effects communication system 10. The control system 66 can also operate audio capture devices 76 (e.g., 76A, 76B) to support audio transmission and capture (e.g., record audio) associated with each user. Audio data associated with a user can be captured via any suitable audio recording device, such as a microphone. The audio capture device 76A can also include one or more beam steering microphone arrays to isolate external and / or environmental noise from the audio capture. For example, the beam steering microphone arrays can allow users to communicate without interference from background noise. In some embodiments, the captured data associated with the one or more beam steering microphone arrays can be used to present a spatial image, such as by suggesting an orientation of the user relative to the microphones.

[0037] In the display system 64, the control system 66 can operate the presentation device 78 (e.g., 78A, 78B) to communicate received images or other data. The presentation device 78 can be essentially any suitable display or system for manipulating physical materials to create a display or projection system. The presentation device 78 can receive one or more control signals that are used to directly modify or cause the presentation of images via the presentation device 78. The control signals can be generated by the control system 66 or by subcomponents of the display system 64, such as driver circuitry (not shown) responsive to the received image data. The control system 66 can operate the presentation device 78 substantially simultaneously with an audio output device 80 (e.g., 80A, 80B). The audio output device 80 can be any suitable device capable of outputting audio (e.g., noise, sound) in response to audio data, such as a speaker or a tactile transducer. The combination of presentation device 78 and audio output device 80 provides the illusion that the displayed image or appearance of the user is speaking, or that the presented image is changing at the same rate as the audio output is changing.

[0038] Additionally, the control system 66 can operate the special effects system 10 to provide special effects corresponding to the audio data and image or other data. As described above, the special effects can, for example, convey the illusion that a first user is actually being transmitted to a physical medium for presentation to a second user. In this manner, the special effects can facilitate the provision of an immersive and / or deformable illusion to both the first user and the second user. This immersive illusion allows the first user to believe that the immersive illusion is actually being transmitted into and out of the corresponding physical medium. For example, the first user can receive an illusion of hotness (e.g., warm air) when the first user's appearance is projected into a fire illusion, or the first user can receive an illusion of cool water (e.g., cool air and mist) when the first user's appearance is projected onto a water screen and / or physically formed from a geometric water display. Thus, the special effects system 10 may include special effects material 82 (e.g., 82A, 82B) and a controller 84 (e.g., 84A, 84B). The controller 84 may operate or control components such as valves, actuators, levels, etc. to manipulate the special effects material 82 to create a special effect or the illusion of a special effect. For example, water may be the special effects material 82A to create the illusion of a special effect to a second user of a first user emerging from the water.

[0039] In some embodiments, the control system 66 may control the tracking devices 86 (e.g., 86A, 86B) respectively to monitor the orientation or position of the first user and / or any object held by the first user (e.g., an object held in the hand of the first user) which is transmitted to the second special effects communication system 10B. In response to receiving this additional sensor data, the control system 66B may operate the display or special effects system 64B (e.g., via one or more control signals) to modify the output of the received data based on the additional sensor data and communicate to the second user (or first user) the orientation or position of the first user (or second user) and / or any associated object possessed by the first user.

[0040] As will be appreciated, centralized processing can be used to provide an immersive and / or transformable communication experience. As discussed above, the real-time graphics engine 16 and the control system 66 can include processing circuitry 70 to process one or more data sets transmitted between the special effects communication systems 10. In this manner, processing of some or all of the one or more data sets can be shared between the control system 66 and the real-time graphics engine 16. Thus, the first special effects communication system 10A can partially process the first data set, and the real-time graphics engine 16 can finally process the first data set before transmission to the second special effects communication system 10B. Processing of the data set can occur while data transmission continues. In this manner, the data set is used to generate control signals in real time and between associated data set generation and data set presentation (e.g., to have the special effects drive the presentation of the user's appearance via the actuation or shaping of physical materials). Additionally, the real-time graphics engine 16 can be communicatively coupled to the central controller 90 (e.g., via a similar or same coupling to the communication network 18). The central controller 90 may aggregate, process, interpret, or perform any other suitable operations on the data sets and / or inputs received from one or more user devices 92. Any suitable combination of memory or processing components may be included within the central controller 90. The user devices 92 may host and operate various software applications or user interfaces to present to a person using the user device 92 to facilitate interaction with the special effects communication system 10 via a communicative coupling to the central controller 90. For example, a user via a user device 92 may operate the device to change an illusion or transformation used by the first special effects communication system 10A in transmitting the appearance of a participant to a second special effects communication system 10B, which may also have a user device.Thus, the special effects communication system 10 may allow a first user to modify an illusion experienced or transmitted by the first user in addition to allowing a second user to modify an illusion experienced and / or transmitted by the first user if the illusion is not the same or a related illusion. Although not shown, each special effects communication system 10 may have respective user devices of user devices 92 associated with users (e.g., user devices belonging to the first user, user devices belonging to the second user, user devices physically located on or in the special effects communication system 10 but accessible by the first user and / or the second user). Thus, this technique may permit near-simultaneous, multi-directional, full-duplex communication between multiple devices, such as between a first user device and the first special effects communication system 10A and simultaneously between a second user device and the second special effects communication system 10B, allowing for alteration of the appearance of the second user and / or the first user simultaneously.

[0041] 6 is a flow diagram of a process 100 for providing an immersive and / or transformable communication system, and is illustrated with respect to FIGS. 1-5. Although process 100 is illustrated below as being performed by first special effects communication system 10A and / or second special effects communication system 10B, it should be understood that process 100 may also be performed by other components of system 20 provided herein. Also, it should be noted that although the following description of process 100 is set forth in a particular order, process 100 may be performed in any suitable order.

[0042] In block 102, the control system 66A of the first special effects communication system 10A detects a participant. The control system 66A can detect a participant (e.g., a first user) in response to received sensor data or via another suitable method. For example, ultrasonic sensors, light sensors, pressure pads, etc. can be used within the physical space of the first special effects communication system 10A (e.g., present inside the originating device) to detect when a user enters the physical space of the first special effects communication system 10A. Furthermore, detection can occur in response to a trigger based on a substance, prop, or material detected (e.g., recognized) by the control system 66A. A user entering the first special effects communication system 10A can be detected in response to a body part or the entire body entering the space. For example, in some embodiments, a user can place the user's head, the entire body, or different parts of the user's body in the physical space of the first special effects communication system 10A. In some embodiments, the first special effects communication system 10A can detect a participant via receipt of an initiation input from a computing device associated with the participant and / or via an input device associated with the first special effects communication system 10A. The initiation input can instruct the control system 66A to initiate a call or communication with one or more destination devices. Furthermore, the central controller 90 can send one or more initiation inputs to the control system 66A to initiate a communication operation.

[0043] In block 104, the first special effects communication system 10A can receive a destination selection (e.g., a destination device). The destination selection can be received via a user actuation of an input device, such as a dial, voice control, touch pad, button, etc., to communicate to the first special effects communication system 10A which of a plurality of destinations the user wishes to communicate with. In some embodiments, the first user can select the destination via a graphical, spatial, and / or physical user interface presented on a display device, where the graphical user interface can contribute to enhancing the user experience, for example, by matching a particular theme corresponding to the communication illusion. The destination is where the first user's appearance is transmitted from the originating device (e.g., the first special effects communication system 10A). In some embodiments, the second special effects communication system 10B can be operated to transmit voice data, image data, and any additional sensor data to the first special effects communication system 10A, regardless of the presence of a participant using the second special effects communication system 10B. Furthermore, in some embodiments, more than one selection of destinations may be made, thereby allowing the first user's appearance to be transmitted to multiple destinations and / or experienced simultaneously at multiple destinations. As described herein, the second special effects communication system 10B may transmit an appearance of a surrounding environment (e.g., ambient environment) with or without the second user.

[0044] In response to the selection of the destination, at block 106, the first special effects communication system 10A establishes a communication link with the destination, and at block 108, the second special effects communication system 10B (e.g., destination) reciprocally responds to establish a communication link. In some embodiments, a broadcast channel may be used to transmit data sets between the special effects communication systems 10, and thus the communication link may be provided via a wired (e.g., twisted pair, cable, fiber optic cable) or wireless (e.g., microwave, satellite, radio, infrared) communication medium. Through the communication link, each special effects communication system 10 (e.g., 10A, 10B) may transmit and receive image data, audio data, and any additionally collected data to communicate the appearance of the user of the special effects communication system 10. Any suitable method of communicative linking may be used, including technologies involving wires, wireless transmission, communication buses, optical fibers, and the like, as well as future technologies not yet known. Establishing the communication link enables the special effects communication systems 10 to transmit data over the communication network 18.

[0045] In block 110, the first special effects communication system 10A captures the appearance of the participant using the capture system 62A. Capturing the appearance of the participant includes recording, collecting, and transmitting audio data corresponding to speech or sounds made by the participant via the audio capture device 76A, collecting image and / or spatial data corresponding to the visual appearance of the participant via the image capture device 74A, and measuring any additional sensor data, such as position or orientation data via the tracking device 86A, to further enhance the appearance of the participant for presentation via the second special effects communication system 10B. Similarly, in block 112, the second special effects communication system 10B captures the appearance of the surrounding environment with or without the second participant using the capture system 62B. The data set generated by the capture system 62B can convey the surrounding environment and any sounds, sites, or other data associated with the surrounding environment to the first special effects communication system 10A. Any suitable image capture, audio capture, and / or data capture device may be used, including microphones, recorders, 2D capture systems, 3D capture systems, video capture systems, thermal capture systems, and the like.

[0046] In block 114, the first special effects communication system 10A triggers special effects that the participant experiences via the special effects system 68A. The special effects may relate to the appearance of the first user at the second special effects communication system 10B, environmental aspects of the environment surrounding the second special effects communication system 10B, the physical medium used to project or generate the environmental aspects of the environment surrounding the first special effects communication system 10A, further enhancing the capture of the participant's appearance, etc. The special effects may enhance and further immerse or transform the participant in communication with the second special effects communication system 10B. For example, and as described above, a participant in communication with second special effects communication system 10B that projects or generates the appearance of a participant from the operation of fog and / or water may use special effects system 68A to trigger (e.g., initiate, initiate, present) a special effect related to cold or temperature, such as a light breeze special effect, a cooling mist special effect, a cold vent special effect, etc., to immerse the participant in the medium of second special effects communication system 10B. In some embodiments, second special effects communication system 10B triggers and presents special effects to the surrounding environment, including any participants of second special effects communication system 10B, via special effects system 68B.

[0047] At block 116, the first special effects communication system 100A transmits the image data, audio data, and additional sensor data measured, recorded, or collected at block 110 to the second special effects communication system 10B. At block 118, the second special effects communication system 10B transmits the image data, audio data, and additional sensor data measured, recorded, or collected at block 112 to the first special effects communication system 10A. These transmission activities can occur substantially simultaneously with one another, thus allowing the special effects communication system 10 to achieve real-time communication between participants and / or the surrounding environment.

[0048] In block 120, the second special effects communication system 10B receives the image data, audio data, and additional sensor data captured by the first special effects communication system 10A. In block 122, the first special effects communication system 10A receives the image data, audio data, and additional sensor data captured by the second special effects communication system 10B. Thus, the special effects communication system 10 communicates the appearance of the participants and / or the surrounding environment in real time. The data set is transmitted over the communication network 18.

[0049] In response to receiving the data set, the first special effects communication system 10A generates one or more destination control signals to communicate the destination surroundings to the participants in block 124. The destination control signals are generated by the first special effects communication system 10A in response to the data set transmitted from the second special effects communication system 10B. Thus, the one or more control signals can correspond to control signals used to display image data, such as pixel control signals, programming voltages to cause emission of light based on image data, or control signals used to drive physical manipulation of a physical medium, such as generating a projection surface to project a visual appearance of the surroundings via light projection. The control signals can include audio data and / or any suitable signal to enable audio emission according to any suitable signal, and enable the use of additional sensor data in communicating the appearance of the surroundings to the participants. These control signals are used by the first special effects communication system 10A in block 126 to drive the system to display the destination surroundings via the destination control signals.

[0050] Similarly, in block 128, the second special effects communication system 10B generates one or more control signals based on the image data, audio data, and additional sensor data received from the first special effects communication system 10A. In block 130, the one or more control signals can be used by the second special effects communication system 10B to drive three-dimensional manipulation of a physical medium to display the appearance of the participant using the first special effects communication system 10A. After presenting the appearance of the participant, the second special effects communication system 10B continues to block 112 and repeats capturing the appearance of the surrounding environment into the second special effects communication system 10B. This capturing and presenting operation can continue until the first special effects communication system 10A no longer detects the participant or a stop command is issued via the control signal. In some embodiments, any time delay in communication caused by the first special effects communication system 10A to determine if the participant is still active can be compensated for by processing the data set to continue providing the illusion of real-time, immersive and / or transformable communication.

[0051] In block 132, the first special effects communication system 10A determines whether the participant is still detected. The first special effects communication system 10A can detect the participant in various ways as discussed with respect to block 102. Thus, to determine whether the participant is still detected, the first special effects communication system 10A can analyze certain sensor outputs or readings, or can analyze or determine a change in an output, or can detect a state change as part of the process to determine whether the participant is still detected. If the participant is still detected, the first special effects communication system 10A can repeat a portion of the process 100 in block 110 to capture the appearance of the participant.

[0052] However, in response to not detecting the participant in block 134, the first special effects communication system 10A may terminate the communication link with the second special effects communication system 10B to end the communication. In response to the termination of the communication link, the second special effects communication system 10B may terminate the capture of the appearance of the surrounding environment, and the first special effects communication system 10A may terminate the capture of the appearance of the participant. In addition, certain operations may be performed to reduce or eliminate special effect residual properties from the physical space of the first special effects communication system 10A. For example, the first special effects communication system 10A may operate to eliminate or reduce residual mist, fog, smoke, etc. from the physical space of the first special effects communication system 10A to provide the next participant with a neutral entrance experience to the first special effects communication system 10A. Thus, the second participant (e.g., the next participant) may not experience the previous surrounding environment associated with the original selected destination. In some embodiments, the second special effects communication system 10B may also reduce or eliminate special effects residual properties from the physical space of the second special effects communication system 10B.

[0053] As described above, the special effects communication system 10 enables immersive and transformable communication between one or more participants and one or more additional participants or surroundings. Thus, two-dimensional (2D) to 2D, 2D to three-dimensional (3D), 3D to 2D, 3D to 3D, or any suitable communication may be available via these techniques. Thus, a captured 2D image or video of a participant can be projected onto a 2D surface, typically (e.g., a fog curtain), onto or into a 2D surface, typically (e.g., an appearance formed from selectable actuation of a jet of water, whereby the negative space of the water curtain forms the appearance of the participant), onto a 2D surface (e.g., projected from light from pixels), onto a 3D surface (e.g., light projection onto a 3D fog sphere such that the appearance of the participant appears 3D within the fog sphere), or via manipulation of a physical medium or 3D material (e.g., an appearance of a participant formed from varying intensities of fire, fog, water, etc., typically projected into a 3D volume, or from actuation of putty or pins that cause a 3D appearance to emerge from a flat surface). In addition, it should be understood that the projection material (e.g., projection surface, projection plane) can be a fixed or dynamic material and / or can appear statically or dynamically in the field of view of the projection material. The physical medium can also be simulated to appear in a different physical medium using real, visual and / or theatrical effects. For example, fog cones or fog projection screens can create the illusion of fire by using visual and theatrical effects (e.g., audio and visual special effects). In summary, the projection and / or display surfaces used by display system 64 can be any suitable impression-based material or system, any suitable flat presentation system, and / or any suitable three-dimensional projection system. Additionally, in some embodiments, display system 64 can use privacy films or filters dedicated at least in part over the presented image (e.g., medium), limited field of view displays, virtual reality goggles, specialized lenses, or other theatrical effects. These display enhancements and features can also be used and applied to audio signals to enable localized sound, which can help with privacy issues.These additional features can at least in part aid in aligning the first user to a desired capture location, such as with respect to capture system 62A.

[0054] In some embodiments, additional components such as mirrors or other reflective surfaces may be included in or adjacent to the special effects communication system 10 as a way to submerge or hide or enhance, transform, or replicate components of the special effects communication system 10. Thus, the first special effects communication system 10A may be hidden from a first user while the first user is within physical range of the device (e.g., using the first special effects communication system 10A). Hiding one or more of the special effects communication systems 10 may enhance the user experience compared to not hiding the device. Furthermore, in some embodiments, facial recognition, voice recognition, content curation (e.g., speech-to-text, text-to-speech), and / or speech detection for content quarantining (e.g., blocking slang or foul language) may also be used to enhance the user experience. Furthermore, although one or more sensors are described herein, it should be understood that any suitable sensor, including thermal sensors, spatial sensors, ultrasonic sensors, infrared sensors, and the like, may be used in the special effects communication system to provide an immersive and / or transformable communication experience.

[0055] With the above in mind, in some embodiments, the special effects communication system 10 allows for subscriber-less broadcasting, which allows a first special effects communication system 10A to be communicatively linked to one or more other special effects communication systems 10 to receive one or more calls. Additionally, to reiterate, in some embodiments, the techniques described above may allow a first user of the first special effects communication system 10A to initiate a call to one or more other special effects communication systems 10 without a second, third, etc. additional user being present in or near the one or more other special effects communication systems 10. In some embodiments, the special effects communication system 10 allows for conference calling and / or multipoint communication, whereby one or more users associated with the special effects communication system 10 may each substantially simultaneously interact with one or more other users and visually see and / or communicate with one or more other users.

[0056] Additionally, although process 100 is described as terminating with the first user terminating the communication link, it should be understood that additional or alternative events can terminate the communication link. For example, a second user of the second special effects communication system 10B can decide to terminate the communication link (e.g., hang up the phone or not answer a call from the first special effects communication system 10A at the first location). As an additional example, the central controller 90 can terminate the communication link. In some embodiments, the communication link can be terminated immediately regardless of the location of the point at which process 100 is executed.

[0057] The technical effect includes an improvement to a communication system by improving the ability of the communication system to provide an immersive and / or transformable communication experience. Techniques for providing special effects while transmitting and receiving data corresponding to the appearance of a participant can enhance the user experience by allowing a user to experience the surrounding environment of the destination device with which the user is communicating. The improved communication system can also enable the simultaneous driving of physical media at the destination communication system in the communication link to enable the actuation of one or more three-dimensional presentations of the participants.

[0058] While only certain features of the present disclosure have been illustrated and described herein, many modifications and changes will occur to those skilled in the art, and it is therefore intended to cover by the appended claims all such changes and modifications that fall within the true spirit of the invention.

[0059] The technology presented and claimed herein is applied with reference to specific examples of a tangible and practical nature that clearly improve the art, and is therefore not abstract, intangible, or purely theoretical. Moreover, when any claim appended hereto includes one or more elements designated as "means for performing a function" or "step for performing a function," such elements are intended to be construed under 35 U.S.C. 112, paragraph 6. However, for any claim that includes an element designated in any other manner, such elements shall not be construed under 35 U.S.C. 112(f).

Claims

1. 1. A special effects communication system, comprising: a camera system at a first location and configured to generate a first data set based on one or more images or impressions of a first user, the first user being present at the first location; a special effects system including a controller configured to generate a special effect based at least in part on controlling components to manipulate special effects material at the first location in response to one or more control signals; a control system communicatively coupled to the camera system and the special effects system; the control system comprising: Transmitting the first data set to a destination device; receiving a second data set from the destination device or a stored data set; wherein the received second data set comprises image data generated by capture of one or more images or impressions of a second user at a second location while the first user is at the first location; The control system includes: generating the one or more control signals based on the image data; sending the one or more control signals to the controller based on the received second data set. the one or more control signals are configured to cause the controller to operate the components at the first location to generate the special effect from manipulation of the special effect material to form a representative profile of the second user based on the image data; the special effects communication system includes a sensor configured to detect a presence of the first user, and the special effects system is initiated in response to the presence of the first user and the received second data set. Special effects communication system.

2. 1. A special effects communication system, comprising: a camera system at a first location and configured to generate a first data set based on one or more images or impressions of a first user, the first user being present at the first location; a special effects system including a controller configured to generate a special effect based at least in part on controlling components to manipulate special effects material at the first location in response to one or more control signals; a control system communicatively coupled to the camera system and the special effects system; the control system comprising: Transmitting the first data set to a destination device; receiving a second data set from the destination device or a stored data set; wherein the received second data set comprises image data generated by capture of one or more images or impressions of a second user at a second location while the first user is at the first location; The control system includes: generating the one or more control signals based on the image data; sending the one or more control signals to the controller based on the received second data set. the one or more control signals are configured to cause the controller to operate the components at the first location to generate the special effect from manipulation of the special effect material to form a representative profile of the second user based on the image data; the special effects system displays one or more images or impressions of the second user on the special effects material to present an additional image of the second user; the special effects system generating a fog screen or a water screen onto which one or more images or impressions of the second user are projected; Special effects communication system.

3. 3. The special effects communication system of claim 1 or 2, wherein the special effects material comprises fire, laser, plasma, electricity, air, water, fog, putty, sand, flexible or moldable material, or any combination thereof.

4. 3. The special effects communication system of claim 1 or 2, wherein the special effects system forms a representative contour of the second user using the special effects material to present a representative contour of the second user, the special effects material including fire, laser, plasma, electricity, water, putty, sand, a flexible or moldable material, or any combination thereof.

5. 3. The special effects communication system of claim 1 or 2, wherein the special effects system is configured to drive physical manipulation of special effects material to cast a three-dimensional image of the second user from the special effects material.

6. 3. The special effects communication system of claim 1 or 2, wherein the control system is configured to extract identifiable features in one or more images or impressions of the second user from the received second data set, and a representative contour of the second user is based on the extracted identifiable features.

7. 7. The special effects communication system of claim 6, wherein the control system is configured to manipulate or deform the extracted identifiable features based on properties of the special effects material, and the representative contour of the second user is based on the manipulated or deformed identifiable features.

8. 3. The special effects communication system of claim 1 or 2, comprising an audio capture device at the first location configured to record and transmit audio data corresponding to the first user and metadata associated with the audio data, the first data set including the audio data.

9. the first data set is transmitted over a communications link; The control system includes: Detecting the first user; in response to detecting the first user, establishing the communication link with the destination device, a broadcast channel, or any combination thereof; It is configured as follows:

3. A special effect communication system according to claim 1 or 2.

10. 1. A special effects communication system, comprising: a camera system configured to capture one or more images or impressions of a first user at a first location; a communications circuit configured to transmit a first data set corresponding to one or more images or impressions of the first user and configured to receive a second data set from a destination device, the received second data set including image data generated by capture of one or more images or impressions of a second user at a second location; a special effects system configured to generate one or more control signals based on the received second data set to drive three-dimensional manipulation of a physical medium to form a representative profile of the second user from the three-dimensional manipulation of the physical medium based on the image data; Including, the special effects communication system includes a sensor configured to detect a presence of the first user, and the special effects system is initiated in response to the presence of the first user and the received second data set. Special effects communication system.

11. 11. The special effects communication system of claim 10, wherein the physical medium comprises fire, laser, plasma, electricity, air, water, fog, putty, sand, a flexible or moldable material, or any combination thereof.

12. The special effects communication system of claim 10 , wherein the sensor comprises a thermal sensor, a spatial sensor, an ultrasonic sensor, an infrared sensor, a pressure sensor, or any combination thereof.

13. 11. The special effects communication system of claim 10, including a destination device, the destination device including a second special effects system configured to generate a special effect at the second location, the special effect based on the first data set, and the special effect generated at least in part using special effects material.

14. 1. A special effects communication system, comprising: a camera system configured to capture one or more images or impressions of a first user at a first location; a communications circuit configured to transmit a first data set corresponding to one or more images or impressions of the first user and configured to receive a second data set from a destination device, the received second data set including image data generated by capture of one or more images or impressions of a second user at a second location; a special effects system configured to generate one or more control signals based on the received second data set to drive three-dimensional manipulation of a physical medium to form a representative profile of the second user from the three-dimensional manipulation of the physical medium based on the image data; Including, the special effects communication system includes the destination device, the destination device including a second special effects system configured to generate a special effect at the second location, the special effect based on the first data set, the special effect being generated at least in part using special effects material; the physical medium is smoke or fog, the special effect includes a thermal effect, and the special effect material includes smoke or fog; Special effects communication system.

15. 1. A special effects communication system, comprising: a camera system configured to capture one or more images or impressions of a first user at a first location; a communications circuit configured to transmit a first data set corresponding to one or more images or impressions of the first user and configured to receive a second data set from a destination device, the received second data set including image data generated by capture of one or more images or impressions of a second user at a second location; a special effects system configured to generate one or more control signals based on the received second data set to drive three-dimensional manipulation of a physical medium to form a representative profile of the second user from the three-dimensional manipulation of the physical medium based on the image data; Including, the special effects communication system includes the destination device, the destination device including a second special effects system configured to generate a special effect at the second location, the special effect based on the first data set, the special effect being generated at least in part using special effects material; the physical medium is a fog or mist, the special effect includes a cooling effect, and the special effect material includes a mist or fog; Special effects communication system.

16. 1. A method comprising: generating a first data set including a first image or first impression data associated with a first user at a first location; transmitting the first data set to a destination device; receiving a second data set from the destination device, the received second data set including second image or second impression data associated with a second user at a second location; generating one or more control signals based at least in part on the received second data set; transmitting the one or more control signals to a controller, the one or more control signals being configured to cause the controller to operate a special effects system at the first location to generate special effects from manipulation of special effects material to form a representative contour based on the received second data set associated with the second location of the second user; Including, the special effects system includes a sensor configured to detect a presence of the first user, and the special effects system is initiated in response to the presence of the first user and the received second data set. method.

17. The method of claim 16 , wherein the first data set includes additional sensor data used to drive the special effect at the destination device.

18. 17. The method of claim 16, wherein the one or more control signals drive three-dimensional manipulation to present the appearance at the first location of the second user at the second location.

19. 20. The method of claim 18, wherein the received second data set includes additional sensor data used to track a position, orientation, movement, or any combination thereof associated with the second user at the second location, and the one or more control signals are updated based on the additional sensor data.

Citation Information

Patent Citations

  • Television conference recording controlling system

    JP1992051690A

  • Stereoscopic picture display unit

    JP1993022753A

  • Human interface device

    JP1996205197A

  • IP telephone device and communication method using the same

    JP2013005253A

  • Screen formation device, projection system and screen control method

    JP2015179131A