SYSTEM AND METHOD FOR PROVIDING IN-APPLICATION MESSAGING - Patent application
The in-application messaging system addresses the need for enhanced amusement park experiences by encoding audio and video watermarks to provide additional information, improving entertainment value and catering to diverse guest needs.
Patent Information
- Application Number
- JP2021568794
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-08-13
- Filing Date
- 2020-05-19
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2040-05-19
AI Technical Summary
Amusement park guests desire additional information related to attractions, and some may have difficulty hearing audio presentations, necessitating enhanced communication systems for improved entertainment experiences.
An in-application messaging system that encodes audio and video watermarks within audio and video signals, allowing portable electronic devices to decode and display additional information such as captions, translations, and hidden secrets based on these watermarks.
Enhances amusement park experiences by providing additional information to guests through encoded audio and video watermarks, catering to diverse needs and improving entertainment value.
Smart Images

Figure 0007579809000001 
Figure 0007579809000002 
Figure 0007579809000003
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application No. 62 / 852,660, filed May 24, 2019, and entitled "Systems and Methods for Providing In-Application Messaging," which is incorporated herein by reference in its entirety for all purposes.
[0002] FIELD OF THE DISCLOSURE The present disclosure relates generally to systems and methods for providing in-application messaging. More specifically, embodiments of the present disclosure generally relate to systems and methods for enabling guests at an amusement park to view in-application messaging related to an amusement park attraction that is generated via an audio watermark encoded in the audio provided for that particular attraction. [Background technology]
[0003] Amusement parks may include a variety of entertainment attractions, restaurants, souvenir shops, and rides that are useful in providing enjoyment to guests (e.g., families and / or people of all ages) of the park. These attractions may involve audio and / or video presentations that contribute to entertainment value. However, guests of the amusement park may desire additional information related to the attractions. Also, some guests may not be able to hear as well as others, and therefore providing additional information related to the attractions may be appreciated.
[0004] This section is intended to introduce the reader to various aspects of the art that may be related to various aspects of the present technology described and / or claimed below. This discussion is believed to be helpful in providing the reader with background to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art. Summary of the Invention [Means for solving the problem]
[0005] The following summarizes certain embodiments common in scope to the originally claimed subject matter. These embodiments are not intended to limit the scope of the claimed subject matter, but rather to outline possible forms of the subject matter. Indeed, the subject matter may include a variety of forms that may be similar to or different from the embodiments set forth below.
[0006] In some embodiments, an in-application messaging system includes an audio generation system configured to encode at least one audio watermark within an audio signal and broadcast the audio signal within a physical environment. The in-application messaging system also includes a portable electronic device configured to receive an audio signal from the physical environment, identify the at least one audio watermark encoded within the audio signal, and display in-application messaging information via an application operating on the portable electronic device. The in-application messaging information is based at least in part on the at least one audio watermark.
[0007] In some embodiments, the portable electronic device also includes an audio sensor configured to detect audio signals broadcast within the physical environment. The portable electronic device also includes processing circuitry configured to identify at least one audio watermark encoded within the audio signals and cause a display of the portable electronic device to display in-application messaging information based at least in part on the at least one audio watermark.
[0008] Additionally, in some embodiments, the in-application messaging system includes an audio generation system configured to encode at least one audio watermark within an audio signal. The in-application messaging system also includes one or more audio systems configured to broadcast audio signals within the physical environment.
[0009] Various refinements of the features described above may be made in relation to the various aspects of the disclosure. Further features may also be incorporated into these various aspects. These refinements and further features may exist individually or in any combination.
[0010] These and other features, aspects, and advantages of the present disclosure will be better understood when read in conjunction with the following detailed description and the accompanying drawings, in which like elements are designated with like reference characters throughout. [Brief description of the drawings]
[0011] [Figure 1] 1 is a schematic representation of an amusement park configured to provide in-application messaging via portable electronic devices used by guests of the amusement park, according to an embodiment of the present disclosure. [Diagram 2] 1 is a schematic diagram of an in-application messaging system that provides in-application messaging via an application running on a portable electronic device, according to an embodiment of the present disclosure. [Diagram 3]1 is a screenshot illustrating a main menu screen of an application of an in-application messaging system according to an embodiment of the present disclosure. [Figure 4] 11 is a depiction of a prompt for a guest to confirm access to an audio device of a portable electronic device running an application, according to an embodiment of the present disclosure. [Diagram 5] 1 is a screenshot of an application of an in-application messaging system notifying a guest that in-application messaging will appear through the application, according to an embodiment of the present disclosure. [Figure 6] 1 is a screenshot of an application of an in-application messaging system showing in-application messaging being presented through the application, according to an embodiment of the present disclosure. [Figure 7] 11 is a depiction of a prompt for a guest to confirm access to the camera of a portable electronic device running an application, according to an embodiment of the present disclosure. [Figure 8] 1 is a screenshot of an application of an in-application messaging system illustrating in-application messaging related to a captured video presented via the application, according to an embodiment of the present disclosure. [Figure 9] 11 is a screenshot of an application of an in-application messaging system showing a guest being presented with a message that they must enable access to an audio device of a portable electronic device, according to an embodiment of the present disclosure. [Figure 10] 11 is a screenshot of an application of an in-application messaging system showing a guest being presented with a message that access to the camera on the portable electronic device must be enabled, in accordance with an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, one or more specific embodiments of the present disclosure will be described. In order to concisely describe these embodiments, not all features of the implementations may be described herein. It is to be understood that in the development of any such implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's particular objectives, such as compliance with system-related and business-related constraints that may vary from implementation to implementation. Moreover, it is to be understood that such development efforts may be complex and time-consuming, but are routine endeavors of design, fabrication, and manufacture for those skilled in the art having the benefit of this disclosure. Furthermore, to the extent that specific terms, such as parallel and perpendicular, are used in the present invention, it is to be understood that these terms allow for deviations from strict mathematical definitions, such as deviations related to manufacturing imperfections and related tolerances.
[0013] When introducing elements of various embodiments of the disclosure, the articles "a," "an," and "the" are intended to mean the presence of one or more of the element. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. It should also be understood that references to "one embodiment" or "an embodiment" of the disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also contain the recited features.
[0014] Amusement park attractions have become increasingly popular, resulting in the creation of a variety of amusement park attractions that provide unique audiovisual experiences for amusement park guests. However, ancillary systems and methods that further enhance these experiences are desirable. For example, embodiments described herein facilitate the communication of additional information related to various amusement park attractions via portable electronic devices, such as mobile phones (e.g., smartphones), tablet computers, wearable devices (e.g., glasses, goggles, watches, etc.), or any other suitable device that may be carried by an amusement park guest. Specifically, in some embodiments, an in-application messaging system may be used to broadcast audio within the physical environment of the amusement park attraction that includes an audio watermark that encodes data related to captions related to the amusement park attraction, data related to multilingual messaging related to the amusement park attraction, data related to special guided tours related to the amusement park attraction, data related to hidden secrets related to the amusement park attraction, and the like. The portable electronic device may receive the broadcasted audio and, depending on a particular setting of the particular portable electronic device (e.g., whether in-application messaging is selected), may cause an application running on the particular portable electronic device to display information related to the data encoded within the audio watermark.
[0015] Additionally, in some embodiments, depending on whether the camera of a particular portable electronic device is activated (e.g., by a guest using the portable electronic device), information related to the data encoded within the audio watermark may be displayed on the portable electronic device along with images and / or videos captured by the camera of the portable electronic device. Additionally, in some embodiments, an in-application messaging system may be used to encode a video watermark within particular cinematic presentations associated with an amusement park attraction. If the camera of the portable electronic device is activated, it may detect the video watermark by capturing video of the cinematic presentation, and depending on a particular setting of the particular portable electronic device (e.g., whether in-application messaging is selected), an application running on the particular portable electronic device may be caused to display information related to the data encoded within the video watermark.
[0016] With this in mind, FIG. 1 is a schematic representation of an amusement park 10 configured to provide in-application messaging via portable electronic devices 12 used by guests 20 of the amusement park 10. As shown, in some embodiments, the amusement park 10 includes an in-application messaging system 14 configured to encode an audio watermark within audio provided via one or more audio systems 16 located within the amusement park 10 that can be used by the portable electronic devices 12 to provide in-application messaging (e.g., captions, multilingual messaging, special guided tours, hidden secrets, etc.) regarding various attractions of the amusement park 10. For example, an audio system 16 located within a particular attraction of the amusement park 10 can provide audio associated with the particular attraction, which audio can include an audio watermark specifically associated with the particular attraction. In the embodiment shown in FIG. 1, the in-application messaging system 14 includes a wireless communication system 18 configured to facilitate communication of the audio to the audio systems 16 located throughout the amusement park 10. In other words, the in-application messaging system 14 may be implemented as a centralized system that communicates wirelessly with audio systems 16 located throughout the amusement park 10. However, in other embodiments, the in-application messaging system 14 may be local to a particular attraction 24.
[0017] Thus, the embodiments described herein facilitate the provision of in-application messaging via portable electronic devices 12 carried by guests 20 by detecting audio watermarks encoded in audio received from audio systems 16 located throughout the amusement park 10. For example, while the guest 20 is waiting in a queue 22 to board a particular attraction 24 (e.g., a ride), in-application messaging related to the particular attraction 24 at which the guest 20 is waiting in the queue 22 to board may be provided to the guest 20 to entertain the guest 20 while the guest 20 is waiting in the queue 22 to board. As another example, while a particular cinematic presentation is being presented (e.g., via one or more display systems 28) at a particular attraction (e.g., theater 26), in-application messaging related to the particular cinematic presentation may be provided to the guest 20 to provide additional information related to the cinematic presentation to the guest 20. Indeed, in-application messaging related to any type of attraction at the amusement park 10 may be provided. For example, in-app messaging may be provided in and around water slides 30 and other types of thrill rides, recreational areas, and the like. Additionally, in-app messaging can be provided for non-ride attractions such as restaurants 32 and themed park areas 34 (e.g., park "villages").
[0018] As described in further detail herein, in-application messaging can be provided via an application running on a portable electronic device 12 in the possession of the guest 20. In some embodiments, the guest 20 can be provided with an admission credential (e.g., a ticket or an active wearable capable of running an application providing in-application messaging) when the guest 20 arrives at the entrance passage 36 (e.g., a hotel reception, a kiosk, a guest service counter, a park gate), among other items such as an amusement park map, virtual queue instructions, and amenity instructions. However, in some cases, the guest 20 may have obtained an admission credential prior to arrival and skip obtaining such a credential at the entrance passage 36. In such a situation, the admission credential can be linked to an application running on a portable electronic device 12 in the possession of the guest 20. Information media (e.g., audio, video) and instructional signage can be present at the entrance passage 36. Furthermore, in some embodiments, if the guest 20 does not have the application installed on his / her portable electronic device 12, the guest can be prompted to download the application as he / she passes through the entrance passage (or shortly thereafter). As described in further detail herein, the audio and video presented at the entrance corridor 36 may also be supplemented with in-application messaging via applications running on the portable electronic devices 12 of the guests 20. In some situations, if the guests 20 do not have portable electronic devices 12, the portable electronic devices 12 may be distributed to the guests at, for example, kiosks 38 in the entrance corridors 36 of the amusement park 10.
[0019] As described in more detail herein, in-application messaging is provided to portable electronic device 12 via in-application messaging system 14 which may include one or more computers 40, each of which may include at least one processor 42 and at least one memory 44 and be capable of communicating audio including audio watermarks to audio systems 16 located throughout amusement park 10.
[0020] 2 is a schematic diagram of an in-application messaging system 14 that provides in-application messaging via applications running on portable electronic devices 12 owned by guests 20 or distributed by the amusement park 10 to guests 20. As shown in FIG. 2, in some embodiments, the in-application messaging system 14 may include one or more portable electronic devices 12 available for use by guests 20 at the amusement park 10. Also, as also shown in FIG. 2, in some embodiments, the in-application messaging system 14 may include an audio generation system 46 configured to generate audio 48 including an encoded audio watermark 50 that may be broadcast by one or more audio systems 16 located throughout the amusement park 10 and detected by the one or more portable electronic devices 12 to generate in-application messaging that may be displayed via applications running on the one or more portable electronic devices 12. 2, in some embodiments, the in-application messaging system 14 may include a video generation system 52 configured to generate a video 54 including an encoded video watermark 56 that may be broadcast by one or more display systems 28 located throughout the amusement park 10 and detected by one or more portable electronic devices 12 to generate in-application messaging that may be displayed via an application operating on the one or more portable electronic devices 12. It will be appreciated that in some embodiments, the in-application messaging system 14 shown in FIG. 2 may be used only to provide in-application messaging for a particular attraction at the amusement park 10. However, in other embodiments, the in-application messaging system 14 may be used to coordinately provide in-application messaging for any number, if not all, of the attractions at the amusement park 10.
[0021] As shown in FIG. 2 , in some embodiments, audio generation system 46 may include processing circuitry, such as a processor 58 and memory 60, that may be used to generate audio 48 that includes an audio watermark 50 associated with a particular attraction at amusement park 10. In particular, the processor 58 may execute processor-executable instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 60 and / or other storage, to generate an audio watermark 50 utilizing an audio watermarking algorithm, such as a spread spectrum audio watermarking algorithm, a low bit audio watermarking algorithm, a phase coding audio watermarking algorithm, an echo hiding audio watermarking algorithm, a time scale modification audio watermarking algorithm, an amplitude modification audio watermarking algorithm, a replica modulation audio watermarking algorithm, a dither audio watermarking algorithm, a self-marking audio watermarking algorithm, or any combination thereof, and to encode the audio watermark 50 within the audio 48 provided to the one or more audio systems 16. In some embodiments, the processor 58 may be a general-purpose processor, a system-on-chip (SoC) device, an application specific integrated circuit (ASIC), or some other similar processor configuration.
[0022] In some embodiments, the audio production system 46 may be configured to communicate audio 48 to one or more audio systems 16 located throughout the amusement park 10 via a wireless communication system 18 (e.g., a wireless local area network (WLAN), a wireless wide area network (WWAN), a near field communication (NFC) network, or any other suitable wireless network). In such embodiments, the audio production system 46 may include communications circuitry 62 configured to wirelessly communicate with communications circuitry 64 of one or more audio systems 16 to transmit the audio 48 to the one or more audio systems 16. However, in other embodiments, particularly those in which the audio production system 46 only provides audio 48 for a particular attraction in the amusement park 10, the communications circuitry 62 of the audio production system 46 may be directly coupled to the communications circuitry 64 of the one or more audio systems 16 via a cable, such as, for example, a sound cable and a communications cable.
[0023] In some embodiments, one or more of the audio systems 16 may also include processing circuitry, such as a processor 66 and memory 68, that may be used to process audio 48 received from the audio production system 46 and broadcast the audio 48 within the physical environment surrounding the one or more audio systems 16. In particular, the processor 66 may execute processor-executable instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 68 and / or other storage, to process the audio 48 received from the audio production system 46 and broadcast the audio 48. In some embodiments, the processor 66 may be a general-purpose processor, a system-on-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration.
[0024] In some embodiments, the portable electronic device 12 may be a mobile phone (e.g., a smartphone), a tablet computer, a wearable device (e.g., augmented reality (AR) glasses, AR goggles, and watches), or any other suitable device that a guest 20 may carry around within the amusement park 10 configured to execute an application that displays in-application messaging information related to a particular attraction at the amusement park 10 based at least in part on an audio watermark 50 encoded in the audio 48 that can be detected by one or more audio sensors 70 (e.g., microphones, etc.) of the portable electronic device 12. In some embodiments, the one or more audio sensors 70 may detect the audio 48 by passively listening to the audio 48. However, in other embodiments, the one or more audio sensors 70 may be prompted to actively listen to the audio 48 based at least in part on a user request received via an input device 72 (e.g., buttons, touch screen, etc.) of the portable electronic device 12.
[0025] In some embodiments, the portable electronic device 12 may include processing circuitry, such as a processor 74 and memory 76, to provide in-application messaging based at least in part on an audio watermark 50 encoded within the received audio 48. In some embodiments, the processor 74 may be a general purpose processor, a system on a chip (SoC) device, an application specific integrated circuit (ASIC), or some other similar processor configuration. The processor 74 may execute processor-executable instructions stored in a tangible, non-transitory computer readable medium, such as the memory 76 and / or other storage, that identify the audio watermark 50 encoded within the audio 48 and cause a display 78 of the portable electronic device 12 to display in-application messaging information 80 based at least in part on the audio watermark 50. In some embodiments, the processor 74 may execute processor-executable instructions to identify the audio watermark 50 by decoding the audio watermark 50 encoded within the audio 48 using an audio watermarking algorithm, such as a spread spectrum audio watermarking algorithm, a low bit audio watermarking algorithm, a phase coding audio watermarking algorithm, an echo hiding audio watermarking algorithm, a time scale modification audio watermarking algorithm, an amplitude modification audio watermarking algorithm, a replica modulation audio watermarking algorithm, a dither audio watermarking algorithm, a self-marking audio watermarking algorithm, or any combination thereof.
[0026] In some embodiments, the processor 74 may execute processor-executable instructions to locally determine the in-application messaging information 80 based at least in part on the audio watermark 50, for example by accessing the in-application messaging information 80 from a tangible, non-transitory computer readable medium, such as the memory 76 and / or other storage of the portable electronic device 12. However, in other embodiments, the processor 74 may execute processor-executable instructions to cause the communications circuitry 82 of the portable electronic device 12 to wirelessly transmit a signal indicative of the audio watermark 50 to the communications circuitry 62 of the audio production system 46, which is configured to determine the in-application messaging information 80 based at least in part on the signal received from the portable electronic device 12, for example by accessing the in-application messaging information 80 from a tangible, non-transitory computer readable medium, such as the memory 60 and / or other storage of the audio production system 46, and transmit the in-application messaging information 80 back to the portable electronic device 12 via wireless communications of the communications circuitry 62, 82.
[0027] In some embodiments, the in-application messaging information 80 may include closed caption information, open caption information, live caption information, multilingual translation information, guided tour information, hidden secret information, or any combination thereof. For example, in some embodiments, the in-application messaging information 80 may include captions directly related to the audio 48 and / or video 54 being broadcast near a particular attraction 24 at the amusement park 10. In other embodiments, the in-application messaging information 80 may include multilingual translations related to the audio 48 and / or video 54 being broadcast near a particular attraction 24 at the amusement park 10. For example, if the settings on the portable electronic device 12 used by the guest 20 indicate that Spanish is the preferred language, while the audio 48 and / or video 54 being broadcast near a particular attraction 24 at the amusement park 10 is English, the in-application messaging information 80 may provide a translation of the audio 48 and / or video 54. In other embodiments, the in-application messaging information 80 may include, for example, guided tour information that may provide further information about a particular attraction 24 and / or the overall amusement park 10. In other embodiments, the in-application messaging information 80 may include hidden secrets about a particular attraction 24 and / or the overall amusement park 10 that other guests 20 may not know.
[0028] As described in further detail herein, the processor 74 of the portable electronic device 12 may execute processor-executable instructions to execute an application 84 that displays the in-application messaging information 80 via a display 78 of the portable electronic device 12. In some embodiments, the processor 74 may execute processor-executable instructions to launch the application 84 in response to identifying the audio watermark 50. In other embodiments, if the in-application messaging information 80 is determined locally by the portable electronic device 12, the processor 74 may execute processor-executable instructions to launch the application 84 in response to determining the in-application messaging information 80. In other embodiments, if the in-application messaging information 80 is determined by the audio generation system 46, the audio generation system 46 may send a control signal to the portable electronic device 12 to launch the application 84 in response to determining the in-application messaging information 80 and display the in-application messaging information 80 via the application 84.
[0029] Similarly, the video generation system 52 may include processing circuitry, such as a processor 86 and memory 88, that may be used to generate a video 54 that includes a video watermark 56 associated with a particular attraction at the amusement park 10. In particular, the processor 86 may execute processor-executable instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 88 and / or other storage, to generate a video watermark 56 utilizing a video watermark algorithm, such as a spread spectrum video watermark algorithm, a low bit video watermark algorithm, a phase encoding video watermark algorithm, an echo hiding video watermark algorithm, a time scale modification video watermark algorithm, an amplitude modification video watermark algorithm, a replica modulation video watermark algorithm, a dither video watermark algorithm, a self-marking video watermark algorithm, or any combination thereof, and to encode the video watermark 56 within the video 54 that is provided to the one or more display systems 28. In some embodiments, the processor 86 may be a general purpose processor, a system on a chip (SoC) device, an application specific integrated circuit (ASIC), or some other similar processor configuration.
[0030] In some embodiments, the video generation system 52 may be configured to communicate the video 54 via the wireless communication system 18 to one or more display systems 28 located throughout the amusement park 10. In such embodiments, the video generation system 52 may include communications circuitry 90 configured to wirelessly communicate with the communications circuitry 92 of the one or more display systems 28 to transmit the video 54 to the one or more display systems 28. However, in other embodiments, particularly those in which the video generation system 52 only provides video 54 for a particular attraction at the amusement park 10, the communications circuitry 90 of the video generation system 52 may be directly coupled to the communications circuitry 92 of the one or more display systems 28 via cables, such as, for example, a video cable and a communications cable.
[0031] In some embodiments, the one or more display systems 28 may also include processing circuitry, such as a processor 94 and memory 96, that may be used to process video 54 received from the video generation system 52 and broadcast the video 54 within the physical environment surrounding the one or more display systems 28. In particular, the processor 94 may execute processor-executable instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 96 and / or other storage, for processing video 54 received from the video generation system 52 and broadcasting the video 54. In some embodiments, the processor 94 may be a general-purpose processor, a system-on-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other similar processor configuration.
[0032] In some embodiments, the portable electronic device 12 may be configured to execute an application 84 that displays in-application messaging information 80 associated with a particular attraction at the amusement park 10 based at least in part on a video watermark 56 encoded in the video 54 that can be detected by one or more cameras 98 of the portable electronic device 12. Notably, in some embodiments, one or more cameras 98 may be aimed at the video 54 such that the video 54 can be detected by the one or more cameras 98 by the guest 20. Also, as described in more detail herein, in some embodiments, the processor 74 of the portable electronic device 12 may execute processor-executable instructions that cause any video captured by the one or more cameras 98 to be displayed via the application 84 associated with the in-application messaging information 80.
[0033] In some embodiments, to provide intra-application messaging based at least in part on a video watermark 56 encoded within a received video 54, a processor 74 of the portable electronic device 12 may execute processor-executable instructions that cause a display 78 of the portable electronic device 12 to identify a video watermark 56 encoded within the video 54 and display intra-application messaging information 80 based at least in part on the video watermark 56. In some embodiments, the processor 74 may execute processor-executable instructions that identify the video watermark 56 by decoding the video watermark 56 encoded within the video 54 using a video watermarking algorithm, such as a spread spectrum video watermarking algorithm, a low bit video watermarking algorithm, a phase encoding video watermarking algorithm, an echo hiding video watermarking algorithm, a time scale modification video watermarking algorithm, an amplitude modification video watermarking algorithm, a replica modulation video watermarking algorithm, a dither video watermarking algorithm, a self-marking video watermarking algorithm, or any combination thereof.
[0034] In some embodiments, the processor 74 of the portable electronic device 12 may execute processor-executable instructions to locally determine the in-application messaging information 80 based at least in part on the video watermark 56 by accessing the in-application messaging information 80 from a tangible, non-transitory computer-readable medium, such as, for example, the memory 76 and / or other storage of the portable electronic device 12. However, in other embodiments, the processor 74 may execute processor-executable instructions to cause the communications circuitry 82 of the portable electronic device 12 to wirelessly transmit a signal indicative of the video watermark 56 to the communications circuitry 90 of the video production system 52, which is configured to determine the in-application messaging information 80 based at least in part on the signal received from the portable electronic device 12 by accessing the in-application messaging information 80 from a tangible, non-transitory computer-readable medium, such as, for example, the memory 88 and / or other storage of the video production system 52, and transmit the in-application messaging information 80 back to the portable electronic device 12 via wireless communications of the communications circuitry 82, 90.
[0035] As described in further detail herein, the processor 74 of the portable electronic device 12 may execute processor-executable instructions to execute an application 84 that displays the in-application messaging information 80 via a display 78 of the portable electronic device 12. In some embodiments, the processor 74 may execute processor-executable instructions to launch the application 84 in response to identifying the video watermark 56. In other embodiments, if the in-application messaging information 80 is determined locally by the portable electronic device 12, the processor 74 may execute processor-executable instructions to launch the application 84 in response to determining the in-application messaging information 80. In other embodiments, if the in-application messaging information 80 is determined by the video generation system 52, the video generation system 52 may send a control signal to the portable electronic device 12 to launch the application 84 in response to determining the in-application messaging information 80 and display the in-application messaging information 80 via the application 84.
[0036] In-application messaging provided by the in-application messaging system 14 described herein may be optional for guests 20 of the amusement park 10. FIGS. 3-10 show a series of screenshots of an application 84 described herein to illustrate how guests 20 may participate in certain in-application messaging features described herein. The series of screenshots show options presented by the application 84 related to in-application captioning information, although it will be understood that the application 84 may present similar options related to other types of in-application messaging information 80. FIG. 3 shows screenshots of a main menu screen 100 of the application 84, including an "In-application Captioning Available" menu option 102 that a guest 20 may select via the application 84 to enable in-application captioning information via the application 84. If the guest 20 selects the "With In-Application Captions" menu option 102, a prompt 104 may be initiated via the application 84 confirming that the guest 20 approves the application 84 to access the audio sensor 70 (e.g., microphone) of the portable electronic device 12 on which the application 84 is running (see, e.g., FIG. 4). If the guest 20 selects "Okay" via the prompt 104 (i.e., enables the audio sensor 70 of the portable electronic device 12), the application 84 will advise the guest that the in-application captions will begin to appear automatically as soon as the portable electronic device 12 (specifically, the audio sensor 70 of the portable electronic device 12) comes within range of an audio source (e.g., the audio system 16 of the amusement park 10) (e.g., when the audio sensor 70 of the portable electronic device 12 listens for audio 48, which may include an audio watermark 50, as described in further detail herein) (see, e.g., FIG. 5).It will be appreciated that when the portable electronic device 12 is not within range of an audio source, a blank screen may be displayed via the application 84 .
[0037] As described in more detail herein, in some embodiments, the in-application messaging information 80 displayed via the application 84 (e.g., the in-application caption information shown in FIG. 6) may be supplemented with video 108 captured by one or more cameras 98 of the portable electronic device 12 running the application 84. For example, the application 84 may display a camera icon 106 that, when selected by the guest 20 via the application 84, may enable video 108 captured via one or more cameras 98 of the portable electronic device 12 running the application 84 to be displayed along with the in-application messaging information 80. FIG. 6 illustrates an application 84 with in-application messaging enabled but with the camera 98 of the portable electronic device 12 disabled. When the guest 20 clicks on the camera icon 106, a prompt 110 may be initiated via the application 84 to confirm that the guest 20 approves the application 84 to access the camera 98 of the portable electronic device 12 running the application 84 (see, e.g., FIG. 7). If the guest 20 selects "OK" via the prompt 110 (i.e., enables the camera 98 of the portable electronic device 12), the application 84 will begin displaying video 108 captured via one or more cameras 98 of the portable electronic device 12 running the application 84, along with, for example, in-application messaging information 80 overlaid on the video 108 (see, e.g., FIG. 8 ). It will be appreciated that the guest 20 can turn the video 108 on and off by clicking the camera icon 106.
[0038] In some cases, the particular settings of the portable electronic device 12 being used by the guest 20 may not have been selected to allow the application 84 to use the audio sensors 70 (e.g., microphone) or camera 98 of the portable electronic device 12. In such a case, the application may prompt the user that access to these components of the portable electronic device 12 is required to enable a particular feature selected by the guest 20 via the application 84. For example, FIG. 9 illustrates the application 84 displaying a message 112 to the guest 20 informing the guest 20 that access to the audio sensors 70 (e.g., microphone) of the portable electronic device 12 must be enabled in order to use the in-application messaging feature of the application 84, and FIG. 10 illustrates the application 84 displaying a message 114 to the guest 20 informing the guest 20 that access to the camera 98 of the portable electronic device 12 must be enabled in order to use the video capture feature of the portable electronic device 12.
[0039] While only certain features have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes which fall within the true spirit of the disclosure.
[0040] The technology presented and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that positively improve the art and are therefore not abstract, intangible, or purely theoretical. Moreover, if any claim appended at the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," such elements are to be construed pursuant to 35 U.S.C. 112(f). On the other hand, for any claim containing an element designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]
[0041] 12 Portable electronic devices 14 In-Application Messaging Systems 16 Audio system 18 Wireless communication networks 28 Display Systems 46 Audio Generation Systems 48 Audio 50 Watermark 52 Video Generation System 54 Videos 56 Watermark 58 Processors 60 Memory 62 Communication Circuits 64 Communication Circuits 66 processors 68 Memory 70 Audio Sensor 72 Input Devices 74 processors 76 Memory 78 Display 80 In-Application Messaging Information 82 Communication Circuits 84 Applications 86 processors 88 Memory 90 Communication Circuits 92 Communication Circuits 94 Processors 96 Memory 98 Camera
Claims
1. 1. An in-application messaging system, comprising: an audio generation system configured to encode at least one audio watermark within an audio signal generated for a cinematic presentation of an amusement park attraction and broadcast said audio signal within a physical environment; a portable electronic device configured to receive the audio signal from the physical environment of the amusement park, identify the at least one audio watermark encoded within the audio signal, and display, during the cinematic presentation of the attraction, via an application operating on the portable electronic device, in-application messaging information related to the cinematic presentation of the attraction; the in-application messaging information is based at least in part on the at least one audio watermark, the in-application messaging information complementing the cinematic presentation of the attraction; The portable electronic device comprises: configured to wirelessly receive from the audio production system the in-application messaging information related to the cinematic presentation of the attraction. An in-application messaging system comprising:
2. the portable electronic device is configured to determine the in-application messaging information associated with the cinematic presentation of the attraction based at least in part on the at least one audio watermark. The in-application messaging system of claim 1 .
3. the portable electronic device is configured to access the in-application messaging information related to the cinematic presentation of the attraction from a computer readable storage medium of the portable electronic device. The in-application messaging system of claim 2 .
4. the portable electronic device is configured to transmit a signal indicative of the at least one audio watermark to the audio generation system to determine the in-application messaging information at the audio generation system, the audio generation system being configured to determine the in-application messaging information associated with the cinematic presentation of the attraction based at least in part on the signal received from the portable electronic device, and to transmit the in-application messaging information associated with the cinematic presentation of the attraction to the portable electronic device. The in-application messaging system of claim 1 .
5. the audio generation system is configured to send a control signal to the portable electronic device to initiate the application in response to determining the in-application messaging information related to the cinematic presentation of the attraction. The in-application messaging system of claim 4.
6. a video production system configured to encode at least one video watermark into a video signal generated for the cinematic presentation of the attraction and broadcast the video signal into the physical environment of the amusement park, the portable electronic device configured to receive the video signal from the physical environment of the amusement park and identify the at least one video watermark encoded into the video signal, and the in-application messaging information is based at least in part on the at least one video watermark. The in-application messaging system of claim 1 .
7. the portable electronic device is configured to identify the at least one audio watermark using a spread spectrum audio watermark algorithm, a low bit audio watermark algorithm, a phase coding audio watermark algorithm, an echo hiding audio watermark algorithm, a time scale modification audio watermark algorithm, an amplitude modification audio watermark algorithm, a replica modulation audio watermark algorithm, a dither audio watermark algorithm, a self-marking audio watermark algorithm, or any combination thereof; The in-application messaging system of claim 1 .
8. the in-application messaging information related to the cinematic presentation of the attraction includes closed caption information, open caption information, live caption information, multilingual translation information, guided tour information, hidden secret information, or any combination thereof; The in-application messaging system of claim 1 .
9. 1. A portable electronic device comprising: one or more audio sensors configured to detect audio signals broadcast within the physical environment of the amusement park as part of a cinematic presentation of an attraction at the amusement park; a processing circuit configured to identify at least one audio watermark encoded within the audio signal and, during the cinematic presentation of the attraction, cause a display of the portable electronic device to display in-application messaging information related to the cinematic presentation of the attraction based at least in part on the at least one audio watermark; the in-application messaging information complements the cinematic presentation of the attraction; The processing circuitry includes: configured to wirelessly receive the in-application messaging information related to the cinematic presentation of the attraction.
1. A portable electronic device comprising:
10. the processing circuitry is configured to determine the in-application messaging information associated with the cinematic presentation of the attraction based at least in part on the at least one audio watermark.
10. The portable electronic device of claim 9.
11. the processing circuitry is configured to access the in-application messaging information related to the cinematic presentation of the attraction from a computer readable storage medium of the portable electronic device.
11. The portable electronic device of claim 10.
12. the processing circuitry is configured to initiate an application in response to identifying the at least one audio watermark.
11. The portable electronic device of claim 10.
13. the one or more audio sensors are configured to detect the audio signal by passively listening for the audio signal; 11. The portable electronic device of claim 10.
14. the one or more audio sensors are configured to detect the audio signal by actively requesting the audio signal based at least in part on user input received via an input device of the portable electronic device.
11. The portable electronic device of claim 10.
15. at least one camera configured to capture video, the processing circuitry configured to cause the display of the portable electronic device to display the video along with the in-application messaging information related to the cinematic presentation of the attraction.
11. The portable electronic device of claim 10.
16. at least one camera configured to receive a video signal broadcast within the physical environment of the amusement park as part of the cinematic presentation of the attraction at the amusement park, the processing circuitry configured to identify at least one video watermark encoded within the video signal and cause the display of the portable electronic device to display the in-application messaging information related to the cinematic presentation of the attraction based at least in part on the video watermark.
11. The portable electronic device of claim 10.
17. the processing circuitry is configured to identify the at least one audio watermark using a spread spectrum audio watermark algorithm, a low bit audio watermark algorithm, a phase coding audio watermark algorithm, an echo hiding audio watermark algorithm, a time scale modification audio watermark algorithm, an amplitude modification audio watermark algorithm, a replica modulation audio watermark algorithm, a dither audio watermark algorithm, a self-marking audio watermark algorithm, or any combination thereof; 11. The portable electronic device of claim 10.
18. the in-application messaging information related to the cinematic presentation of the attraction includes closed caption information, open caption information, live caption information, multilingual translation information, guided tour information, hidden secret information, secret information, or any combination thereof; 11. The portable electronic device of claim 10.
19. 1. An in-application messaging system, comprising: an audio generation system configured to encode at least one audio watermark within an audio signal; one or more audio systems configured to receive the audio signals and broadcast the audio signals within the physical environment of the amusement park during a cinematic presentation of an attraction at the amusement park as part of the cinematic presentation of the attraction; wherein the audio signal complements the cinematic presentation of the attraction; The audio production system comprises: receiving a signal from a portable electronic device indicative of at least one audio watermark encoded within the audio signal; determining in-application messaging information associated with the cinematic presentation of the attraction based at least in part on the signal received from the portable electronic device; transmitting the in-application messaging information related to the cinematic presentation of the attraction to the portable electronic device; It is configured as follows: An in-application messaging system comprising:
20. the audio generation system is configured to send a control signal to the portable electronic device that displays the in-application messaging information via an application running on the portable electronic device.
20. The in-application messaging system of claim 19.
21. the audio generation system is configured to send a control signal to the portable electronic device to initiate the application in response to determining the in-application messaging information related to the cinematic presentation of the attraction.
21. The in-application messaging system of claim 20.
22. the in-application messaging information related to the cinematic presentation of the attraction includes closed caption information, open caption information, live caption information, multilingual translation information, guided tour information, hidden secret information, or any combination thereof; 20. The in-application messaging system of claim 19.
23. the audio generating system is configured to encode the at least one audio watermark within the audio signal using a spread spectrum audio watermarking algorithm, a low bit audio watermarking algorithm, a phase coding audio watermarking algorithm, an echo hiding audio watermarking algorithm, a time scale modification audio watermarking algorithm, an amplitude modification audio watermarking algorithm, a replica modulation audio watermarking algorithm, a dither audio watermarking algorithm, a self-marking audio watermarking algorithm, or any combination thereof; 20. The in-application messaging system of claim 19.
Citation Information
Patent Citations
Image processing method in camera attached communication apparatus, image processing apparatus in camera attached communication apparatus, program, and computer-readable recording medium
JP2005150849A
Information display method, system, and program
JP2007174108A
Content playback device controlled with acoustic signal
JP2009180893A
How to unlock game content
JP2019502506A
Enhanced digital media platform with user control of application data thereon
US20180225717A1
