Signal adapter and somatosensory signal generation method
Through the signal transceiver unit and processing module of the signal adapter, the somatosensory signal is analyzed and generated, which solves the problem of the control signal converted into somatosensory vibration in electronic games, and improves the immersion of the player's experience.
Patent Information
- Application Number
- CN202311781919.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-06-30
- Filing Date
- 2023-12-21
- Publication Date
- 2024-12-31
AI Technical Summary
The prior art is difficult to effectively convert control signals in electronic games into somatosensory vibration signals, resulting in insufficient immersion in the player experience.
A signal adapter is designed, including a signal transceiver unit and a processing module, by receiving control signals from an external processing device, processing and generating a second control signal and a somatosensory signal, and transmitting it to the controller and the somatosensory device to cause vibration. The processing module can monitor and analyze signals, determine whether vibration data is included, and adjust vibration intensity based on audio data.
It realizes the conversion of control signals in electronic games into corresponding somatosensory vibrations, enhancing the immersion of the player's experience, and provides deeper game feedback by synchronizing the vibrations of the controller and somatosensory devices.
Smart Images
Figure CN119215399A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a method for generating a somatosensory vibration signal, and more particularly to a signal adapter and a signal processing method thereof. Background Art
[0002] With the development of the video game industry and the expansion of the consumer market, the types of electronic games are becoming more and more diverse. For example, the game console can detect the player's body movements as input signals to play somatosensory games; in addition, the game console can also feedback the scenes or events in the game to the player in different types of ways (such as sound, light and shadow) to present a deeper experience effect. Summary of the invention
[0003] The present disclosure relates to a signal adapter, comprising a signal transceiver unit and a processing module. The signal transceiver unit is communicatively connected to an external processing device and a controller. The processing module is coupled to the signal transceiver unit and is communicatively connected to a somatosensory device. The signal transceiver unit is used to receive a first control signal from an external processing device and transmit it to the processing module. The processing module is used to process the first control signal and generate a second control signal and a somatosensory signal, and at least a portion of the second control signal is the same as the first control signal. The second control signal is transmitted to the controller through the signal transceiver unit, and the somatosensory signal is transmitted to the somatosensory device, so that the controller vibrates according to the second control signal, and the somatosensory device vibrates according to the somatosensory signal.
[0004] In one embodiment, the processing module is used to copy the first control signal to generate a second control signal and a third control signal, the second control signal is the same as the first control signal, and the third control signal is processed to generate a somatosensory signal and transmitted to the somatosensory device.
[0005] In one embodiment, the processing module is further used to monitor the first control signal received by the signal transceiver unit, and to determine whether the first control signal contains a first vibration data. When the first control signal contains the first vibration data, the processing module processes the first control signal and generates a second control signal and a third control signal, the second vibration data of the second control signal causes the controller to vibrate, and the third control signal is processed to generate a somatosensory signal and transmitted to the somatosensory device.
[0006] In one embodiment, the processing module is further configured to receive audio data corresponding to the external processing device, and to generate a somatosensory signal according to the audio data and the third vibration data in the third control signal.
[0007] In one embodiment, the first control signal is transmitted in the form of a data packet, and the processing module is used to determine whether the data packet includes an identification code to determine whether the first control signal includes the first vibration data.
[0008] The present disclosure also relates to a method for generating a somatosensory signal, comprising: receiving a first control signal from an external processing device through a signal transceiver unit, wherein the signal transceiver unit is communicatively connected to the external processing device; receiving a first control signal from the signal transceiver unit through a processing module, wherein the processing module is coupled to the signal transceiver unit; processing the first control signal through the processing module to generate a second control signal and a somatosensory signal, wherein at least a portion of the second control signal is the same as the first control signal, and the second control signal is transmitted to the signal transceiver unit; transmitting the second control signal to a controller through the signal transceiver unit, wherein the controller is communicatively connected to the signal transceiver unit, and the controller generates vibration according to the second control signal; and transmitting the somatosensory signal to the somatosensory device through the processing module, so that the somatosensory device generates vibration according to the somatosensory signal.
[0009] In one embodiment, the method of processing a first control signal by a processing module includes: copying the first control signal by the processing module to generate a second control signal and a third control signal, wherein the second control signal is the same as the first control signal; and processing the third control signal by the processing module to generate a somatosensory signal.
[0010] In one embodiment, a method for processing a first control signal through a processing module includes: monitoring the first control signal through the processing module to determine whether the first control signal includes first vibration data; when the first control signal includes the first vibration data, processing the first control signal through the processing module to generate a second control signal and a third control signal, wherein a second vibration data of the second control signal is used to cause the controller to vibrate; and generating a somatosensory signal based on the third vibration data of the third control signal.
[0011] In one embodiment, a method for generating a somatosensory signal according to third vibration data includes: receiving audio data from an external processing device; and generating a somatosensory signal according to the audio data and the third vibration data.
[0012] In one embodiment, the first control signal is transmitted in the form of a data packet, and the method of processing the first control signal by the processing module includes:
[0013] The processing module is used to determine whether the data packet includes the identification code, so as to determine whether the first control signal includes the first vibration data.
[0014] Accordingly, by analyzing the first control signal generated by the external processing device to generate the second control signal and the somatosensory signal, the somatosensory device can generate a somatosensory vibration effect corresponding to the controller. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 is a schematic diagram of a gaming system according to some embodiments of the present disclosure.
[0016] Figure 2 is a schematic diagram of a gaming system according to some embodiments of the present disclosure.
[0017] Figure 3 is a flow chart of steps of a method for generating a somatosensory signal according to some embodiments of the present disclosure.
[0018] Figure 4 FIG. 4 is a signal diagram of a gaming system according to some embodiments of the present disclosure.
[0019] Figure 5 FIG. 4 is a signal diagram of a gaming system according to some embodiments of the present disclosure.
[0020] The reference numerals are described as follows:
[0021] 100: Game System
[0022] 110: External processing device
[0023] 120: Controller
[0024] 130: Signal Adapter
[0025] 131: Signal transceiver unit
[0026] 132: Processing module
[0027] 132A: Analysis Unit
[0028] 132B: Digital to Analog Conversion Unit
[0029] 140: Somatosensory device
[0030] 200: Game System
[0031] 210: External processing device
[0032] 220: Controller
[0033] 230: Signal Adapter
[0034] 231: Signal transceiver unit
[0035] 232: Processing module
[0036] 232A: Analysis Unit
[0037] 232B: Arithmetic unit
[0038] 233: Analog-to-digital conversion unit
[0039] 234: Digital to Analog Conversion Unit
[0040] 240: Somatosensory device
[0041] Sg: Operation signal
[0042] S10: First control signal
[0043] S20: Second control signal
[0044] S30: The third control signal
[0045] S31: The adjusted third control signal
[0046] S40: somatosensory signal
[0047] S41: Somatosensory signals in analog format
[0048] Sx: Background music data
[0049] Sy: Action sound effect data
[0050] Sa1: original audio signal
[0051] Sa2: Audio data
[0052] Sa3: The first volume value after adjustment
[0053] T41: Phase 1
[0054] T42: Phase 2
[0055] T51: Phase 1
[0056] T52: Phase 2
[0057] T53: Phase 3
[0058] T54: Stage 4
[0059] S301-S308: Steps DETAILED DESCRIPTION
[0060] The following will disclose multiple embodiments of the present invention with the accompanying drawings. For the purpose of clear description, many practical details will be described together in the following description. However, it should be understood that these practical details should not be used to limit the present invention. That is, in some embodiments of the present invention, these practical details are not necessary. In addition, in order to simplify the drawings, some known and commonly used structures and elements will be depicted in a simple schematic manner in the drawings.
[0061] In this document, when an element is referred to as "connected" or "coupled", it may refer to "electrically connected" or "electrically coupled". "Connected" or "coupled" may also be used to indicate that two or more elements cooperate or interact with each other. In addition, although the terms "first", "second", etc. are used in this document to describe different elements, the terms are only used to distinguish between elements or operations described by the same technical terms. Unless the context clearly indicates otherwise, the terms do not specifically refer to or imply an order or sequence, nor are they used to limit the present invention.
[0062] Figure 1 FIG. 1 is a schematic diagram of a gaming system 100 according to some embodiments of the present disclosure. The gaming system 100 includes an external processing device 110, a controller 120, a signal adapter 130, and a somatosensory device 140. In one embodiment, the external processing device 110, the controller 120, the signal adapter 130, and the somatosensory device 140 are independent devices, or are partially integrated devices, and the devices can be connected by wire or wirelessly.
[0063] In some embodiments, the external processing device 110 may be a host computer, a desktop computer, a notebook computer, or other device with logic computing capabilities that can execute a game program, and may be connected to a display device (e.g., a television, not shown) and an audio playback device (e.g., a speaker, not shown). When the external processing device 110 executes the game program, the game images and sound effects will be presented through the display device and the audio playback device. The controller 120 (e.g., a game joystick) may be indirectly connected to the external processing device 110, and a plurality of operation buttons are provided thereon to transmit an operation signal Sg (e.g., a game control command) to the external processing device 110, or to receive a control signal from the external processing device 110.
[0064] In one embodiment, the "control signal" may be a feedback instruction generated by the external processing device 110 when running the game program, or a feedback instruction generated according to the operation signal Sg. For example, the control signal includes sound effect data so that the speaker in the controller 120 plays the game sound effect (such as the sound of a laser gun). The control signal may also include vibration data so that the motor in the controller 120 can vibrate to simulate the game scene (such as the impact of an explosion). For the convenience of explaining the signal processing method of the present disclosure, the control signal output by the external processing device 110 is referred to as the "first control signal S10".
[0065] The signal adapter 130 is communicatively connected to the external processing device 110 and the controller 120. In one embodiment, the signal adapter 130 is connected to the external processing device 110 and the controller 120 via a wireless signal (e.g., Bluetooth). If the external processing device 110 (or the controller 120) does not have a wireless communication function, the external processing device 110 (or the controller 120) can be coupled to a wireless transceiver to establish a communication connection with the signal adapter 130 via the wireless transceiver.
[0066] The signal adapter 130 includes a signal transceiver unit 131 and a processing module 132. The signal transceiver unit 131 is communicatively connected to the external processing device 110 and the controller 120, and is used to receive the first control signal S10 from the external processing device 110. Similarly, the signal transceiver unit 131 is also used to receive the operation signal Sg from the controller 120, and then transfer the operation signal Sg to the external processing device 110. In other words, the signal transceiver unit 131 is used to establish communication between the external processing device 110 and the controller 120, for example, wirelessly or wired.
[0067] The processing module 132 is coupled to the signal transceiver unit 131, and is used to receive the first control signal S10 transmitted by the signal transceiver unit 131. The processing module 132 is directly or indirectly connected to the somatosensory device 140 in a wired or wireless manner. In one embodiment, the processing module 132 includes an analysis unit 132A, and the analysis unit 132A can be a central processing unit, a system on a chip (SoC), a digital signal processor (DSP), or a processing chip with a specific function.
[0068] The analysis unit 132A of the processing module 132 is used to process the first control signal S10 to generate the second control signal S20 and the somatosensory signal S40 respectively. At least a portion of the second control signal S20 is the same as the first control signal S10. In one embodiment, the analysis unit 132A can directly use the first control signal S10 as the second control signal S20. In other embodiments, the analysis unit 132A can extract a portion of the first control signal S10 and then process it into the second control signal S20. The processing module 132 is used to transmit the second control signal S20 to the controller 120 through the signal transceiver unit 131, and transmit the somatosensory signal S40 to the somatosensory device 140, so that the controller 120 vibrates according to the second control signal S20, and the somatosensory device 140 vibrates according to the somatosensory signal S40.
[0069] In one embodiment, the somatosensory device 140 is a chair, which is provided with a motor, and can generate vibration according to the vibration data of the somatosensory signal S40. As mentioned above, after receiving the first control signal S10, the signal adapter 130 generates a second control signal S20 to the controller 120, and generates a somatosensory signal S40 to the somatosensory device 140. In other words, the controller 120 and the somatosensory device 140 can generate corresponding vibration effects (for example, vibrate at the same time) according to the second control signal S20 and the somatosensory signal S40.
[0070] In one embodiment, the first control signal S10 is transmitted in the form of a data packet, including various data generated by the external processing device 110, such as game sound effects, vibration frequency or intensity (hereinafter referred to as the first vibration data), etc. If the first control signal S10 includes the first vibration data, a specific identification code (such as a preamble or a feature code) will be included in the data packet. The analysis unit 132A is used to monitor each first control signal S10 (data packet) received by the signal transceiver unit 131 to determine whether any data packet includes the specific identification code (such as a preamble or a feature code) to confirm whether the first control signal S10 includes the first vibration data. When the analysis unit 132A determines that the data packet has an identification code, it can be confirmed that the first control signal S10 includes the first vibration data.
[0071] The signal adapter 130 can serve as a signal transmission bridge between the controller 120 and the external processing device 110, processing the first control signal S10 into the second control signal S20 and the somatosensory signal S40, and transmitting them to the controller 120 and the somatosensory device 140 respectively. Accordingly, the controller 120 and the somatosensory device 140 can generate vibration synchronously, making the player's gaming experience more profound.
[0072] Taking "shooting game" as an example, according to the setting of the game program, when the player inputs the "shooting" operation signal Sg through the controller 120, the external processing device 110 will not only present the "shooting" attack effect in the game program, but also generate a first control signal S10 for the "vibration of shooting". The signal adapter 130 then generates a second control signal S20 and a somatosensory signal S40 to make the controller 220 and the somatosensory device 240 vibrate.
[0073] like Figure 1As shown, in one embodiment, the processing module 132 further includes a digital-to-analog conversion unit 132B, which is coupled to the analysis unit 132A and the somatosensory device 140. In the process of the processing module 132 generating the somatosensory signal S40, the analysis unit 132A first copies the first control signal S10, and then generates the second control signal S20 and the third control signal S30 according to at least a portion of the copied first control signal S10 (e.g., the first vibration data in the first control signal S10). The digital-to-analog conversion unit 132B is used to convert the third control signal S30 in a digital audio or multimedia format into a somatosensory signal S40 (this somatosensory signal S40 is in an analog format), and then transmit the somatosensory signal S40 to the somatosensory device 140.
[0074] As mentioned above, in some embodiments, the second control signal S20 and the third control signal S30 may be the same. For example, the analysis unit 132A may directly use the "copied first control signal S10" as the second control signal S20 and the third control signal S30, or the analysis unit 132A may extract the first vibration data in the first control signal S10 as the second control signal S20 and / or the third control signal S30. In other embodiments, the second control signal S20 and the third control signal S30 are not completely the same, for example, the second control signal S20 is the first vibration data in the first control signal S10, and the third control signal S30 is generated according to the first vibration data (such as: strengthening or weakening), and the detailed method will be described in the subsequent paragraphs.
[0075] Figure 2 FIG. 2 is a schematic diagram of a gaming system 200 according to another embodiment of the present disclosure. The gaming system 200 may also include an external processing device 210, a controller 220, a signal adapter 230, and a motion sensing device 240. Since the external processing device 210, the controller 220, and the motion sensing device 240 are respectively similar to the aforementioned Figure 1 The external processing device 110, the controller 120 and the body sensing device 140 are not described in detail here.
[0076] like Figure 2 The signal adapter 230 includes a signal transceiver unit 231 and a processing module 232, wherein the processing module 232 includes an analysis unit 232A and a computing unit 232B. The signal transceiver unit 231 is communicatively connected to the external processing device 210 and the controller 220. The analysis unit 232A is coupled to the signal transceiver unit 231 to receive the first control signal S10 through the signal transceiver unit 231, and processes the first control signal S10 to generate a second control signal S20 and a third control signal S30. The computing unit 232B is coupled to the analysis unit 232A to receive the third control signal S30 from the analysis unit 232A. The computing unit 232B processes the third control signal S30 to generate a somatosensory signal S40.
[0077] As mentioned above, the processing module 232 is used to copy the first control signal S10 to generate the second control signal S20 and the third control signal S30. The second control signal S20 and / or the third control signal S30 may be the same as the first control signal S10, or may be a part of the first control signal S10 (e.g., the first vibration data). In one embodiment, the analysis unit 232A of the processing module 232 is also used to monitor the first control signal S10 received by the signal transceiver unit to determine whether the first control signal S10 contains the first vibration data. When the first control signal S10 contains the first vibration data, the analysis unit 232A processes the first control signal S10 and generates the second control signal S20 and the third control signal S30. The second vibration data in the generated second control signal S20 is used to cause the controller 220 to vibrate, and the third control signal S30 is processed to generate a somatosensory signal S40. In one embodiment, the operation unit 232B is further configured to receive the audio data Sa2 provided by the external processing device 210 , and to generate the somatosensory signal S40 for controlling the vibration of the somatosensory device 240 according to the audio data Sa2 and the third vibration data in the third control signal S30 .
[0078] Specifically, in one embodiment, the signal adapter 230 further includes an analog-to-digital conversion unit 233 and a digital-to-analog conversion unit 234. The analog-to-digital conversion unit 233 is coupled to the computing unit 232B and is communicatively connected to the external processing device 210 (e.g., connected via an audio transmission line, or other wireless connection methods). The analog-to-digital conversion unit 233 receives an original audio signal Sa1 (e.g., game audio) from the external processing device 210 and converts the original audio signal Sa1 into audio data Sa2. The digital-to-analog conversion unit 234 is coupled to the computing unit 232B and is communicatively connected to the somatosensory device 240 (e.g., connected via an audio transmission line, or other wireless connection methods). The digital-to-analog conversion unit 234 is used to convert the somatosensory signal S40 in a digital format into a somatosensory signal S41 in an analog format, and then transmit the somatosensory signal S41 in an analog format to the somatosensory device 240.
[0079] The operation unit 232B of the processing module 232 can generate a somatosensory signal S40 according to the audio data Sa2 and the third vibration data in the third control signal S30. Taking a shooting game as an example, according to the setting of the game program, if the player and the enemy in the game shoot each other, because the battle is more intense, the vibration feedback can be designed to be stronger than the vibration of "simple player shooting" to highlight the somatosensory feedback of the game scene. In other words, the signal adapter 230 can generate a somatosensory signal S40 according to the audio data Sa2 and the original vibration data (that is, the first vibration data, which is the same as the third vibration data in this embodiment) to adjust the vibration intensity generated by the somatosensory device 240. For example, the operation unit 232B can use different weights to adjust the audio data Sa2 and the third vibration data in the third control signal S30 respectively to set the vibration intensity. Specifically, the operation unit 232B stores an audio weight value and a vibration weight value. The operation unit 232B is used to adjust the first volume value in the audio data Sa2 according to the audio weight value. The operation unit 232B is used to adjust the third vibration data of the third control signal S30 according to the vibration weight value. Then, the operation unit 232B adds up the “adjusted first volume value” and the “adjusted third vibration data” to generate a body sensing signal S40.
[0080] Figure 3 The flowchart of the method for generating a somatosensory signal according to some embodiments of the present disclosure is shown. The game system 200 can be used to execute Figure 3 Please also refer to Figure 2-3 In step S301, the signal adapter 230 is communicatively connected to the external processing device 210 and the controller 220 via the signal transceiver unit 231. In step S302, the signal transceiver unit 231 receives the first control signal S10 transmitted from the external processing device 210.
[0081] In step S303, the signal adapter 230 of the processing module 232 monitors the first control signal S10 received by the signal transceiver unit 231 in real time through the analysis unit 232A (e.g., monitors each received data packet) to determine whether the first control signal S10 includes the first vibration data. In some embodiments, the analysis unit 232A determines whether each data packet received by the signal transceiver unit 231 has a specific identification code. For example, the analysis unit 232A pre-stores the identification code "00X". Therefore, if the analysis unit 232A determines that the identification code (preamble / characteristic code) in front of the data of any data packet is also "00X", the analysis unit 232A will confirm that the data packet includes the first vibration data, and the data encoding after "00X" in the data packet is used to indicate "vibration intensity". If the first control signal S10 includes the first vibration data, the signal adapter 230 will copy the first vibration data and generate the second control signal S20 and the third control signal S30 after calculation. Specifically, in step S304 , the analysis unit 232A transmits the second control signal S20 to the controller 220 via the signal transceiver unit 231 , wherein the second control signal S20 includes second vibration data, and at least a portion of the second control signal S20 is the same as the first control signal S10 .
[0082] As mentioned above, in step S305, the operation unit 232B receives the audio data Sa2 (e.g., the gunfight environment sound effect in the game) from the analog-to-digital conversion unit 233. The audio data Sa2 corresponds to the original audio signal Sa1 provided by the external processing device 210, that is, the analog-to-digital conversion unit 233 is used to convert the original audio signal Sa1 into a digital format as the audio data Sa2. The operation unit 232B adjusts the first volume value in the audio data Sa2 according to the audio weight value. For example, if the audio weight value is "0.5" and the first volume value is "60 (sound effect intensity reference value)", the operation unit 232B will adjust the first volume value to "30". In addition, the operation unit 232B is also used to adjust the third vibration data in the third control signal according to the vibration weight value. In one embodiment, the third vibration data is equivalent to the first vibration data in the first control signal. If the vibration weight value is "1" and the third vibration data is "40 (vibration intensity reference value)", the operation unit 232B will maintain the third vibration data at "40". In some embodiments, the audio weight value is less than "1" (eg, 0.3-0.6) and less than the vibration weight value. The vibration weight value may be greater than or equal to "1" (eg, 1-2).
[0083] In step S306, the operation unit 232B adds up the "adjusted first volume value of the audio data Sa2" and the "adjusted third vibration data" to generate a somatosensory signal S40. For example, the operation unit 232B adds the adjusted first volume value "30" to the adjusted third vibration data "40", and the result "70" is the somatosensory signal S40. Specifically, the third vibration data is used to record the reference intensity of the vibration. After the operation unit 232B adjusts the third vibration data according to the vibration weight value, the adjusted third vibration data can be used as the second volume value, and then the adjusted first volume value and the second volume value are added up to generate a somatosensory signal S40 in a digital audio format.
[0084] In step S307, the operation unit 232B may convert the somatosensory signal S40 in the digital audio format into the somatosensory signal S41 in the analog format through the digital-to-analog conversion unit 234, and then transmit the somatosensory signal S41 in the analog format to the somatosensory device 240, so that the somatosensory device 240 can generate vibrations of corresponding intensity. In some embodiments, the signal adapter 230 transmits the somatosensory signal S41 in the analog format to the somatosensory device 240 through an audio transmission line, that is, the somatosensory signal S41 in the analog format may be in an audio format or a multimedia signal format, and its amplitude corresponds to the vibration intensity.
[0085] If the first control signal S10 does not include the first vibration data (e.g., only includes audio without vibration feedback), in step S308, the signal adapter 230 directly transfers the first control signal S10 to the controller 220 without controlling the somatosensory device 240 according to the first control signal S10. In other embodiments, the signal adapter 230 may also directly transfer the first control signal S10 to the somatosensory device 240 so that the somatosensory device 240 performs other non-vibration processing (e.g., playing game sound effects through a speaker).
[0086] See also Figure 1 and Figure 4 , the following will illustrate the processing methods of different embodiments, and the signal waveform is used to illustrate the processing principle of the game system 100. Figure 4 The following is a schematic diagram of signals in the game system 100 in some embodiments of the present disclosure, which corresponds to the scenario of "vibration is generated only according to the player's action (such as shooting)". In other words, only when the player generates an operation signal Sg through the controller 120, the external processing device 110 will generate the first control signal S10 with the first vibration data according to the "sound effect corresponding to the operation signal Sg". Specifically, Figure 4In the example, the external processing device 110 is used to generate background music data Sx, which corresponds to the soundtrack or ambient music generated by the game program executed by the external processing device 110. The external processing device 110 is also used to generate action sound effect data Sy, which corresponds to the feedback sound (such as gunshot) generated by the game program according to the operation signal Sg input by the player / controller 120 when the external processing device 110 executes the game program. The background music data Sx and the action sound effect data Sy are digital data. Figure 4 The background music data Sx and the action sound effect data Sy are depicted as simulated sine wave waveforms only for the convenience of illustrating their corresponding volume sizes. For example, the vertical axis of the background music data Sx and the action sound effect data Sy may be decibel (dB).
[0087] like Figure 4 As shown, in the first stage T41, when the player has not yet performed an action, the external processing device 110 only generates background music data Sx, but does not generate action sound effect data Sy. Therefore, the external processing device 110 only generates the original audio signal Sa1 based on the background music data Sx, and does not generate the second control signal S20 and the third control signal S30. In the second stage T42, when the player performs an action, the external processing device 110 may selectively pause the generation of background music data Sx, and generate action sound effect data Sy corresponding to the player's action. At this time, the external processing device 110 generates the original audio signal Sa1 (the vertical axis may be a voltage value) according to the action sound effect data Sy, and generates the first control signal S10 accordingly. Therefore, the signal adapter 130 may generate the second control signal S20 and the third control signal S30 when it is determined that the first control signal S10 has the first vibration data. In addition, Figure 4 The amplitudes of the third control signal S30 and the action sound effect data Sy are positively correlated, that is, the vibration value is positively correlated to the volume represented by the action sound effect data. Figure 4 The third control signal S30 is illustrated as a simulated sine wave waveform only for the convenience of illustrating its corresponding vibration degree. For example, the vertical axis of the third control signal S30 may be a “vibration value” carried by the third vibration data, and the vibration value is positively correlated to the vibration amplitude and / or frequency of the motor of the controller 120 and the somatosensory device 140.
[0088] Please refer to Figure 2 and Figure 5 , the processing principle of the game system 200 is explained here using signal waveforms. Figure 5Shown is a signal processing schematic diagram of a gaming system 200 according to some embodiments of the present disclosure. In the application scenario of this embodiment, the signal adapter 230 receives a first control signal S10 and an original audio signal Sa1 from an external processing device 210, respectively, to generate a somatosensory signal S40 based on “player actions” and “game audio” at the same time.
[0089] Specifically, when the external processing device 210 runs the game program, the external processing device 210 will generate a simulated original audio signal Sa1 as the game program runs. The amplitude of the original audio signal Sa1 corresponds to the volume of the ambient sound and game sound effects generated by the game program (i.e., the feedback sound generated by the game program based on the operation signal Sg input by the player / controller 220), and the corresponding vertical axis can be voltage (V). Continuing from the above, the external processing device 210 generates the first control signal S10 based on the operation signal Sg input by the player / controller 220, so the first control signal S10 carries the first vibration data (such as: data located after the identification code in the data packet). The vertical axis of the first control signal S10 can be a vibration value, and the vibration value is positively correlated to the vibration amplitude and / or frequency of the motor of the controller 220 and the somatosensory device 240.
[0090] The signal adapter 230 converts the analog original audio signal Sa1 into digital audio data Sa2 through the analog-to-digital conversion unit 233, wherein the original audio signal Sa1 / audio data Sa2 carries a first volume value. The signal adapter 230 adjusts the first volume value according to the audio weight value through the operation unit 232B to generate an adjusted first volume value Sa3. The adjusted first volume value Sa3 is digital data, Figure 5 The adjusted first volume value Sa3 is depicted as a simulated sine wave waveform only for the convenience of explaining the corresponding volume size. For example, the vertical axis of the adjusted first volume value Sa3 can be decibels (dB). The signal adapter 230 adjusts the third vibration data in the third control signal S30 according to the vibration weight value through the calculation unit 232B to generate an adjusted third control signal S31 ( Figure 5 The vertical axis is the vibration intensity). The adjusted third control signal S31 is digital data, Figure 5 The adjusted third control signal S31 is shown as a simulated sine wave waveform only for the convenience of explaining the corresponding vibration level. The calculation unit 232B in the signal adapter 230 is used to sum the adjusted first volume value Sa3 and the adjusted third control signal S31 to generate the body sensing signal S40. Figure 5 The somatosensory signal S40 is depicted as a simulated sine wave waveform only for the convenience of illustrating the corresponding vibration degree. For example, the vertical axis of the somatosensory signal S40 may be the vibration amplitude of the motor of the somatosensory device 240 .
[0091] like Figure 5 As shown, in the first stage T51, because the player does not perform any action and the game program has no special sound effects, the external processing device 210 does not generate the first control signal S10, nor does it generate the third control signal S30 and the somatosensory signal S40 when there is no somatosensory vibration requirement.
[0092] In the second stage T52, the game program has sound effects, but they are not generated based on the player's actions (such as: other characters in the game shooting). The external processing device 210 generates an original audio signal Sa1, but because the player does not take any action, the game program presets that there will be no somatosensory vibration, and the external processing device 210 will not generate a first control signal S10 at this time. In this case, the signal adapter 230 still receives the original audio signal Sa1. The signal adapter 230 adjusts the audio data Sa2 in the original audio signal Sa1 according to the audio weight value (such as: 0.5) to generate an adjusted first volume value Sa3. Since there is no first control signal S10 (regarded as zero) in the second stage T52, the somatosensory signal S40 is the same as the adjusted first volume value Sa3. In other words, the controller 220 does not vibrate at this time, but the somatosensory device 240 generates a vibration intensity corresponding to the original audio signal Sa1.
[0093] In the third stage T53, the game program generates environmental sounds and game sound effects. For example, the original audio signal Sa1 contains Figure 4 The background music data Sx shown and the action sound effect data Sy generated corresponding to the player's action (such as: the player performs the action of "laser gun firing", so that the game program generates a gunshot). Because the game program will generate corresponding vibration control according to the player's action, the external processing device 210 will generate a first control signal S10. When the signal adapter 230 copies the first control signal S10 to generate the second control signal S20 and the third control signal S30, the signal adapter 230 transmits the second control signal S20 to the controller 220 to generate vibration. At the same time, the signal adapter 230 adjusts the original audio signal Sa1 according to the audio weight value (such as: 0.5) to generate the adjusted first volume value Sa3. At the same time, the signal adapter 230 adjusts the third vibration data in the third control signal S30 according to the vibration weight value (such as: 1.5 or 2) to generate the adjusted third control signal S31. Next, the signal adapter 230 is used to sum the adjusted first volume value Sa3 and the adjusted third vibration data of the third control signal S31 to generate a somatosensory signal S40. In other words, the somatosensory device 240 generates vibrations corresponding to the player's actions and game sounds.
[0094] The fourth stage T54 is similar to the third stage T53, except that the proportion of ambient sound (i.e., not in response to the player's action) in the original audio signal Sa1 is smaller, and the proportion of game sound effects is the same as in the third stage T53, so the original audio signal Sa1 in the fourth stage T54 is smaller than the original audio signal Sa1 in the third stage T53, but the third control signal S30 is the same as in the third stage T53. At this time, the final summed body sense signal S40 is also smaller than that in the third stage T53.
[0095] In some embodiments, the signal adapter 130, 230 can be connected to the somatosensory device via wireless transmission technology such as Bluetooth. Since Bluetooth is a format for transmitting digital signals, the digital-to-analog conversion units 132B, 234 can be instead disposed in the somatosensory device 240. In other embodiments, the signal adapter 130, 230 can also be disposed in the somatosensory device.
[0096] The various elements, method steps or technical features in the aforementioned embodiments may be combined with each other and are not limited to the order of text description or the order of presentation of the drawings in the present disclosure.
[0097] Although the present disclosure has been disclosed in the above implementation mode, it is not intended to limit the present disclosure. Anyone skilled in the art can make various changes and modifications without departing from the spirit and scope of the present disclosure. Therefore, the scope of protection of the present disclosure shall be determined by the following claims.
Claims
1. A signal adapter, characterized in that: Include: a signal transceiver unit, communicatively connected to an external processing device and a controller; and a processing module, coupled to the signal transceiver unit and communicatively connected to the oneness device, wherein the signal transceiver unit is used to receive a first control signal from the external processing device and transmit it to the processing module, the processing module is used to process the first control signal and generate a second control signal and the oneness signal, and at least a part of the second control signal is the same as the first control signal; The second control signal is transmitted to the controller through the signal transceiver unit, and the somatosensory signal is transmitted to the somatosensory device, so that the controller vibrates according to the second control signal, and the somatosensory device vibrates according to the somatosensory signal.
2. The signal adapter according to claim 1, characterized in that: The processing module is used for copying the first control signal to generate the second control signal and a third control signal, wherein the second control signal is the same as the first control signal, and the third control signal is processed to generate the somatosensory signal and transmitted to the somatosensory device.
3. The signal adapter according to claim 1, wherein: The processing module is also used to monitor the first control signal received by the signal transceiver unit, and to determine whether the first control signal contains a first vibration data. When the first control signal contains the first vibration data, the processing module processes the first control signal and generates the second control signal and a third control signal. The second vibration data of the second control signal causes the controller to vibrate, and the third control signal is processed to generate the somatosensory signal and transmitted to the somatosensory device.
4. The signal adapter according to claim 3, characterized in that: The processing module is further used for receiving audio data corresponding to the external processing device, and for generating the body sensing signal according to the audio data and a third vibration data in the third control signal.
5. The signal adapter according to claim 1, wherein: The first control signal is transmitted in the form of a data packet. The processing module is used to determine whether the data packet includes an identification code to determine whether the first control signal includes a first vibration data.
6. A method for generating a somatosensory signal, characterized in that: Include: Receiving a first control signal from an external processing device through a signal transceiver unit, wherein the signal transceiver unit is communicatively connected to the external processing device; Receiving the first control signal from the signal transceiver unit through a processing module, wherein the processing module is coupled to the signal transceiver unit; Processing the first control signal through the processing module to generate a second control signal and a sense of unity signal, wherein at least a part of the second control signal is the same as the first control signal, and the second control signal is transmitted to the signal transceiver unit; The second control signal is transmitted to a controller through the signal transceiver unit, wherein the controller is communicatively connected with the signal transceiver unit, and the controller generates vibration according to the second control signal; as well as The somatosensory signal is transmitted to the integrated sensing device through the processing module, so that the somatosensory device vibrates according to the somatosensory signal.
7. The method for generating a body sensory signal according to claim 6, wherein: The method of processing the first control signal by the processing module comprises: By means of the processing module, replicating the first control signal to generate the second control signal and a third control signal, wherein the second control signal is the same as the first control signal; and The third control signal is processed by the processing module to generate the body sensing signal.
8. The method for generating a body sensory signal according to claim 6, wherein: The method of processing the first control signal by the processing module comprises: By means of the processing module, the first control signal is monitored to determine whether the first control signal includes a first vibration data; When the first control signal includes the first vibration data, the processing module processes the first control signal to generate the second control signal and a third control signal, wherein the second vibration data of the second control signal is used to make the controller vibrate; as well as The body sensing signal is generated according to a third vibration data of the third control signal.
9. The method for generating a body sensory signal according to claim 8, wherein: The method for generating the body sensing signal according to the third vibration data comprises: receiving audio data from the external processing device; and The body sensing signal is generated according to the audio data and the third vibration data.
10. The method for generating a body sensory signal according to claim 6, wherein: The first control signal is transmitted in the form of a data packet, and the method for processing the first control signal by the processing module includes: The processing module is used to determine whether the data packet includes an identification code, so as to determine whether the first control signal includes a first vibration data.