Control system and handheld apparatus

Abstract

A control system includes a processing unit, a first rotating device, and a first driving unit. The processing unit receives an input signal and generates a control signal based on the input signal, wherein the input signal includes at least one of image data and sound data. The first rotating device has a first angular momentum, which changes in response to the control signal when the input signal changes. The first driving unit drives the first rotating device and changes the first angular momentum from a first angular momentum value to a second angular momentum value according to the control signal. A handheld device is also disclosed herein.

Description

Control systems and handheld devices The present disclosure relates to a control technology, and more particularly to a control system and a handheld device. Typically, to allow users to experience haptic feedback from various devices (e.g., game controllers, wearables, headsets, controllers, etc.), a processor controls a motor based on signals from a host (e.g., a game console) to vibrate the device or adjust button resistance. However, these approaches do not generate a corresponding resistance when the user rotates the device, preventing the user from experiencing a sense of weight. Therefore, designing solutions to these issues is a significant challenge in this field. An embodiment of the present invention includes a control system. The control system includes a processing device, a first rotating device, and a first driving device. The processing device is configured to receive an input signal and generate a control signal based on the input signal, wherein the input signal includes at least one of image data and audio data. The first rotating device has a first angular momentum that changes in response to the control signal when the input signal changes. The first driving device is configured to drive the first rotating device and change the first angular momentum from a first angular momentum value to a second angular momentum value based on the control signal. An embodiment of the present invention includes a handheld device. The handheld device includes a handheld component and a first rotating device. The first rotating device has a first angular momentum and is disposed on the handheld component. The first angular momentum changes when at least one of image data and audio data changes from a first data value to a second data value. In this document, when an element is referred to as being "connected" or "coupled," it may refer to being "electrically connected" or "electrically coupled." "Connected" or "coupled" may also refer to the coordinated operation or interaction between two or more elements. Furthermore, while terms such as "first," "second," and so on are used herein to describe different elements, these terms are used solely to distinguish between elements or operations described using the same technical terms. Unless the context clearly indicates otherwise, these terms do not specifically refer to or imply an order or sequence, nor are they intended to limit this disclosure. Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this invention, and will not be interpreted as idealized or overly formal unless expressly defined as such herein. The present disclosure provides a control system. In some embodiments, the control system includes a processing device (e.g., processing device 110 shown in FIG. 1 , described below) and a rotation device (e.g., rotation device 123 shown in FIG. 1 , described below). The processing device is configured to receive an input signal and generate a control signal based on the input signal. The rotation device has a first angular momentum, which changes in response to the control signal when the input signal changes. In some embodiments, the processing device is further configured to identify at least one of image data and audio data of the input signal and generate a control signal based on the at least one of the image data and audio data. When the at least one of the image data and audio data changes from a first data value to a second data value, the first angular momentum changes in response to the control signal. Figure 1 is a schematic diagram of a control system 100 according to some embodiments of the present invention. Control system 100 includes a processing device 110, a handheld device 120, an audio / visual device 130, and a host 140. Processing device 110 receives an input signal IS1 and generates a control signal CS1 based on the input signal IS1. Handheld device 120 operates based on control signal CS1. Host 140 generates input signal IS1. Audio / visual device 130 generates images and / or sounds based on input signal IS1. In some embodiments, host 140 may be implemented as a game console, and audio-visual device 130 may be implemented as a screen and / or speakers, but the present disclosure is not limited thereto. In some embodiments, input signal IS1 includes image data and audio data. Audio-visual device 130 displays corresponding images based on the image data and generates corresponding audio based on the audio data, and processing device 110 generates control signal CS1 based on at least one of the image data and audio data. It is worth noting that audio-visual device 130 and processing device 110 receive the same input signal IS1. In some embodiments, host 140 may provide input signal IS1 to each of audio-visual device 130 and processing device 110 via a splitter. As shown in FIG1 , a handheld device 120 may include a handheld portion 121, a drive device 122, and a rotating device 123. Handheld portion 121 can be grasped by a user. Rotating device 123 is disposed on handheld portion 121 and can rotate to generate angular momentum L1. In some embodiments, rotating device 123 may be a turntable, a sphere, a gyroscope, or other structure capable of generating angular momentum through rotation. Drive device 122 can adjust rotating device 123 based on control signal CS1 to change angular momentum L1. In other words, angular momentum L1 changes in response to control signal CS1. In some embodiments, the processing device 110 can identify at least one of the image data and audio data of the input signal IS1 to determine the angular momentum L1, such that the angular momentum L1 corresponds to at least one of the image and audio data of the audio-visual device 130. In some embodiments, the processing device 110 can identify the image data and audio data of the input signal IS1 using artificial intelligence, such as the object detection model of YoloV3, but the present disclosure is not limited thereto. In various embodiments, the processing device 110 can perform identification using various models. In the embodiment shown in Figure 1, the rotation axis of the rotating device 123 is parallel to the Z-axis of the paper. In other words, the rotating device 123 rotates in the XY plane. In some embodiments, the X-axis, Y-axis, and Z-axis are perpendicular to each other. When the user rotates the handheld device 120 in the Z direction, causing the rotation direction of the rotating device 123 to change, the user will experience a resistance force from the handheld device 120 due to the law of conservation of angular momentum. The greater the angular momentum L1, the greater the resistance force. Therefore, the control system 100 can change the resistance force felt by the user by changing the angular momentum L1. In some approaches, a processor controls a motor based on signals from a host (e.g., a game console) to vibrate a device (e.g., a game controller, wearable device, headset, controller, etc.) or adjust button resistance. However, in these approaches, the device does not generate a corresponding resistance when rotated by the user, and therefore, the user cannot feel a sense of weight. Compared to the above approach, in this embodiment of the present invention, the processing device 110 determines the angular momentum L1 based on different image data and / or sound data, allowing the user to feel corresponding different resistance forces through the handheld device 120. Thus, when operating the handheld device 120 or other devices (e.g., game controllers, wearable devices, head-mounted devices, controllers, etc.), the user can feel the weight of objects and / or situations corresponding to different images and / or sounds, thereby enhancing the tactile experience. In the embodiment shown in Figure 1, the handheld component 121 has a length X1 in the X-direction, a length Y1 in the Y-direction, and a length Z1 in the Z-direction, where the length X1 is greater than both the lengths Y1 and Z1. In some embodiments, the user most often rotates the longest side of the handheld component 121, i.e., the side having the length X1. Accordingly, the rotation axis of the rotating device 123 is perpendicular to the X-direction, allowing the user to feel a resistance when rotating the handheld component 121. In some embodiments, the angular momentum L1 can be expressed by the following formula 1, where the mass M1 represents the mass of the rotating device 123, the distance R1 represents the distance between the mass of the rotating device 123 and the rotation axis of the rotating device 123 (for example, the mass of the rotating device 123 can come from weight blocks B11 and B12, and the distance R1 can represent the distance between the weight blocks B11 and B12 and the rotation axis of the rotating device 123), and the angular velocity W1 represents the angular velocity of the rotating device 123, that is, the rotational speed. (Formula 1). As can be seen from Equation 1, the driving device 122 can change the angular momentum L1 by changing at least one of the distance R1 and the angular velocity W1. For example, the driving device 122 can increase the angular velocity W1 to increase the angular momentum L1. In another example, the driving device 122 can decrease the distance R1 to decrease the angular momentum L1. As shown in FIG1 , the rotating device 123 may include weights B11 and B12, and the distance R1 may represent the distance between the weights B11 and B12 and the rotation axis of the rotating device 123 on the XY plane. In some embodiments, the driving device 122 may change the distance R1 by adjusting the positions of the weights B11 and B12. In some embodiments, the processing device 110 may store data regarding the relationship between the angular velocity W1, the distance R1, and the image and audio data of the input signal IS1. In the embodiment shown in FIG1 , the processing device 110 stores the relationship between the angular velocity W1, the distance R1, and the input signal IS1 in a lookup table T1, but the present disclosure is not limited thereto. In various embodiments, the processing device 110 may store the relationship between the angular velocity W1, the distance R1, and the input signal IS1 in various forms. As shown in lookup table T1, the image data of input signal IS1 can have data values ​​corresponding to three different weapons: a knife, a small gun, or a large gun. In the setting of input signal IS1, the weight of the large gun is greater than the weight of the small gun, and the weight of the small gun is greater than the weight of the knife. Correspondingly, the rotation speed W1 values ​​corresponding to the large gun image, the small gun image, and the knife image are 2000, 500, and 0, respectively. In this way, the resistance felt by the user when the audio-visual device 130 displays the large gun image is greater than the resistance felt when the audio-visual device 130 displays the small gun image, and the resistance felt by the user when the audio-visual device 130 displays the small gun image is greater than the resistance felt when the audio-visual device 130 displays the knife image. In some embodiments, the rotation speed corresponding to the knife image is 0, resulting in a corresponding resistance of 0. In some embodiments, when the user changes the image data of input signal IS1 through manipulation, the rotational speed W1 also changes accordingly. For example, when the user switches from a small gun to a large gun, causing the audio-visual device 130 to display an image of a large gun instead of a small gun, the rotational speed W1 changes from 500 to 2000, and the angular momentum L1 increases accordingly. For another example, when the user switches from a small gun to a small knife, causing the audio-visual device 130 to display an image of a small knife instead of a small gun, the rotational speed W1 changes from 500 to 0, and the angular momentum L1 decreases accordingly. On the other hand, the audio data of input signal IS1 can have data values ​​corresponding to two different states of the game character: a normal state and a tired state. In the configuration of input signal IS1, the perceived weight of the tired state is greater than that of the normal state. Accordingly, the distance R1 values ​​corresponding to the normal and tired states are 30 and 80, respectively. In this way, the resistance felt by the user when audio-visual device 130 produces tired state sounds is greater than when audio-visual device 130 produces normal state sounds. In some embodiments, processing device 110 can also determine the state of the game character based on the image data of input signal IS1. For example, it can determine whether the game character is in a normal state or a fatigued state based on the blood content in the image data. In other words, the aforementioned operation of adjusting angular momentum L1 based on the normal state and fatigue state can also be performed based on the image data of input signal IS1. In some embodiments, when the user performs an operation that changes the audio data of the input signal IS1, the distance R1 also changes accordingly. For example, when the user switches from a normal state to a fatigued state, causing the audio-visual device 130 to change from producing a normal state sound to producing a fatigued state sound, the driving device 122 drives the distance R1 between the weights B11 and B12 and the rotation axis to change from 30 to 80, and the angular momentum L1 increases accordingly. For another example, when the user switches from a fatigued state to a normal state, causing the audio-visual device 130 to change from producing a fatigued state sound to producing a normal state sound, the driving device 122 drives the distance R1 between the weights B11 and B12 and the rotation axis to change from 80 to 30, and the angular momentum L1 decreases accordingly. Please refer to the lookup table T1 and formula 1. When the input signal IS1 corresponds to the knife, since the angular velocity is 0, the value of the angular momentum L1 is 0. When the input signal IS1 corresponds to the gun and the normal state, the value of the angular momentum L1 is When the input signal IS1 corresponds to the small gun and fatigue state, the value of angular momentum L1 is When the input signal IS1 corresponds to the large gun and the normal state, the value of the angular momentum L1 is When the input signal IS1 corresponds to the large gun and fatigue state, the value of the angular momentum L1 is . In summary, in response to two different image data values ​​(small gun and large gun) and two different audio data values ​​(normal state and fatigue state), angular momentum L1 can have four different angular momentum values. The image data values, audio data values, distance R1 values, and rotational speed W1 values ​​shown in lookup table T1 are merely examples, and the present disclosure is not limited thereto. In various embodiments, processing device 110 can adjust distance R1 and rotational speed W1 in various ways based on various image data values ​​and audio data values. For example, processing device 110 can change distance R1 when the image data changes, and can also change rotational speed W1 when the audio data changes. While in the above embodiment, the image data corresponds to a weapon and the audio data corresponds to a status, the present disclosure is not limited thereto. In various embodiments, the image data may correspond to objects other than weapons or other information, and the audio data may correspond to objects other than status or other information. For example, in some variations, the image data corresponds to a status, and the audio data corresponds to a weapon. FIG2 is a schematic diagram of a handheld device 200 according to some embodiments of the present invention. Referring to FIG1 and FIG2 , handheld device 200 is a variation of handheld device 120 . Some components of handheld device 200 are numbered the same as handheld device 120 . For the sake of brevity, the discussion will focus on the differences between handheld device 200 and handheld device 120 rather than the similarities. Compared to handheld device 120, handheld device 200 further includes driving devices 212 and 222 and rotating devices 213 and 223. Rotating device 213 is mounted on handheld component 121 and can rotate to generate angular momentum L2. Driving device 212 can adjust rotating device 213 based on control signal CS1 to change angular momentum L2. Rotating device 223 is mounted on handheld component 121 and can rotate to generate angular momentum L3. Driving device 222 can adjust rotating device 223 based on control signal CS1 to change angular momentum L3. In other words, angular momenta L2 and L3 change in response to control signal CS1. In the embodiment shown in FIG. 2 , the rotating devices 213 , 223 , and 123 are separated from each other along the X-axis. However, the present disclosure is not limited to this. Various positional relationships between the rotating devices 213 , 223 , and 123 are contemplated within the scope of the present disclosure. For example, the rotating devices 213 , 223 , and 123 may be integrated into the same device, coupled to each other, and located in the same position. As shown in Figure 2, the rotation axis of the rotating device 213 is parallel to the X-axis. In other words, the rotating device 213 rotates in the ZY plane. When the user rotates the handheld device 200 in the X-direction, causing the rotation direction of the rotating device 213 to change, the user will feel a resistance force from the handheld device 200 due to the law of conservation of angular momentum. Similarly, the rotation axis of the rotating device 223 is parallel to the Y-axis. In other words, the rotating device 213 rotates in the ZX plane. When the user rotates the handheld device 200 in the Y direction, causing the rotation direction of the rotating device 223 to change, the user will feel a resistance force from the handheld device 200 due to the law of conservation of angular momentum. As a result, when the user rotates the handheld device 200 in different directions, at least one of the rotating devices 123 , 213 and 223 will generate corresponding resistance, so that the user can feel the corresponding image and / or sound of the audio-visual device 130 . In some embodiments, the values ​​of the angular momentums L1 to L3 are the same, so that the user can feel the same resistance when rotating the handheld device 200 in different directions. For example, when the image and sound of the audio-visual device 130 changes from a small gun / normal state to a large gun / fatigue state, the value of each of the angular momentums L1 to L3 changes from Change to In some embodiments, each of the rotating devices 213 and 223 includes a weight block (not shown) similar to the weight blocks B11 and B12, and / or the driving devices 212 and 222 can adjust the distance between the weight blocks in the rotating devices 213 and 223 and the corresponding rotation axis to change the angular momentum L2 and L3. In some embodiments, when the image data has a first image data value and the sound data has a first sound data value, the first driving device adjusts the first angular momentum to the first angular momentum value. For example, when the image data has an image data value corresponding to a pistol and the sound data has a sound data value corresponding to a normal state, the driving device 122 adjusts the angular momentum of the rotating device 123 to an angular momentum value of 500*30. In some embodiments, when the image data has a second image data value and the sound data has a first sound data value, the first driving device adjusts the first angular momentum to a second angular momentum value. For example, when the image data has an image data value corresponding to a gun and the sound data has a sound data value corresponding to a normal state, the driving device 122 adjusts the angular momentum of the rotating device 123 to an angular momentum value of 2000*30. In some embodiments, when the image data has a first image data value and the sound data has a second sound data value, the first driving device adjusts the first angular momentum to a third angular momentum value. For example, when the image data has an image data value corresponding to a pistol and the sound data has a sound data value corresponding to fatigue, the driving device 122 adjusts the angular momentum of the rotating device 123 to an angular momentum value of 500*80. In some embodiments, when the image data has a second image data value and the sound data has a second sound data value, the first driving device adjusts the first angular momentum to a fourth angular momentum value. For example, when the image data has an image data value corresponding to a rifle and the sound data has a sound data value corresponding to fatigue, the driving device 122 adjusts the angular momentum of the rotating device 123 to an angular momentum value of 2000*80. In some embodiments, the first image data value is different from the second image data value. For example, the image data value corresponding to a small gun is different from the image data value corresponding to a large gun. In some embodiments, the first sound data value is different from the second sound data value. For example, the sound data value corresponding to a normal state is different from the sound data value corresponding to a tired state. In some embodiments, the first angular momentum value, the second angular momentum value, the third angular momentum value, and the fourth angular momentum value are different from each other. For example, the angular momentum value of 500*30, the angular momentum value of 2000*30, the angular momentum value of 500*80, and the angular momentum value of 2000*80 are different from each other. In some embodiments, the handheld component has a first length in a first direction, a second length in a second direction, and a third length in a third direction, the first length being greater than each of the second and third lengths, and the rotation axis of the first rotating device is perpendicular to the first direction. For example, the handheld component 121 has a length X1 in the X direction, a length Y1 in the Y direction, and a length Z1 in the Z direction, wherein the length X1 is greater than each of the lengths Y1 and Z1, and the rotation axis of the rotating device 123 is perpendicular to the X direction. Although the present disclosure has been disclosed above with reference to the embodiments, this is not intended to limit the present disclosure. Anyone with ordinary skill in the art may make slight modifications and improvements without departing from the spirit and scope of the present disclosure. Therefore, the scope of protection of the present disclosure shall be determined by the scope of the appended patent applications. 100: Control system 110: Processing device 120, 200: Handheld device 130: Audio and video device 140: Host IS1: Input signal CS1: Control signal 121: Handheld component 122, 212, 222: Driving device 123, 213, 223: Rotating device X1, Y1, Z1: Length R1: Distance B11, B12: Weight T1: Lookup table X, Y, Z: Axis Figure 1 is a schematic diagram of a control system according to some embodiments of the present invention. Figure 2 is a schematic diagram of a handheld device according to some embodiments of the present invention. Domestic deposit information (please note in the order of deposit organization, date, and number) None Foreign deposit information (please note in the order of deposit country, organization, date, and number) None 100: Control System 110: Processing device 120:Handheld device 130: Audio-visual equipment 140:Host IS1: Input signal CS1: control signal 121:Handheld parts 122: Drive device 123: Rotating device X1, Y1, Z1: length R1: Distance B11, B12: Weight blocks T1: Lookup table X, Y, Z: axis

Claims

1. A control system comprising: a processing device for receiving an input signal and generating a control signal based on the input signal, wherein the input signal includes at least one of image data and sound data; a first rotating device having a first angular momentum, wherein the first angular momentum changes in response to the control signal when the input signal changes; and a first driving device for driving the first rotating device and changing the first angular momentum from a first angular momentum value to a second angular momentum value based on the control signal.

2. The control system as claimed in claim 1, wherein when at least one of the image data and the sound data changes from a first data value to a second data value, the first angular momentum changes in response to the control signal.

3. The control system as claimed in claim 2, wherein when the first angular momentum changes, a rotational speed of the first rotating device changes.

4. The control system as claimed in claim 1, wherein the first rotating device includes at least one weight, wherein the first driving device further adjusts at least one distance between the at least one weight and a rotation axis of the first rotating device to change the first angular momentum.

5. The control system as claimed in claim 2 further comprises: a second rotating device having a second angular momentum; and a second driving device that, when at least one of the image data and the sound data changes from the first data value to the second data value, changes the second angular momentum from the first angular momentum value to the second angular momentum value according to the control signal, wherein the rotation direction of the first rotating device is different from the rotation direction of the second rotating device.

6. The control system as claimed in claim 1, wherein when the image data has a first image data value and the sound data has a first sound data value, the first driving device adjusts the first angular momentum to the first angular momentum value; when the image data has a second image data value and the sound data has the first sound data value, the first driving device adjusts the first angular momentum to the second angular momentum value; when the image data has the first image data value and the sound data has the second sound data value, the first driving device adjusts the first angular momentum to a third angular momentum value; and when the image data has the second image data value and the sound data has the second sound data value, the first driving device adjusts the first angular momentum to a fourth angular momentum value, wherein the first image data value is different from the second image data value, the first sound data value is different from the second sound data value, and the first angular momentum value, the second angular momentum value, the third angular momentum value, and the fourth angular momentum value are different from each other.

7. A handheld device comprising: a handheld component; and a first rotating device disposed on the handheld component and having a first angular momentum, wherein when at least one of an image data and an audio data changes from a first data value to a second data value, the first angular momentum changes accordingly, causing a change in the rotational speed of the first rotating device.

8. The handheld device as claimed in claim 7 further includes: a first driving device for adjusting the first angular momentum based on at least one of the image data and the sound data, such that the first angular momentum changes from a first angular momentum value to a second angular momentum value.

9. The handheld device as claimed in claim 8, wherein when the image data changes from a first image data value to a second image data value, the first drive device changes the first rotational device from a first rotational speed to a second rotational speed, and when the image data changes from a first image data value to a third image data value, the first drive device changes the first rotational device from the first rotational speed to a third rotational speed, wherein the first image data value, the second image data value, and the third image data value are different from each other, and the first rotational speed, the second rotational speed, and the third rotational speed are different from each other.

10. The handheld device as claimed in claim 7, further comprising: a second rotating device having a second angular momentum and disposed on the handheld component; and a third rotating device having a third angular momentum and disposed on the handheld component, wherein the rotation directions of the first rotating device, the second rotating device, and the third rotating device are different from each other, and the angular momentum values ​​of the first angular momentum, the second angular momentum, and the third angular momentum are the same as each other.

Images