Action device

By processing real-time audio data with fast Fourier transforms and adjusting operating speed or unit count based on spectral intensity, the operating device creates a synchronized and engaging interaction with music, addressing the lack of connection in conventional devices.

JP7667636B2Active Publication Date: 2025-04-23TOMY CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2020069619
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-04-08
Publication Date
2025-04-23
Estimated Expiration
2040-04-08

AI Technical Summary

Technical Problem

Conventional operating devices linked to volume levels lack a sense of connection between music and operation, as the operating speed remains constant regardless of music volume.

Method used

The operating device employs real-time audio data processing using fast Fourier transforms to dynamically change the operating speed or the number of operating units based on spectral intensity thresholds, creating a synchronized link with music.

Benefits of technology

This approach ensures a harmonious and engaging interaction between the operating device's movements and the music, aligning with human sensory experiences and enhancing the device's interest factor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007667636000001
    Figure 0007667636000001
  • Figure 0007667636000002
    Figure 0007667636000002
  • Figure 0007667636000003
    Figure 0007667636000003
Patent Text Reader

Abstract

To provide an operation device that allows a link between music and an operation of the operation device to be felt.SOLUTION: An operation device 100 in which an operation part operates to music in a form visible from the outside includes: a conversion part for executing time-frequency conversion of a sound on the basis of sound data on the music; a determination part for determining whether or not spectrum intensity of a data component for each frequency band acquired by the conversion part exceeds a predetermined threshold; and a counting part for counting the number that the spectrum intensity exceeds the predetermined threshold. An operation mode of the operation part changes reversibly according to the counted value acquired by the counting part.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an operating device. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known an operating device that collects external music, detects the volume level of the music, and operates an operating unit at a speed according to the volume level (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 3-123581 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in devices that are linked to the volume level, the volume level is the same. Operating device, if any Since the speed of the movement does not change, there is no sense of link between the music and the movement of the device. The present invention has been made in consideration of such problems, and has an object to provide a motion device that allows a user to feel a link between music and the motion of the motion device. [Means for solving the problem]

[0005] The first method is The operating part is visible from the outside. With immediacy In a motion device that moves in sync with music, Sequentially based on the audio data of the music In real time A transform unit that performs a fast Fourier transform; a determination unit that determines whether or not a spectral intensity of a data component for each frequency band obtained by the conversion unit exceeds a predetermined threshold; A counting unit that counts the number of times the spectrum intensity exceeds a predetermined threshold, At least one of the operating units includes: With immediacy, The present invention is characterized in that the operating speed of the operating unit is reversibly changed in response to the count value obtained by the counting unit so that the operating speed is gradually increased when the count value obtained by the counting unit exceeds a predetermined value.

[0006] The second method is The operating part is visible from the outside. With immediacy In a motion device that moves in sync with music, Sequentially based on the audio data of the music In real time A transform unit that performs a fast Fourier transform; The spectral intensity of the data component for each frequency band obtained by the conversion unit exceeds a predetermined threshold. A determination unit that determines whether or not A counting unit that counts the number of times the spectrum intensity exceeds a predetermined threshold, With immediacy, The present invention is characterized in that it is configured to reversibly change the number of operating parts in operation according to the count value obtained by the counting unit so that the number of operating parts in operation is increased sequentially when the count value obtained by the counting unit exceeds a predetermined value.

[0007] The third method is The operating part is visible from the outside. With immediacy In a motion device that moves in sync with music, Sequentially based on the audio data of the music In real time A transform unit that performs a fast Fourier transform; a determination unit that determines whether or not a spectral intensity of a data component for each frequency band obtained by the conversion unit exceeds a predetermined threshold; With immediacy, A counting unit that counts the number of times the spectrum intensity exceeds a predetermined threshold, The present invention is characterized in that it is configured to reversibly change the operating unit in operation according to the count value obtained by the counting unit, so that the operating unit in operation is changed sequentially when the count value obtained by the counting unit exceeds a predetermined value. Effect of the Invention

[0010] According to the first means, The operation speed is reversibly changed according to the number of data components for each frequency band whose spectral intensity exceeds a predetermined threshold. Therefore, a link between the music and the motion of the motion device can be felt, and the motion of the motion device matches human senses, resulting in a highly entertaining motion device.

[0011] According to the second method, The number of moving parts is reversibly changed according to the number of frequency bands whose spectral intensities of data components exceed a predetermined threshold. Therefore, the link between the music and the movement of the moving device is felt, and the movement of the moving device matches human senses, resulting in a highly entertaining moving device.

[0012] According to the third method, The operating part is reversibly changed according to the number of times the spectral intensity of the data components for each frequency band exceeds a predetermined threshold. Therefore, the link between the music and the operation of the operating device is felt, and the operation of the operating device matches human senses, resulting in a highly entertaining operating device.

[0013] According to the fourth means, since the time-frequency conversion is performed by the fast Fourier transform, it is possible to make the moving part change its movement immediately when the music stops or the tune changes.

[0014] According to the fifth aspect, a motion device that moves hands or feet in time with the tune can be realized. [Brief description of the drawings]

[0015] [Figure 1] FIG. 2 is a front perspective view of the operating device according to the embodiment, seen from diagonally above. [Diagram 2] FIG. 2 is a rear perspective view of the operating device according to the embodiment, seen from diagonally below. [Diagram 3] FIG. 2 is a perspective view showing an operating mechanism of the operating device. [Figure 4] This is a diagram showing the basic postures during the dance. [Diagram 5] FIG. 2 is a block diagram showing a control configuration of the operating device. [Figure 6] FIG. 11 is a diagram showing a procedure of an operation speed change process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an operating device according to the present invention will be described with reference to the drawings.

[0017] FIG. 1 is a front perspective view of an operating device 100 according to an embodiment, as viewed obliquely from above, and FIG. 2 is a rear perspective view of the operating device 100, as viewed obliquely from below.

[0018] (Appearance of the operating device 100) The operating device 100 of this embodiment includes a spherical device body 10. A first rotating piece 11L is provided on the left of the device body 10, and a first rotating piece 11R is provided on the right. The left and right refer to the left and right when viewed from the operating device 100. Each first rotating piece 11 (when the left and right first rotating pieces 11L, 11R are not differentiated, they are referred to as first rotating piece 11) rotates independently up and down within a predetermined range. A second rotating piece 12L is provided at the end of the left first rotating piece 11L, and a second rotating piece 12R is provided at the end of the right first rotating piece 11R. Each second rotating piece 12 (when the left and right second rotating pieces 12L, 12R are not differentiated, they are referred to as second rotating piece 12) rotates independently up and down within a predetermined range. The first rotating piece 11 and the second rotating piece 12 form a rotating member.

[0019] A left eye 13L and a right eye 13R are displayed on the front of the device body 10. In addition, two protrusions 14f and two protrusions 14r are provided on the upper part of the device body 10, and two protrusions 14f and two protrusions 14r are provided on the lower part. The four protrusions 14f and four protrusions 14r are intended to stabilize the posture of the operating device 100.

[0020] A circular rubber plate 15 is exposed at the bottom end of the device body 10, and the device body 10 is rotatable around the rubber plate 15. This operating device 100 performs a predetermined action by a combination of rotation of the left and right first rotating pieces 11L, 11R, rotation of the left and right second rotating pieces 12L, 12R, and rotation of the device body 10, etc.

[0021] 3(A) to (D) show characteristic shapes of the first rotating piece 11 and the second rotating piece 12 that the operating device 100 can take. In Fig. 3(A), the first rotating pieces 11L, 11R extend obliquely downward relative to the device body 10, and the second rotating pieces 12L, 12R hang down. In this state, the tips of the second rotating pieces 12L, 12R touch the ground, and the device body 10 rises above the ground surface. The rotating members can maintain this state. 3(B), the first rotating piece 11L extends below the device body 10, and the second rotating piece 12L slips under the device body 10. Meanwhile, the first rotating piece 11R extends above the device body 10, and the second rotating piece 12R covers the upper end of the device body 10. When this shape is achieved, the center of gravity shifts, causing the operating device 100 to roll in the direction in which the tips of the second rotating pieces 12L and 12R point. In FIG. 3(C), both of the first rotating pieces 11L, 11R extend upward relative to the device body 10, and the tips of the second rotating pieces 12L, 12R abut against each other. In the third (D), the first rotating pieces 11L and 11R extend horizontally relative to the device body 10, and the second rotating pieces 12L and 12R hang down. In this form, for example, the device body 10 can rotate around the rubber plate 15.

[0022] (Structure of device body 10) A light emitting diode (not shown) constituting a part of the light output unit 77 (see FIG. 3) is provided on the back of each of the left eye 13L and the right eye 13R. 2, a door 10a that can be opened and closed by a hinge (not shown) is provided at the rear of the device body 10. Various operation buttons, a charging terminal, and a battery are provided inside the door 10a (not shown). A speaker (not shown) that constitutes a part of the sound output unit 76 (see FIG. 5) and a microphone 79 that collects external sounds are provided at the rear of the device body 10.

[0023] 4 is a perspective view showing the pivot member and pivot device of the operating device 100. In this view, the rear half of the pivot member has been removed. The operating device 100 includes a left first rotating piece rotating device 31L for rotating the left first rotating piece 11L, a right first rotating piece rotating device 31R for rotating the right first rotating piece 11R, a left second rotating piece rotating device 32L for rotating the left second rotating piece 12L, and a right second rotating piece rotating device 32R for rotating the right second rotating piece 12R. The left first rotating piece rotating device 31L, the right first rotating piece rotating device 31R, the left second rotating piece rotating device 32L, and the right second rotating piece rotating device 32R are each composed of a separate servo mechanism. Each servo mechanism includes a servo motor and an encoder that measures the rotational position with a sensor and outputs position information as an electric signal.

[0024] The first left rotating piece rotating device 31L and the first right rotating piece rotating device 31R are provided at the joint J1, while the second left rotating piece rotating device 32L and the second right rotating piece rotating device 32R are provided at the joint J2. In addition, a main body rotating device 33 for rotating the main body 10 is provided at the center of the main body 10. The main body rotating device 33 includes a vertically placed motor 33a and a gear mechanism 34 connected to the motor 33a. According to the main body rotating device 33, the motor power is transmitted to the rotating plate 35 via gears 34a, 34b, 34c, 34d, 34e, 34f, 34g, and 34h. The above-mentioned rubber plate 15 is attached to the lower surface of the rotating plate 35. When the motor 33a is operated, the rotating plate 35 tries to rotate, but since the rubber plate 15 grips the play surface (ground surface), the rubber plate 15 is not rotated, and the motor 33a and the main body 10 rotate in reaction.

[0025] (First rotating piece 11 and second rotating piece 12) A joint J1 between the device body 10 and the first rotating piece 11 is formed by connecting an output shaft 31a of the first rotating piece rotating device 31 and a rotation shaft 11a of the first rotating piece 11. In addition, the joint J2 between the first rotating piece 11 and the second rotating piece 12 is cylindrical with a central axis extending perpendicular to the rotation plane of the second rotating piece 12. This allows smooth sliding contact with the ground surface as the piece rotates. In addition, the tip of the second rotating piece 12 is also cylindrical with a central axis extending perpendicular to the rotation plane of the second rotating piece 12. This allows smooth sliding contact with the ground surface as it rotates.

[0026] (Control Configuration) FIG. 5 shows a control configuration of the operating device 100. Specifically, the operating device 100 includes a central processing unit 70, a main memory device 71a, and an auxiliary memory device 71b as a control configuration. The operating device 100 also includes a transceiver 75, a sound output unit 76, a light output unit 77, a first left rotating piece rotating device 31L, a first right rotating piece rotating device 31R, a second left rotating piece rotating device 32L, a second right rotating piece rotating device 32R, and a main body rotating device 33.

[0027] Of these, the auxiliary storage device 71b stores various programs and data. As various programs, operation programs, sound analysis programs, etc. are stored.

[0028] As for data, data necessary for executing various programs is stored in the auxiliary storage device 71b. For example, a plurality of music data and motion data are stored. Music data and motion data can be additionally stored in the auxiliary storage device 71b.

[0029] The operation data includes a plurality of types of standard operation pattern data. The operation pattern data is data for making the first rotating piece 11, the second rotating piece 12, the device body 10, the sound output unit 76 and / or the light output unit 77 perform a series of operations that are relatively consistent. Specifically, the operation pattern data includes operation data such as the rotation direction, rotation speed or number of reversals of the first rotating piece 11 or the second rotating piece 12, the rotation direction, number of rotations, rotation speed or number of reversals of the device body 10, the type of sound output from the sound output unit 76, the color of the light output from the light output unit 77, the lighting time, the blinking speed or number of blinks, etc. The plurality of types of motion pattern data includes other motion pattern data that are different from the one motion pattern data only in motion speed data such as rotation speed, and the other motion data are the same.

[0030] The central processing unit 70 also includes a control unit 70a and an arithmetic unit 70b. The central processing unit 70 reads various programs and data as appropriate, controls each section, and performs the necessary calculations. The main memory device 71a is a work area, and temporarily stores programs and various data during execution as necessary.

[0031] The transmitter / receiver 75 communicates with, for example, a dedicated controller, a smartphone, or a tablet using Bluetooth (registered trademark) or the like. The light output unit 77 includes the light emitting diode, and the sound output unit 76 includes the speaker. The microphone 79 is for picking up external sounds.

[0032] (How to play and actions) This operating device 100 operates in a plurality of modes. The mode can be selected by a selection button provided on the operating device 100, a dedicated controller, a smartphone, a tablet, or the like. The operating device 100 operates in accordance with external music or music output from the operating device 100 itself. In this case, the operating device 100 changes the speed of its operation in accordance with the melody of the music. In other words, the operating device 100 changes its speed of operation depending on whether the sound is lively / flashy or quiet / subdued.

[0033] For example, the operation speed change process in the case where the operating device 100 sequentially outputs music based on music data transmitted from a smartphone or the like via Bluetooth or the like will be described with reference to Fig. 6. In this operation speed change process, the central processing unit 70 functions as a conversion unit, a determination unit, a counting unit, and an operation speed determination unit. When music data is received from a smartphone or the like via Bluetooth communication (step S1), a sound analysis program is started by a data transmission trigger. As a result, the transmitted music data is expanded in a buffer in the main memory device 71a. Then, a fast Fourier transform (FFT) is applied to the music data in the buffer to perform a time-frequency conversion (step S2). This extracts data components for each of a predetermined number of frequency bands. Then, it is determined whether the spectral intensity of each data component exceeds a predetermined threshold value (step S3). Then, the number of data components that exceed the predetermined threshold value is counted (step S4), and it is determined whether the count value exceeds a predetermined value (step S5), and the operating speed is determined (step S6). If the threshold is not exceeded, the sound is determined to be quiet and subdued, and the first rotating piece 11 or the second rotating piece 12 of the operating device 100 is operated based on the movement pattern data with a slow movement speed, and conversely, if the threshold is exceeded, the sound is determined to be noisy and flashy, and the first rotating piece 11 or the second rotating piece 12 of the operating device 100 is operated based on the movement pattern data with a fast movement speed.

[0034] In this case, the switching of the motion pattern data is reversible. That is, when the count value subsequently exceeds or falls below a predetermined value, the motion speed is switched each time. The threshold value may be a different value for each data component, or may be a uniform value. Furthermore, when switching the motion pattern data, it is preferable to change only the motion speed from the corresponding motion of the other motion pattern when the switching is performed in the middle of a series of motions of one motion pattern. Note that the number of data components to be decomposed is not particularly limited, but is about 20. A count value of 0 may be treated as silent, and a count value of 20 may be treated as lively or flashy sound. A plurality of count values ​​that bring about a speed change may be provided to change the motion speed in stages.

[0035] When the operating device 100 operates in accordance with external music, the music can be collected by the microphone 79, music data based on the music can be generated, and the generated music data can be processed in the same manner as above to change the operating speed in accordance with the melody of the music. When the operating device 100 outputs music based on music data already stored in it, the music data can be processed in the same manner as above to change the operating speed in accordance with the melody of the music.

[0036] The operating device 100 of this embodiment provides the following advantages. That is, in a section with a slow tempo, the number of sounds per unit time is generally small, so the operation of the operation device 100 is slowed down. Also, in a section with a fast tempo or a section where various instruments are used, the operation of the operation device 100 is generally fast, because many data components with different frequency bands are included. Therefore, a link between the music and the operation of the operation device 100 is felt, and the operation of the operation device 100 matches the human senses, so that a highly entertaining operation device 100 can be realized. In addition, since the time-frequency transformation is performed sequentially by the fast Fourier transform until the end of the music, it is possible to make the movement of the moving part change instantly when the music stops or the melody changes.

[0037] (Modification) Although the embodiment of the present invention has been described above, it goes without saying that the present invention is not limited to the above embodiment and various modifications are possible. For example, in the above embodiment, the operating speed of the first rotating piece 11 or the second rotating piece 12 is changed, but the blinking speed of the light output unit 76, which is one of the operating parts, may be changed. Also, the rotation speed of the device body 10 may be changed. Furthermore, in addition to the first rotating piece 11 or the second rotating piece 12, all or a part of these may be changed.

[0038] Also, when the count exceeds a predetermined value, the number of moving parts that are in motion may be increased, or the moving parts that are in motion may be changed to make the robot appear more active. As an example of the former, when the count is smaller than a predetermined value, only one arm may be moved, but when the count exceeds the predetermined value, both arms may be moved, and multiple movements, such as rotation, light, sound, etc., may be made to produce a lively and flashy sound. Here, "more active movements" refers to movements that are objectively more lively and flashy, such as increasing the volume of the sound effects of the moving parts, speeding up the movement of the moving parts, increasing the number of moving parts per stage, etc. This "more active movements" also includes psychological changes that are objectively recognized as being lively and flashy and that are recognized as being in accordance with psychological laws, such as changing the color of the light from white to a passionate red.

[0039] Furthermore, when there are a plurality of operating units, the operating modes of all the operating units may be changed, or the operating modes of some of the operating units may be changed.

[0040] Furthermore, the operating device is not limited to robots, but can also be applied to ornaments imitating stuffed toys, dolls, and potted plants, or room decorations, which have operating parts. [Explanation of symbols]

[0041] 11 First Moving Piece 12 2nd Moving Piece 31L Left first rotating single rotating device 31R Right first rotating single rotating device 32L Left 2nd Rotating Single Rotating Device 32R Right 2nd Rotating Single Rotating Device 33 Main body rotation device 33a Motor 34 Gear mechanism 70a Control device 75 Transmitter / Receiver 76 Sound output section 77 Optical output section 78a~78d Servo motor 100 Operating device

Claims

1. In a motion device, a motion unit moves in real time in accordance with music in a manner that is visible from the outside, a transform unit that sequentially performs a fast Fourier transform in real time based on the audio data of the music; a determination unit that determines whether or not a spectral intensity of a data component for each frequency band obtained by the conversion unit exceeds a predetermined threshold; A counting unit that counts the number of times the spectrum intensity exceeds a predetermined threshold, An operating device characterized in that at least one operating unit is configured to reversibly change the operating speed of the operating unit in response to a count value obtained by the counting unit so as to immediately increase the operating speed sequentially when the count value exceeds a predetermined value.

2. In a motion device, a motion unit moves in real time in accordance with music in a manner that is visible from the outside, a transform unit that sequentially performs a fast Fourier transform in real time based on the audio data of the music; a determination unit that determines whether or not a spectral intensity of a data component for each frequency band obtained by the conversion unit exceeds a predetermined threshold; A counting unit that counts the number of times the spectrum intensity exceeds a predetermined threshold, An operating device characterized in that it is configured to reversibly change the number of operating units in operation in response to a count value obtained by the counting unit so as to sequentially increase the number of operating units in operation when the count value obtained by the counting unit exceeds a predetermined value with a high degree of real-timeness.

3. In a motion device, a motion unit moves in real time in accordance with music in a manner that is visible from the outside, a transform unit that sequentially performs a fast Fourier transform in real time based on the audio data of the music; a determination unit that determines whether or not a spectral intensity of a data component for each frequency band obtained by the conversion unit exceeds a predetermined threshold; A counting unit that counts the number of times the spectrum intensity exceeds a predetermined threshold, An operating device characterized in that it is configured to reversibly change the operating unit in operation in response to the count value obtained by the counting unit, so that the operating unit in operation is changed sequentially when the count value obtained by the counting unit exceeds a predetermined value with a high degree of real-timeness.

Citation Information

Patent Citations

  • Movement device

    JP1991123581A

  • Dancing dool

    JP2002331175A

  • Device and method for driving movable part

    JP2008119135A

  • Sound responsive doll apparatus

    US20070037475A1

  • Music structure analysis device, method for analyzing music structure, and music structure analysis program

    WO2017195292A1