Information processing device, information processing system, and information processing method

Abstract

An information processing device 18 is an information terminal that can be attached to and detached from a controller 16 of a game machine 12 that executes an application. The information processing device 18 comprises a display unit for displaying a predetermined character. The information processing device 18 acquires a voice signal that is outputted from an application executed by the game machine 12 and that instructs the output of audio. The information processing device 18 determines an operation mode of the character on the basis of the acquired audio signal, and causes the display unit to display the character operating in the determined mode.

Description

Information processing device, information processing system, and information processing method

[0001] The present disclosure relates to data processing technology, and more particularly to an information processing device, an information processing system, and an information processing method.

[0002] A wide variety of game applications are available.

[0003] There is a need to enhance the enjoyment of game applications. One object of the present disclosure is to provide a technology that effectively enhances the enjoyment of game applications.

[0004] In order to solve the above problem, an information processing device of one aspect of the present disclosure is an information processing device that is detachable from a controller of a game console that runs an application, and includes a display unit, an acquisition unit that acquires an audio signal that is output from the application and instructs the output of audio, and a display control unit that displays a character that performs an action based on the audio signal on the display unit.

[0005] Another aspect of the present disclosure is an information processing system including a controller for a game machine that executes an application, and an information processing device detachable from the controller. The information processing device includes a display unit, an acquisition unit that acquires an audio signal output from the application that instructs audio output, and a display control unit that causes a character that performs an action based on the audio signal to be displayed on the display unit.

[0006] Yet another aspect of the present disclosure is an information processing method, in which an information processing device that is detachable from a controller of a game console that executes an application and that includes a display unit receives an audio signal that is output from the application and instructs the display unit to output audio, and displays a character that performs an action based on the audio signal.

[0007] Any combination of the above components, or conversion of the expression of the present disclosure into a computer program, a recording medium storing a computer program, or the like, is also valid as an aspect of the present disclosure.

[0008] According to the present disclosure, it is possible to effectively increase the interest of game applications.

[0009] It is a diagram showing the configuration of a game system according to an embodiment. It is a diagram showing the outline of the appearance of a controller and an information processing device. It is a block diagram showing functional blocks provided in the information processing device. It is a diagram showing an example of operation rules stored in an operation rule storage unit.

[0010] 1 shows the configuration of a game system 10 according to an embodiment. The game system 10 is an information processing system including a game machine 12, a display device 14, a controller 16, and an information processing device 18.

[0011] The functionality of the components in the game console 12, controller 16, and information processing device 18 may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuitry, and / or combinations thereof, configured or programmed to perform the functions described herein. A processor is considered to be circuitry or processing circuitry that includes transistors and other circuits. A processor may also be a programmed processor that executes a program stored in a memory.

[0012] In this specification, a circuit, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.

[0013] If the hardware is a processor that is considered to be a type of circuitry, the circuitry, means, or unit is a combination of hardware and software used to configure the hardware and / or processor.

[0014] The game machine 12 is an information processing device including a computer capable of executing various application software such as game applications, etc. The game machine 12 in this embodiment is a stationary game machine.

[0015] The controller 16 is an operation device that accepts operations input by a user to system software or application software (e.g., a video game) executed by the game machine 12. The user inputs operations by holding the controller 16. The controller 16 is connected to the game machine 12 by wire or wirelessly, and sequentially transmits operation information indicating operations input by the user to the game machine 12.

[0016] The controller 16 includes a speaker and is capable of outputting sound based on an audio signal transmitted from the game machine 12 (such as a game application). The controller 16 also includes a vibrator and is capable of vibrating the vibrator in a manner based on a haptic signal transmitted from the game machine 12 (such as a game application).

[0017] The display device 14 has a display for outputting images and a speaker for outputting sound. The display device 14 may be a television or a computer display. The display device 14 is connected to the game console 12 by wire or wirelessly. When the game console 12 receives operation information provided from the controller 16, it reflects the operation information in the processing of the system software and application software, causes the display device 14 to display an image related to the processing result, and causes the speaker of the display device 14 to output sound related to the processing result.

[0018] The information processing device 18 is a small information terminal that can be attached to and detached from the controller 16. Figure 2 shows a schematic view of the appearance (top) of the controller 16 and the information processing device 18. The controller 16 includes a plurality of buttons (face buttons, directional keys, etc.), an analog stick, and a mounting portion 17. The mounting portion 17 is provided in the center of the controller 16, and the information processing device 18 can be attached to the mounting portion 17.

[0019] The information processing device 18 includes a display unit 20 that displays various content such as text and images. In the embodiment, the display unit 20 displays a character 40 as a partner of the user. The character 40 behaves in accordance with the progress of the game played by the user on the game machine 12.

[0020] 3 is a block diagram showing functional blocks of the information processing device 18. Each block shown in the block diagram in this specification can be realized in terms of hardware by elements such as a computer processor (e.g., CPU) and memory, electronic circuits, and mechanical devices, and in terms of software by a computer program, etc. However, the functional blocks shown here are realized by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various ways by combining hardware and software.

[0021] The information processing device 18 includes a display unit 20, a processing unit 22, a storage unit 24, and a communication unit 26. The display unit 20 may include a liquid crystal display or an organic EL display. The display unit 20 may also include a touch panel and function as an operation input unit.

[0022] The processing unit 22 executes various data processes. The storage unit 24 stores data referenced or updated by the processing unit 22. The communication unit 26 communicates with external devices in accordance with a predetermined communication protocol. In the embodiment, the processing unit 22 transmits and receives data to and from the controller 16 via the communication unit 26, and further transmits and receives data to and from the game console 12 via the controller 16.

[0023] The storage unit 24 includes an operation rule storage unit 30. The operation rule storage unit 30 stores predetermined operation rules. The operation rules define the correspondence between combinations of audio signals and haptic signals output from a game application running on the game machine 12 and the operation of the character 40 displayed on the display unit 20.

[0024] The processing unit 22 includes a signal acquisition unit 32, an operation determination unit 34, and a display control unit 36. A computer program implementing the functions of these multiple functional blocks may be installed in the storage of the information processing device 18. The processor of the information processing device 18 may perform the functions of these multiple functional blocks by reading this computer program into main memory and executing it.

[0025] The signal acquisition unit 32 acquires an audio signal and a haptic signal output from a game application running on the game machine 12. The movement determination unit 34 determines the movement mode of the character 40 to be displayed on the display unit 20 based on the audio signal and haptic signal acquired by the signal acquisition unit 32 and the movement rules stored in the storage unit 24.

[0026] The display control unit 36 ​​causes the display unit 20 to display the character 40 moving in a manner determined by the movement determination unit 34 based on the audio signal and the haptic signal. In other words, the display control unit 36 ​​causes the display unit 20 to display an image of the character 40 moving in a manner determined by the movement determination unit 34.

[0027] The operation of the game system 10 configured as described above will now be described. The user attaches the information processing device 18 to the controller 16 and launches a game application on the game console 12. The processor of the game console 12 that executes the game application (hereinafter simply referred to as the "game application") sequentially transmits audio signals corresponding to the progress and results of the game to the display device 14 and the controller 16. The audio signal is a signal that instructs the output of audio. Upon receiving the audio signal, the display device 14 causes the speaker to output the audio instructed by the audio signal.

[0028] The game application sequentially transmits haptic signals according to the progress of the game and the results of the game to the controller 16. The haptic signal is a signal that instructs the vibration mode of the vibrator of the controller 16. Upon receiving the haptic signal, the controller 16 vibrates the vibrator in the vibration mode instructed by the haptic signal.

[0029] A signal acquisition unit 32 of the information processing device 18 acquires the audio signal and haptic signal transmitted from the game machine 12 via the controller 16. A movement determination unit 34 of the information processing device 18 determines the movement mode of the character 40 based on the audio content indicated by the audio signal, the vibration mode indicated by the haptic signal, and the movement rules stored in the movement rule storage unit 30. A display control unit 36 ​​of the information processing device 18 displays the character 40 on the display unit 20 and causes the character 40 to move in the mode determined by the movement determination unit 34.

[0030] 4 shows an example of a behavior rule stored in the behavior rule storage unit 30. Hereinafter, an example of determining the behavior of the character 40 to be displayed on the display unit 20 of the information processing device 18 will be described with reference to FIG.

[0031] (Example 1) The first situation is a situation in which the audio signal indicates a dissonant note or a minor chord, and the haptic signal is not received. The audio signal in the first situation may indicate at least one of the following: (A) an audio signal with three or more overlapping semitones, (B) an audio signal in which the interval of a fourth between "F" and "C" is repeated for four or more measures, (C) an audio signal containing a predetermined threshold or more of sustained tones, or (D) an audio signal with a chord progression that makes heavy use of diminished chords (e.g., A dim → A♭ dim → G dim → A♭ dim). The first situation is typically a situation in which a horror scene is displayed in a game.

[0032] The movement rule associates a first situation with a movement indicating fear (frightened motion). The movement determination unit 34 of the information processing device 18 uses publicly known technology to determine whether a combination of an audio signal and a haptic signal corresponds to the first situation. If the combination of an audio signal and a haptic signal corresponds to the first situation, the movement determination unit 34 determines the movement of the character 40 to be a predetermined movement indicating fear. The movement indicating fear may include, for example, shaking the body, putting a hand over the mouth, turning pale, etc.

[0033] (Example 2) The second situation is a situation in which the audio signal indicates a dissonant note or a minor chord, and the haptic signal indicates a vibration magnitude equal to or greater than a predetermined threshold. The audio signal in the second situation may indicate at least one of: (A) a sound in which three or more semitones overlap; (B) a sound in which the interval of a fourth between "F" and "C" is repeated for four or more measures; (C) a sound containing a number of sustained tones equal to or greater than a predetermined threshold; or (D) a sound with a chord progression that makes heavy use of diminished chords. The haptic signal in the second situation may indicate a maximum vibration magnitude. The second situation is typically a situation in which an emergency scene or a surprise scene is displayed in a game.

[0034] The movement rule associates the second situation with a movement indicating surprise (e.g., a leaning back motion). The movement determination unit 34 of the information processing device 18 uses known technology to determine whether a combination of an audio signal and a haptic signal corresponds to the second situation. If the combination of an audio signal and a haptic signal corresponds to the second situation, the movement determination unit 34 determines the movement of the character 40 to be a predetermined movement indicating surprise. The movement indicating surprise may include, for example, a movement such as leaning back, widening the eyes, or jumping up.

[0035] (Example 3) A third situation is a situation in which the audio signal indicates the sound of cheering and the haptic signal indicates a vibration magnitude equal to or greater than a predetermined threshold. The haptic signal in the third situation may indicate a maximum level of vibration magnitude. The third situation is typically a situation in which a goal is scored or a scene in which a fanfare is played is displayed.

[0036] The movement rule associates the third situation with a movement indicating the achievement of a goal. The movement determination unit 34 of the information processing device 18 uses known technology to determine whether a combination of an audio signal and a haptic signal corresponds to the third situation. If the combination of an audio signal and a haptic signal corresponds to the third situation, the movement determination unit 34 determines the movement of the character 40 to be a movement indicating the achievement of a predetermined goal. The movement indicating the achievement of a goal may include a motion for scoring a goal in soccer (e.g., an overhead kick motion), a goal celebration (goal performance), etc.

[0037] (Example 4) The fourth situation is a situation in which the audio signal indicates audio with a tempo equal to or greater than a predetermined threshold, and a predetermined number of haptic signals are received at regular intervals. The audio signal in the fourth situation may indicate at least one of (A) audio with a BPM (beats per minute) of 180 or more, (B) audio with a four-beat bass drum (the bass drum is struck four times in a quarter note per measure), (C) audio with a 16-beat hi-hat, or (D) audio with a heavy use of minor chords (e.g., a song that uses a predetermined number of minor chords or more). The fourth situation is typically a situation in which a scene of a battle with an enemy (e.g., a boss battle) is displayed.

[0038] The action rule associates the fourth situation with an action indicative of combat. The action determination unit 34 of the information processing device 18 uses known technology to determine whether a combination of an audio signal and a haptic signal corresponds to the fourth situation. If the combination of an audio signal and a haptic signal corresponds to the fourth situation, the action determination unit 34 determines the action of the character 40 to be a predetermined action indicative of combat. The action indicative of combat may include an action for fighting an enemy boss character, a action in martial arts or combat sports (e.g., a shadow boxing motion), or the like.

[0039] Typically, in the game system 10, images and sounds relating to the progress of the game and the game results are output from the display device 14. Furthermore, haptic feedback (vibration) relating to the progress of the game and the game results is output from the controller 16. In parallel with these, a character 40 that performs actions according to the progress of the game and the game results is displayed on the display unit 20 of the information processing device 18.

[0040] According to the game system 10 of the embodiment, the character 40 displayed on the display unit 20 of the information processing device 18 can be made to take actions in accordance with the progress of the game and the game results based on the audio signals and haptic signals output from the game application. This makes it possible to provide a character as a companion that experiences the game world together with the user, thereby effectively increasing the interest in the game.

[0041] The present invention has been described above based on an embodiment. This embodiment is merely an example, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present invention.

[0042] A first modified example will be described. In the above embodiment, the movement rules associate a set of the content of the audio signal and the content of the haptic signal with the movement mode of the character 40, and the movement determination unit 34 of the information processing device 18 determines the movement mode of the character 40 based on the content of the audio signal and the content of the haptic signal. As a modified example, the movement rules may associate the content of the audio signal with the movement mode of the character 40. The movement determination unit 34 of the information processing device 18 may determine the movement mode of the character 40 based on the content of the audio signal, regardless of the content of the haptic signal.

[0043] For example, the movement rule may associate an audio signal indicating a dissonant note or a minor chord with a movement indicating fear (a frightening motion). Furthermore, the movement rule may associate an audio signal indicating a sound with a tempo equal to or greater than a predetermined threshold with a movement indicating combat. When the audio signal indicates a dissonant note or a minor chord, the movement determination unit 34 of the information processing device 18 may determine the movement of the character 40 to be a predetermined movement indicating fear. On the other hand, when the audio signal indicates a sound with a tempo equal to or greater than a predetermined threshold, the movement determination unit 34 may determine the movement of the character 40 to be a predetermined movement indicating combat.

[0044] A second modified example will be described. The movement rule may associate the content of the haptic signal with the movement mode of the character 40. The movement determination unit 34 of the information processing device 18 may determine the movement mode of the character 40 based on the content of the haptic signal, regardless of the content of the audio signal.

[0045] For example, the movement rule may associate a haptic signal indicating a vibration magnitude equal to or greater than a predetermined threshold with a movement indicating surprise. Furthermore, the movement rule may associate the receipt of a predetermined number of haptic signals at regular intervals with a movement indicating combat. When the haptic signal indicates a vibration magnitude equal to or greater than a predetermined threshold, the movement determination unit 34 of the information processing device 18 may determine the movement of the character 40 to be a predetermined movement indicating surprise. On the other hand, when the movement determination unit 34 receives a predetermined number of haptic signals at regular intervals, the movement determination unit 34 may determine the movement of the character 40 to be a movement indicating combat.

[0046] A third modified example will be described. The movement determination unit 34 of the information processing device 18 may determine the movement mode of the character 40 based on at least one of the content of the audio signal and the content of the haptic signal, and the title information (in other words, identification information) of the game application running on the game console 12.

[0047] For example, the movement rule storage unit 30 may store a plurality of predetermined movement rules for a plurality of games, in other words, the movement rule storage unit 30 may store a predetermined movement rule for each game. For example, the movement rule corresponding to a soccer game may define the movement of a soccer player as the movement of the character 40. Furthermore, the movement rule corresponding to a horror game may define the movement of the character 40 as a frightened movement, a surprised movement, a running away movement, etc.

[0048] The signal acquisition unit 32 of the information processing device 18 may acquire the title of the game currently being executed (identification information of the game application) transmitted from the game console 12. The movement determination unit 34 of the information processing device 18 may refer to the movement rules corresponding to the title of the game currently being executed and determine the movement of the character 40 based on at least one of the content of the audio signal and the content of the haptic signal.

[0049] Any combination of the above-described examples and modifications is also useful as an embodiment of the present invention. A new embodiment resulting from a combination will have the combined effects of the combined examples and modifications. It will also be understood by those skilled in the art that the functions to be performed by each constituent element in the claims can be realized by each component shown in the examples and modifications, either individually or in combination.

[0050] The technical ideas described in the above embodiments and modified examples can be expressed as the technologies of the following items. [Technology 1] An information processing device detachable from a controller of a game machine that runs an application, the information processing device comprising: a display unit; and a circuit configured to: acquire an audio signal output from the application that instructs the output of a predetermined sound; and display on the display unit a character that performs an action based on the audio signal. [Technology 2] The information processing device described in Technology 1, wherein the circuit further acquires a haptic signal output from the application that instructs a vibration mode of the controller, and the circuit determines an action of the character based on the audio signal and the haptic signal. [Technology 3] The information processing device described in Technology 2, wherein the circuit determines an action of the character to be an action indicating fear when the audio signal indicates a dissonant note or a minor chord sound and the haptic signal is not accepted. [Technology 4] The information processing device according to Technology 2, wherein the circuit determines the character's movement to be a movement indicating surprise when the audio signal indicates a dissonant note or a minor chord sound and the haptic signal indicates a vibration magnitude equal to or greater than a predetermined threshold. [Technology 5] The information processing device according to Technology 2, wherein the circuit determines the character's movement to be a movement indicating achievement of a goal when the audio signal indicates a cheer and the haptic signal indicates a vibration magnitude equal to or greater than a predetermined threshold. [Technology 6] The information processing device according to Technology 2, wherein the circuit determines the character's movement to be a movement indicating combat when the audio signal indicates an audio with a tempo equal to or greater than a predetermined threshold and a predetermined number or more of the haptic signals are received at regular intervals. [Technology 7] An information processing system comprising: a game console controller that executes an application; and an information processing device detachable from the controller, wherein the information processing device includes: a display unit; an acquisition unit that acquires an audio signal that instructs audio output, output from the application; and a display control unit that causes the display unit to display a character performing an action based on the audio signal.[Technology 8] An information processing method in which an information processing device that is detachable from a controller of a game machine that executes an application and that has a display unit, acquires an audio signal that is output from the application and instructs the output of a predetermined audio, and displays on the display unit a character that performs an action based on the audio signal.

[0051] The present invention can be applied to information processing devices, information processing systems, and the like.

[0052] REFERENCE SIGNS LIST 10 Game system, 12 Game machine, 16 Controller, 18 Information processing device, 20 Display unit, 30 Operation rule storage unit, 32 Signal acquisition unit, 34 Operation determination unit, 36 Display control unit

Claims

1. An information processing device that is detachable from a controller of a game machine that executes an application, comprising: a display unit; an acquisition unit that acquires an audio signal that is output from the application and instructs the output of audio; and a display control unit that displays on the display unit a character that performs actions based on the audio signal.

2. An information processing device as described in claim 1, further comprising a determination unit, wherein the acquisition unit further acquires a haptic signal output from the application that indicates the vibration mode of the controller, and the determination unit determines the movement of the character based on the audio signal and the haptic signal.

3. The information processing device according to claim 2, wherein the determination unit determines the character's movement to be a movement indicating fear when the audio signal indicates a dissonant tone or a minor chord and the haptic signal is not received.

4. The information processing device according to claim 2, wherein the determination unit determines the character's behavior to be an behavior indicating surprise when the audio signal indicates a dissonant or minor chord sound and the haptic signal indicates a vibration magnitude greater than a predetermined threshold.

5. The information processing device according to claim 2, wherein the determination unit determines that the character's movement is an movement indicating the achievement of a goal when the audio signal indicates a cheer and the haptic signal indicates a vibration magnitude equal to or greater than a predetermined threshold.

6. The information processing device according to claim 2, wherein the determination unit determines that the character's action is an action indicating combat when the audio signal indicates an audio with a tempo equal to or higher than a predetermined threshold and a predetermined number or more of the haptic signals are received at regular intervals.

7. An information processing system comprising: a controller for a game machine that executes an application; and an information processing device detachable from said controller, said information processing device including: a display unit; an acquisition unit that acquires an audio signal that is output from said application and instructs the output of audio; and a display control unit that causes said display unit to display a character that performs an action based on said audio signal.

8. An information processing method in which an information processing device that is detachable from a controller of a game machine that runs an application and that has a display unit receives an audio signal that instructs the output of audio, output from the application, and displays on the display unit a character that performs an action based on the audio signal.

Images