Information Processing Systems
The information processing system addresses the inconvenience of profile switching feedback by using visual and tactile notifications, improving user experience.
Patent Information
- Application Number
- JP2024540147
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-08-10
- Publication Date
- 2026-01-21
- Estimated Expiration
- 2042-08-10
AI Technical Summary
Existing methods for switching controller profiles provide feedback to users through lighting states or physical switch positions, which are not always convenient.
An information processing system with an operation device and notification unit that includes multiple feedback systems to notify users when profile information is switched, utilizing visual and tactile stimuli.
Enhances user convenience by providing clear and intuitive feedback on profile changes through visual and tactile notifications.
Smart Images

Figure 0007804082000001 
Figure 0007804082000002 
Figure 0007804082000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing system. [Background technology]
[0002] In recent years, controllers that can store setting information (hereinafter also referred to as a "profile") related to operations on the controller customized by the user have become increasingly popular. Summary of the Invention [Problem to be solved by the invention]
[0003] Until now, when the profile applied to controller operations was switched, the user would know that the profile had been switched based on the lighting state of the indicator light or the position of the physical switch, and the feedback was not necessarily in a form that was convenient for the user.
[0004] An object of the present invention is to provide a technique for providing feedback to a user in a convenient manner that the profile applied to the operation of the controller has been switched. [Means for solving the problem]
[0005] In order to solve the above problems, an information processing system according to one aspect of the present invention includes an operation device and a notification unit. The operation device stores a plurality of pieces of setting information related to operations on the operation device that can be selected by a user, and the notification unit has a plurality of types of feedback systems for notifying the user when the setting information applied to operations on the operation device has been switched.
[0006] Another aspect of the present invention is an information processing system. The information processing system includes an operation device and a processor. The operation device stores a plurality of pieces of setting information related to operations on the operation device that can be selected by a user, and when the setting information applied to operations on the operation device is switched, the processor activates at least one feedback system out of a plurality of types of feedback systems to notify the user of this fact.
[0007] Any combination of the above components, and any transformation of the present invention into a method, a computer program, a recording medium storing a computer program, or the like, are also valid aspects of the present invention. [Effects of the Invention]
[0008] According to the present invention, it becomes easier to provide feedback to the user in a convenient manner that the profile applied to the operation on the controller has been switched. [Brief explanation of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram illustrating an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing the top surface of the controller. [Figure 3] FIG. 2 is a diagram illustrating a hardware configuration of a controller. [Figure 4] FIG. 1 is a diagram illustrating a hardware configuration of an information processing device. [Figure 5] FIG. 2 is a block diagram showing functional blocks of a controller. [Figure 6] FIG. 2 is a block diagram showing functional blocks of the information processing device. [Figure 7] FIG. 10 is a diagram showing an example of profile switching using function buttons. [Figure 8] FIG. 10 is a diagram illustrating an example of a function menu window. [Figure 9] 10A and 10B are diagrams illustrating an example of changing audio output using function buttons. [Figure 10]FIG. 10 is a diagram showing an example in which both profile switching and audio output change are performed using function buttons. [Figure 11] FIG. 10 is a diagram illustrating an example of a feedback setting screen. [Figure 12] 10A to 10C are diagrams illustrating screen transitions related to profile settings. DETAILED DESCRIPTION OF THE INVENTION
[0010] FIG. 1 shows an information processing system 1 according to an embodiment. The information processing system 1 includes an information processing device 10, a display device 4, a controller 6, and headphones 8. The information processing device 10 of the embodiment is a game device, for example, a stationary game device. The information processing device 10 is connected wirelessly or via a wire to a controller 6 operated by a user. The controller 6 is an operation device that accepts operations input by a user regarding information processing (a game in the embodiment) executed by the information processing device 10. The controller 6 sequentially transmits operation information indicating operations input by the user to the information processing device 10. The controller 6 can also be said to be a game controller.
[0011] The headphones 8 are a device that includes a sound generator (such as a speaker) and outputs audible sounds from the sound generator based on electrical signals transmitted from the information processing device 10. Note that the information processing system 1 may be configured to use earphones, a speaker of the display device 4, or a speaker built into the controller 6 as audio output means instead of the headphones 8.
[0012] The display device 4 may be a television having a display for outputting images and a speaker for outputting sound, or may be a computer display. The display device 4 may be connected to the information processing device 10 by a wired cable or wirelessly. Upon receiving operation information provided from the controller 6, the information processing device 10 reflects the operation information in the processing of the system software and application software, causes an image related to the processing result to be displayed on the display device 4, and causes sound related to the processing result to be output from the headphones 8.
[0013] As an overview of the information processing system 1 of the embodiment, first to third features of the information processing system 1 will be described.
[0014] The controller 6 of the embodiment can store setting information related to operations on the controller, which is customized by the user. The setting information of the controller 6 may be information including predetermined setting values related to operations on the controller 6. The setting information of the controller 6 may also be setting information related to generating operation information to be input to the information processing device 10 based on an input operation on the controller 6. The setting information of the controller 6 may also be setting information related to changing an image generation mode by the information processing device 10 or an image display mode by the display device 4 based on an input operation on the controller 6. The setting information of the controller 6 may also be setting information related to changing an audio output mode from the information processing device 10, headphones 8, etc. based on an input operation on the controller 6. The setting information of the controller 6 may also be setting information related to changing a chat mode based on an input operation on the controller 6.
[0015] In the embodiment, the setting information of the controller is also referred to as "profile information" or simply "profile." Specific examples of profile information are described below. The profile information includes a profile ID and name, button assignment information, sensitivity information, dead zone information, and corresponding button information. The button assignment information is information indicating various actions, commands, and functions assigned by the user to each button of the controller 6. In other words, the button assignment information is information indicating the assignment status of various actions, commands, and functions to each button. The corresponding button information is identification information of the button of the controller 6 associated with the profile information, and is, for example, information indicating the circle button 72 and the cross button 73 described below.
[0016] The sensitivity information is information that indicates a setting value related to the sensitivity of the analog stick of the controller 6. The sensitivity of the analog stick defines the magnitude of the operation recognized by the information processing device 10 relative to the magnitude of the operation (in other words, the amount of tilt) actually input by the user to the analog stick. The magnitude of the operation recognized by the information processing device 10 can also be said to be the magnitude of the operation input to data processing in the information processing device 10. The sensitivity setting value may be the ratio between the amount of operation actually input to the analog stick and the amount of operation recognized by the information processing device 10.
[0017] The dead zone information is information including a setting value related to the dead zone of the analog stick of the controller 6. The dead zone of the analog stick is a range in which operations input to the analog stick are not accepted, in other words, a range in which operations input to the analog stick are ignored. The setting value of the dead zone may be a value range of the tilt amount corresponding to the dead zone.
[0018] The inventors have recognized that, as the number of profile information items that can be stored in a controller is expected to increase in the future, there is a need for a mechanism that allows a user to easily switch to the profile information they desire from among the multiple profile information items stored in the controller.
[0019] A first feature of the information processing system 1, based on the inventor's recognition of the above problem, aims to support the user in easily switching to desired profile information from among multiple pieces of profile information stored in the controller 6. Specifically, as the first feature, the controller 6 of the information processing system 1 stores profile information related to operations on the controller 6. When an operation on the second button is input together with an operation on the first button, the controller 6 switches the profile information to be applied to the operations on the controller 6.
[0020] It can be said that the first button causes the second button to perform a function related to profile information as a function different from the normal function. The first button includes a function button 88, which will be described later. The second button includes an operation button 76, a direction button 71, and an OPTIONS button 82, which will be described later. In the controller 6 of this embodiment, various operations can be performed by combining the function button 88 with other buttons.
[0021] Another issue recognized by the present inventor is that, as the number of profile information items that can be stored in a controller is expected to increase in the future, there is a need for a mechanism that allows users to easily check information related to the profile information stored in the controller (i.e., the profile information that can be selected by the user).
[0022] A second feature of the information processing system 1, based on the inventor's recognition of the above problem, aims to assist the user in easily checking information related to the profile information stored in the controller 6. Specifically, as the second feature, the information processing device 10 of the information processing system 1 acquires the profile information stored in the controller 6. When the information processing device 10 detects that a predetermined operation has been input using a button on the controller 6 while an application is running, it causes the display device 4 to display information related to the profile information acquired from the controller 6.
[0023] Another problem recognized by the present invention is that, until now, a user has had to know that the profile information applied to the controller operation has been switched based on the lighting state of an indicator lamp or the position of a physical switch, which means that feedback regarding the switching of profile information cannot always be provided in a manner that is convenient for the user.
[0024] Based on the above problem, a third feature of the information processing system 1 aims to provide feedback to the user in a manner convenient for the user that the profile information applied to operations on the controller 6 has been switched. Specifically, as the third feature, the controller 6 of the information processing system 1 stores multiple pieces of profile information related to operations on the controller 6 that can be selected by the user. The notification unit of the information processing system 1 has multiple types of feedback systems for notifying the user when the profile information applied to operations on the controller 6 has been switched.
[0025] The button configuration of the controller 6 in FIG. 1 will be described. FIG. 2 shows the top surface of the controller 6. The user operates the controller 6 by holding the left grip portion 78b with their left hand and the right grip portion 78a with their right hand. The top surface of the housing of the controller 6 is provided with input units: a directional button 71, a right analog stick 77a, a left analog stick 77b, and operation buttons 76. The directional button 71 is configured to allow input in eight directions: up, down, left, right, and diagonal. In this embodiment, it includes an up button 71a, a left button 71b, a down button 71c, and a right button 71d. The four operation buttons 76 are marked with different shapes and in different colors to distinguish them from one another. The operation buttons 76 include a circle button 72, an x button 73, a square button 74, and a triangle button 75.
[0026] The right analog stick 77a and the left analog stick 77b are also called control sticks, thumbsticks, or joysticks, and are used to input direction and tilt amount by tilting. The tilt amount can also be said to be the angle at which the right analog stick 77a or the left analog stick 77b is tilted. The right analog stick 77a and the left analog stick 77b also function as push-buttons that sink downward when pressed by the user and return to their original position when the user releases their hand. Hereinafter, the right analog stick 77a and the left analog stick 77b will also be collectively referred to as the "analog stick 77." The operation buttons 76, directional buttons 71, and analog stick 77 are used to operate an application (a game in this embodiment) executed on the information processing device 10.
[0027] A touchpad 79 is provided on the flat area on the top surface of the housing between the direction buttons 71 and the operation buttons 76. In addition to detecting touches by the user's fingers, the touchpad 79 also functions as a push-button that sinks downward when pressed by the user and returns to its original position when the user releases their hand. A speaker 84 is also provided on the top surface of the housing.
[0028] A home button 80 is provided between the right analog stick 77a and the left analog stick 77b. The home button 80 is used to power on the controller 6 and the information processing device 10, and at the same time activate a communication function for wirelessly connecting to the information processing device 10. After the controller 6 is connected to the information processing device 10, the home button 80 is also used to display a menu screen or home screen on the information processing device 10. The menu screen or home screen is a screen that allows the user to select a function or application to be executed by the information processing device 10.
[0029] The SHARE button 81 is provided on the left side of the touchpad 79. The OPTIONS button 82 is provided on the right side of the touchpad 79. The SHARE button 81 and the OPTIONS button 82 are used to input instructions from the user to the OS (Operating System) or system software in the information processing device 10. In other words, the SHARE button 81 and the OPTIONS button 82 are buttons used to call up (operate) functions of the OS (Operating System) or system software in the information processing device 10. The SHARE button 81 and the OPTIONS button 82 may both be formed as push buttons.
[0030] The light-emitting unit 86 is provided on the lower edge of the touchpad 79. The light-emitting unit 86 includes a plurality of lamps (five lamps in the example of FIG. 2 ) and displays information about the state of the controller 6 by the lighting modes of the plurality of lamps (i.e., a combination of lighting and extinguishing states). Normally, the light-emitting unit 86 is controlled to a lighting mode that indicates identification information of the controller 6 (information for distinguishing it from other controllers). In this embodiment, when the profile information applied to operations on the controller 6 is switched, the light-emitting unit 86 is controlled for a short time to a lighting mode that indicates that the profile information of the controller 6 has been switched.
[0031] The right function button 88a and the left function button 88b (hereinafter collectively referred to as "function buttons 88") are buttons that change or expand the functions of other buttons. In this embodiment, when an operation is input to the operation button 76 while an operation is input to the function button 88, the profile information applied to the operation on the controller 6 is switched to the profile information associated with the type of the operation button 76 that was operated together with the function button 88. The right function button 88a and the left function button 88b may be functionally identical. In this case, the same function is provided regardless of whether the left or right button is operated.
[0032] 2, the controller 6 is configured to have various input units (various buttons, sticks, etc.). The user inputs operations into the input units of the controller 6 while looking at the menu screen and game screen displayed on the display device 4.
[0033] Fig. 3 shows a hardware configuration related to this embodiment of the controller 6. In addition to the hardware shown in Fig. 2, the controller 6 includes a vibrator 90, a storage unit 92, a communication control unit 94, and a processor 96. The processor 96 executes various data processing operations and controls the operation of various hardware components. The processor 96 may include a CPU (Central Processing Unit), a memory, and an SoC (System on a Chip).
[0034] The vibrator 90 vibrates based on a control signal from the processor 96, thereby providing a tactile stimulus to the user. The memory unit 92 stores data referenced or updated by the processor 96. The communication control unit 94 controls communication with an external device. In the embodiment, the communication control unit 94 performs wireless communication with the information processing device 10, but as a modified example, the communication control unit 94 may perform wired communication with the information processing device 10.
[0035] 4 shows the hardware configuration of the information processing device 10. The information processing device 10 includes a main power button 20, a power-on LED 21, a standby LED 22, a system controller 24, a clock 26, a device controller 30, a media drive 32, a USB module 34, a flash memory 36, a wireless communication module 38, a wired communication module 40, a subsystem 50, and a main system 60.
[0036] The main system 60 includes a main CPU, a memory serving as a main storage device, a memory controller, a GPU (Graphics Processing Unit), and the like. The GPU is primarily used for processing game programs. These functions may be configured as an SoC (System on a Chip) and formed on a single chip. The main CPU has the function of starting up the OS and, in the environment provided by the OS, executing applications installed in a storage unit (e.g., flash memory 36 or an auxiliary storage device not shown). The main system 60 also has the function of controlling the content displayed on the display device 4.
[0037] The subsystem 50 includes a sub-CPU, a memory serving as a main storage device, a memory controller, and the like, but does not include a GPU. The number of circuit gates of the sub-CPU is smaller than that of the main CPU, and the operating power consumption of the sub-CPU is smaller than that of the main CPU. The sub-CPU operates while the main CPU is in standby mode, and its processing functions are limited to keep power consumption low. The sub-CPU and memory may be formed on separate chips.
[0038] The main power button 20 is an input unit that receives operational input from the user, is provided on the front of the housing of the information processing device 10, and is operated to turn on or off the power supply to the main system 60 of the information processing device 10. Hereinafter, when the main power is on, it means that the main system 60 is in an active state, and when the main power is off, it means that the main system 60 is in a standby state. The power ON LED 21 lights up when the main power button 20 is on, and the standby LED 22 lights up when the main power button 20 is off.
[0039] The system controller 24 detects when the user presses the main power button 20. When the main power button 20 is pressed while the main power is in the off state, the system controller 24 interprets the pressing operation as an "on instruction." On the other hand, when the main power button 20 is pressed while the main power is in the on state, the system controller 24 interprets the pressing operation as an "off instruction." The system controller 24 may also obtain the same power on / off instructions as above from an operation input from the controller 6.
[0040] While the main CPU has the function of executing game programs installed in a specified storage unit or ROM medium 44, the sub-CPU does not have such functions. However, the sub-CPU does have the function of accessing the storage unit and the function of sending and receiving data to and from external devices. The sub-CPU is configured with only these limited processing functions, and therefore can operate with less power consumption than the main CPU. These functions of the sub-CPU are executed when the main CPU is in standby mode.
[0041] The clock 26 is a real-time clock that generates current date and time information and supplies it to the system controller 24, the subsystem 50, and the main system 60.
[0042] The device controller 30 is configured as an LSI (Large-Scale Integrated Circuit) that, like a southbridge, transfers information between devices. As shown in the figure, devices such as the system controller 24, media drive 32, USB module 34, flash memory 36, wireless communication module 38, wired communication module 40, subsystem 50, and main system 60 are connected to the device controller 30. The device controller 30 absorbs differences in the electrical characteristics and data transfer speeds of each device and controls the timing of data transfer.
[0043] The media drive 32 is a drive device that is driven by mounting a ROM medium 44 on which application software such as games and license information are recorded, and that reads programs, data, and the like from the ROM medium 44. The ROM medium 44 is a read-only recording medium such as an optical disc, a magneto-optical disc, or a Blu-ray disc.
[0044] The USB module 34 is a module that connects to an external device via a USB cable. The flash memory 36 is an auxiliary storage device that constitutes internal storage. The wireless communication module 38 wirelessly communicates with, for example, the controller 6 or headphones 8 using a communication protocol such as Bluetooth (trademark or registered trademark) protocol or IEEE802.11 protocol. The wired communication module 40 communicates with an external device via a wire, and connects to the Internet, a server, or the like via an access point (not shown), for example.
[0045] 5 is a block diagram showing the functional blocks of the controller 6. Each block shown in the block diagram in this specification can be realized in terms of hardware by elements such as a computer processor, CPU, and memory, as well as electronic circuits and mechanical devices, and in terms of software by a computer program loaded into memory, etc. However, the functional blocks shown here are realized by the cooperation of these elements. Therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various ways by combining hardware and software.
[0046] The controller 6 includes a profile storage unit 100 and a processing unit 102. The profile storage unit 100 is realized by the storage unit 92 shown in FIG. 3. The processing unit 102 executes various information processes. The processing unit 102 is realized by the processor 96 shown in FIG. 3.
[0047] The profile storage unit 100 stores profile information of the controller 6. The profile storage unit 100 stores multiple pieces of profile information in association with different operation buttons 76. In the embodiment, the profile storage unit 100 stores up to four pieces of profile information in association with the four operation buttons 76 (circle button 72, cross button 73, square button 74, and triangle button 75), respectively.
[0048] The processing unit 102 includes an operation detection unit 104, an operation information generation unit 106, an operation information transmission unit 108, a change unit 110, a notification unit 112, and a setting update unit 114. A computer program (e.g., firmware) that implements at least some of these functions may be stored in the storage unit 92 of the controller 6. The processor 96 of the controller 6 may perform at least some of these functions by reading this computer program into main memory and executing it.
[0049] The operation detection unit 104 detects user operations input to the controller 6. User operations include, for example, pressing a button and tilting the analog stick 77.
[0050] The operation information generation unit 106 generates user operation information to be transmitted from the controller 6 to the information processing device 10, based on profile information to be applied to operations on the controller 6 selected by the user and an operation by the user input to the controller 6 detected by the operation detection unit 104. For example, when an operation of a first tilt amount is input to the analog stick 77, the operation information generation unit 106 may determine a second tilt amount of the analog stick 77 to be input to the information processing device 10, based on the sensitivity and the size of the dead zone indicated by the profile information to be applied to operations on the controller 6. Then, the operation information generation unit 106 may generate operation information indicating the second tilt amount of the analog stick 77.
[0051] The operation information transmitting unit 108 transmits the user operation information generated by the operation information generating unit 106 to the information processing device 10.
[0052] When an operation on the function button 88 as the first button and an operation on the operation button 76 as the second button are input, the change unit 110 switches the profile information to be applied to the operation on the controller 6. Specifically, when an operation on the function button 88 and an operation on a specific operation button 76 are input, the change unit 110 switches the profile information to be applied to the operation on the controller 6 to the profile information associated with the specific function button 88 to be operated, from among the multiple pieces of profile information stored in the profile storage unit 100.
[0053] When the profile information applied to the operation of the controller 6 is switched, the notification unit 112 provides the user with at least one type of feedback from among multiple types of feedback. The notification unit 112 has multiple types of feedback systems for notifying the user that the profile information applied to the operation of the controller 6 has been switched.
[0054] The setting update unit 114 updates the profile information stored in the profile storage unit 100 based on update data for the profile information transmitted from the information processing device 10.
[0055] 6 is a block diagram showing functional blocks of the information processing device 10. The information processing device 10 includes a storage unit 200 and a processing unit 210. The processing unit 210 executes various information processes. The processing unit 210 is implemented by a processor of the information processing device 10, and may be implemented by, for example, the main system 60 shown in FIG. 4. The storage unit 200 stores data referenced or updated by the processing unit 210. The storage unit 200 may include the flash memory 36 or ROM medium 44 shown in FIG. 4.
[0056] The storage unit 200 includes an application storage unit 202 and a profile storage unit 204. The application storage unit 202 stores data of applications that can be executed by the information processing device 10 (game programs in this embodiment).
[0057] The profile storage unit 204 stores the profile information of the controller 6. At least some (up to four pieces of profile information) of the multiple pieces of profile information stored in the profile storage unit 204 correspond to the profile information stored in the controller 6.
[0058] The processing unit 210 includes a profile information acquisition unit 212, an operation information reception unit 214, an application execution unit 216, a setting screen generation unit 218, a display control unit 220, an audio processing unit 221, a notification unit 222, and an update instruction unit 224. A computer program that implements at least some of these functions may be stored in the storage unit 200 of the information processing device 10. A processor (e.g., main system 60) of the information processing device 10 may perform at least some of these functions by reading this computer program into main memory and executing it.
[0059] The profile information acquisition unit 212 acquires profile information stored in the controller 6 from the controller 6 connected to the information processing device 10, and stores the acquired profile information in the profile storage unit 204. For example, the profile information acquisition unit 212 acquires a plurality of pieces of profile information stored in the controller 6 that can be selected by the user.
[0060] The operation information receiving unit 214 receives information about a user's operation on the controller 6, which is transmitted from the controller 6 connected to the information processing device .
[0061] The application execution unit 216 executes an application program (a game program in this embodiment) stored in the application storage unit 202. The application execution unit 216 progresses the game in accordance with operation information of the user on the controller 6, and sequentially generates images (hereinafter also referred to as "game screens") showing the progress of the game.
[0062] The setting screen generation unit 218 detects, based on operation information of the user on the controller 6, that a predetermined operation has been input using the function button 88 as the first button while the game is being played (for example, while the game screen is being displayed). When the setting screen generation unit 218 detects that a predetermined operation has been input using the function button 88, it generates information related to the profile information acquired by the profile information acquisition unit 212 and stored in the profile storage unit 204. As will be described later, the information related to the profile information includes a function menu window and a setting screen for the profile information.
[0063] The display control unit 220 outputs game screen data generated by the application execution unit 216 to the display device 4, thereby causing the game screen to be displayed on the display device 4. In addition, the display control unit 220 outputs information related to the profile information of the controller 6, generated by the setting screen generation unit 218, to the display device 4, thereby causing the information to be displayed on the display device 4.
[0064] The audio processing unit 221 controls audio output from speakers and the like connected to the information processing device 10. For example, the audio processing unit 221 transmits a signal of game audio generated by the application execution unit 216 to the headphones 8, causing the game audio to be output from the headphones 8. Alternatively, the audio processing unit 221 transmits the game audio to the controller 6, causing the game audio to be output from a speaker 84 built into the controller 6. The audio processing unit 221 also transmits a signal of chat audio (e.g., speech by other users) input from an external device to the information processing device 10 to the headphones 8, causing the chat audio to be output from the headphones 8. The audio processing unit 221 may mix the game audio and chat audio and output the resulting mixture from the headphones 8, or may output the resulting mixture from the speaker 84 of the controller 6.
[0065] In response to a user operation on the profile information setting screen, the update instruction unit 224 transmits an instruction to update the profile information to the controller 6. The update instruction unit 224 causes the controller 6 to store the profile information edited on the profile information setting screen; in other words, causes the edit content on the profile information setting screen to be reflected in the profile information stored in the controller 6.
[0066] The notification unit 222 provides predetermined feedback to the user when the profile information applied to the operation of the controller 6 is switched. The notification unit 112 of the controller 6 and the notification unit 222 of the information processing device 10 constitute the notification unit of the information processing system 1. The notification unit of the information processing system 1 has multiple types of feedback systems for notifying the user when the profile information applied to the operation of the controller 6 is switched.
[0067] Various types of feedback systems are means or mechanisms for providing information perceived by different types of senses to a user, and include hardware and software. The information provided to a user by a feedback system is also called "feedback." Feedback can include various physical phenomena using hardware, such as physical stimuli for the user.
[0068] The multiple types of feedback systems include feedback systems that provide visual information as feedback and feedback systems that provide tactile information as feedback. Visual information, which can also be referred to as visual stimuli, is information (e.g., images) that is sensed by a person's vision. Hardware that provides visual information as feedback includes one or both of a light-emitting unit 86 of the controller 6 and a display device 4 that is different from the controller 6. Tactile information, which can also be referred to as tactile stimuli, is information (e.g., vibrations) that is sensed by a person's sense of touch. Hardware that provides tactile information as feedback includes a vibrator 90 of the controller 6.
[0069] When the profile information applied to the operation of the controller 6 is switched, the notification unit of the information processing system 1 provides the user with one or more types of feedback selected by the user from among the multiple types of feedback. Specifically, when the profile information applied to the operation of the controller 6 is switched, the notification unit of the information processing system 1 activates one or more types of feedback systems corresponding to the one or more types of feedback selected by the user from among the multiple types of feedback systems.
[0070] The operation of the information processing system 1 configured as described above will now be described. When the controller 6 is connected to the information processing device 10, the profile information acquisition unit 212 of the information processing device 10 acquires the profile information stored in the profile storage unit 100 of the controller 6 and stores it in the profile storage unit 204. In the following description, it is assumed that the application execution unit 216 of the information processing device 10 is currently executing a game program, and the display control unit 220 is currently displaying a game screen on the display device 4.
[0071] First, the operation for switching profiles will be described. Fig. 7 shows an example of profile switching using the function button 88.
[0072] In Case 1, the user holds the controller 6 and presses the function button 88 as the first button while pressing the triangle button 75 as the second button. In this case, when the change unit 110 of the controller 6 detects that the triangle button 75 is pressed while detecting that the function button 88 is pressed, the change unit 110 of the controller 6 switches to profile information associated with the triangle button 75 (for example, a default profile). Although not shown, if the user presses the cross button 73 while pressing the function button 88, the change unit 110 of the controller 6 switches to profile information associated with the cross button 73 (for example, fighting profile 1).
[0073] In Case 2, the user inputs a long press on the function button 88. In this embodiment, the long press is a press that continues for 400 milliseconds or longer. The setting screen generation unit 218 of the information processing device 10 detects the long press on the function button 88 and generates a function menu window (described later). The display control unit 220 displays the function menu window overlaid on the game screen. If the user continues to press the function button 88 and presses the △ button 75 after the function menu window is displayed, the change unit 110 of the controller 6 detects the press of the △ button 75 while detecting the press of the function button 88, and therefore switches to profile information (e.g., a default profile) associated with the △ button 75. When the user stops pressing the function button 88, the display control unit 220 of the information processing device 10 terminates the display of the function menu window on the game screen.
[0074] Case 3 shows a case where the user presses the triangle button 75 before the function button 88 has been pressed for 400 milliseconds (i.e., before the function menu window 302 is displayed), and then the function button 88 is pressed for 400 milliseconds. In this case, the change unit 110 of the controller 6 detects that the triangle button 75 has been pressed while detecting the function button 88 being pressed, and therefore switches to the profile information (for example, the default profile) associated with the triangle button 75. Meanwhile, the display control unit 220 of the information processing device 10 detects that another button (here, the triangle button 75) has been operated before the function button 88 has been pressed for 400 milliseconds, and suppresses the display of the function menu window 302.
[0075] When a profile information switching operation is performed, the change unit 110 of the controller 6 notifies the operation information generation unit 106 of this. The operation information generation unit 106 generates user operation information based on the currently selected profile information, which is the profile information selected by the operation when a profile information switching operation is performed. For example, the operation information generation unit 106 generates operation information for the analog stick 77 based on the amount of tilt of the analog stick 77 by the user and the sensitivity and dead zone setting values indicated by the currently selected profile information. The application execution unit 216 of the information processing device 10 executes an application (game program) based on the operation information transmitted from the controller 6 and reflecting the currently selected profile information.
[0076] FIG. 8 shows an example of a function menu window. As described above, the function menu window 302 is displayed superimposed on a screen showing the execution result of an application (a game screen 300 in the figure). The function menu window 302 includes a list of multiple profile information that the user can select on the controller 6 as information related to the profile information of the controller 6. The list of profile information includes information on the operation button 76 associated with each of the multiple profile information. The list of profile information may also include profile IDs, names, and corresponding button information. The function menu window 302 in FIG. 8 shows that the default profile is associated with the △ button 75, and the fighting profile 1 is associated with the X button 73.
[0077] The selected profile indicator 304 is an object that indicates the profile information currently selected on the controller 6. When the profile information applied to an operation on the controller 6 is switched, the notification unit 112 of the controller 6 notifies the information processing device 10 of the profile information to be applied after the switch (i.e., the currently selected profile information). The setting screen generation unit 218 of the information processing device 10 adds the selected profile indicator 304 to the currently selected profile information among the profile information set in the function menu window 302.
[0078] The function menu window 302 also presents a profile information customization function in association with an image showing the OPTIONS button 82. The profile information customization function using the function button 88 and the OPTIONS button 82 will be described later with reference to FIG.
[0079] The function menu window 302 also includes information on shortcut assignments for voice operations. For example, the function menu window 302 in Fig. 8 indicates that the up button 71a and down button 71c of the controller 6 function as shortcut keys for adjusting the volume of the headphones 8. Furthermore, the function menu window 302 in Fig. 8 indicates that the left button 71b and right button 71d of the controller 6 function as shortcut keys for adjusting the balance between the game volume and the chat volume.
[0080] The change unit 110 of the controller 6 further executes a change process related to audio output when an operation on the direction button 71 as a second button is input together with an operation on the function button 88 as a first button. In the embodiment, the change unit 110 of the controller 6 transmits an instruction to change audio output to the information processing device 10 when an operation on the direction button 71 is input together with an operation on the function button 88. The audio processing unit 221 of the information processing device 10 changes the mode of audio output from the audio output device (headphones 8 or speaker 84 of the controller 6 in the embodiment) in response to the above instruction from the controller 6.
[0081] Specifically, when an operation of the up button 71a or the down button 71c is input together with an operation of the function button 88, the change unit 110 of the controller 6 transmits a signal to the information processing device 10 instructing a change in the volume of the headphones 8 or the speaker 84 of the controller 6. For example, an operation of the function button 88 plus the up button 71a may instruct an increase in the volume, and an operation of the function button 88 plus the down button 71c may instruct a decrease in the volume. The audio processing unit 221 of the information processing device 10 changes the volume of the audio (for example, game audio or chat audio) output from the speaker 84 of the headphones 8 or the controller 6 in accordance with the signal received from the controller 6.
[0082] Furthermore, when an operation is input using the left button 71b or the right button 71d together with the function button 88, the change unit 110 of the controller 6 transmits a signal instructing adjustment of the balance between the game volume and the chat volume to the information processing device 10. For example, an operation of the function button 88 and the left button 71b may instruct a decrease in the chat volume ratio, and an operation of the function button 88 and the right button 71d may instruct an increase in the chat volume ratio. The audio processing unit 221 of the information processing device 10 changes the balance between the game volume and the chat volume output from the headphones 8 and the speaker 84 of the controller 6 in accordance with the signal received from the controller 6.
[0083] 9 shows an example of changing the audio output using the function button 88. In case 1, the user holds the controller 6 and presses the up button 71a while pressing the function button 88. In this case, the change unit 110 of the controller 6 works in conjunction with the audio processing unit 221 of the information processing device 10 to increase the volume of the audio output from the headphones 8 by one unit.
[0084] In Case 2, the user inputs a long press operation on the function button 88, but also starts pressing the up button 71a before the function button 88 has been pressed for 400 milliseconds. In this case, the change unit 110 of the controller 6 gradually increases the volume of the sound output from the headphones 8 and the speaker 84 of the controller 6 while the up button 71a continues to be pressed. Furthermore, the display control unit 220 of the information processing device 10 detects that another button (here, the up button 71a) has been operated before the function button 88 has been pressed for 400 milliseconds, and suppresses the display of the function menu window 302.
[0085] In case 2, the user continues to press the up button 71a even after finishing operating the function button 88. Even if the change unit 110 of the controller 6 detects that the up button 71a has been pressed after finishing operating the function button 88, the change unit 110 does not increase the volume of the sound output from the headphones 8. Note that the application execution unit 216 of the information processing device 10 may recognize the pressing of the up button 71a after finishing operating the function button 88 as an operation for the game, and may reflect this in the progress of the game.
[0086] In Case 3, the user inputs a long press of the function button 88, and after 400 milliseconds of pressing the function button 88, presses the up button 71a multiple times. The setting screen generation unit 218 of the information processing device 10 detects the long press of the function button 88 and generates a function menu window, and the display control unit 220 displays the function menu window superimposed on the game screen. When the long press of the function button 88 ends, the display control unit 220 ends the display of the function menu window. The change unit 110 of the controller 6 gradually increases the volume of the sound output from the headphones 8 depending on the number of times the up button 71a is pressed during the period in which the function button 88 is continuously pressed.
[0087] 10 shows an example in which both profile switching and audio output change are performed using the function button 88. The user presses the up button 71a before pressing the function button 88, and then starts to press and hold the function button 88 while continuing to press the up button 71a. Because the up button 71a is pressed before pressing the function button 88, no special operation (e.g., volume increase processing) is performed at the timing of pressing the function button 88. The application execution unit 216 of the information processing device 10 recognizes the pressing of the up button 71a before operating the function button 88 as an operation for the game, and reflects this in the progress of the game.
[0088] While holding down the function button 88, the user sequentially presses the triangle button 75, the down button 71c, and the cross button 73. When the change unit 110 of the controller 6 detects that the triangle button 75 has been pressed, it switches to profile information (for example, a default profile) associated with the triangle button 75. The change unit 110 of the controller 6 gradually decreases the volume of the sound output from the headphones 8 during the period in which the function button 88 is continuously pressed and the down button 71c is continuously pressed. When the change unit 110 of the controller 6 detects that the function button 88 has been pressed and the cross button 73 has been pressed, it switches to profile information (for example, fighting profile 1) associated with the cross button 73.
[0089] In this way, when an operation is input to the operation button 76 along with an operation to the function button 88, the change unit 110 of the controller 6 executes change processing for a setting item of the type that is determined with one press (in other words, one operation). In this embodiment, the setting item of the type that is determined with one press is the profile information of the controller 6, but as a modified example, it may be an application to be executed, or an object to be operated within the application (for example, a game character, etc.).
[0090] Furthermore, when an operation is input to the direction button 71 together with an operation to the function button 88, the change unit 110 of the controller 6 executes a change process for a setting item whose value changes continuously. In this embodiment, the setting item whose value changes continuously is the volume and audio balance, but in a modified example, it may be the brightness, luminosity, saturation, etc. of an image in an application, or the movement speed of an object to be controlled within the application (for example, a game character, etc.).
[0091] According to the information processing system 1 of the embodiment, the user can quickly switch the profile information applied to the operation of the controller 6, thereby improving the convenience of the controller 6. For example, if the user knows which operation button 76 is associated with the desired profile information to switch to, the user can switch to the desired profile information with a single operation using the function button 88 and the operation button 76, regardless of the currently selected profile information. In other words, the user can switch the profile information applied to the operation of the controller 6 without taking their eyes off the screen on which the game is being played. Furthermore, according to the information processing system 1 of the embodiment, the profile information is switched by command, so that special hardware for switching the profile information is not required.
[0092] Next, an operation related to notifying the user of a change in profile information will be described. When the change unit 110 of the controller 6 changes the profile information to be applied to an operation, the notification unit 112 of the controller 6 can control the operation of one or both of the light-emitting unit 86 and the vibrator 90 in accordance with a predetermined feedback setting. That is, the notification unit 112 can provide the user with feedback using one or both of visual information and tactile information in response to a single change in profile information.
[0093] For example, when an indicator of the controller is selected as the feedback system, the notification unit 112 may send a signal to the light-emitting unit 86 instructing it to emit light for a predetermined period of time in a manner indicating that the profile information has been switched. In this case, the light-emitting unit 86 emits light in the above manner, thereby providing the user with feedback using visual information indicating the profile switch. Furthermore, when vibration of the controller is selected as the feedback system, the notification unit 112 may send a signal to the vibrator 90 instructing it to vibrate for a predetermined period of time. In this case, the vibrator 90 vibrates, thereby providing the user with feedback using tactile information indicating the profile switch.
[0094] When the profile information to be applied to an operation is switched by the change unit 110 of the controller 6, the notification unit 112 of the controller 6 further notifies the information processing device 10 of the profile information switching by transmitting data indicating that the profile information has been switched to the information processing device 10. When the notification unit 222 of the information processing device 10 is notified of the profile information switching from the controller 6 and screen notification is specified as the feedback system in the predetermined feedback settings, it causes the display device 4 to display information (such as an image or a message) indicating that the profile information has been switched. Information regarding the profile information switching may be displayed superimposed on an image related to an application currently being executed and displayed on the display device 4. In this case, feedback using visual information indicating the profile switching is provided to the user. That is, the visual information as feedback may be displayed on both the display unit of the controller 6 (the light-emitting unit 86 in this embodiment) and the display device 4 other than the controller 6, depending on the user's settings.
[0095] The setting screen generation unit 218 of the information processing device 10 generates data for a screen for setting the mode of feedback for profile switching (hereinafter also referred to as a "feedback setting screen") in response to an operation by the user. The display control unit 220 causes the display device 4 to display the feedback setting screen. The feedback setting screen may be one of the screens related to system settings of the information processing device 10.
[0096] 11 shows an example of a feedback setting screen. The feedback setting screen 330 includes information indicating multiple types of feedback systems that the user can select from. As described above, the multiple types of feedback systems use different hardware, specifically, (1) a controller indicator (a feedback system that uses the light-emitting unit 86 of the controller 6), (2) a controller vibration (a feedback system that uses the vibrator 90 of the controller 6), and (3) a screen notification (a feedback system that uses the display device 4).
[0097] A soft switch 332 is provided in the area for each feedback system on the feedback setting screen 330. The user sets the soft switch 332 corresponding to the desired feedback system to ON. On the feedback setting screen 330 of the embodiment, any feedback mode can be selected from among no feedback (setting all three feedback systems to OFF) to parallel execution of three types of feedback (setting all three feedback systems to ON).
[0098] The notification unit 222 of the information processing device 10 stores information indicating whether feedback by screen notification is on or off, among the settings of the feedback setting screen 330. When feedback by screen notification is set to on, the notification unit 222 notifies the user of the switching of the profile information via the screen of the display device 4. In addition, the notification unit 222 transmits the settings of the feedback setting screen 330 to the controller 6.
[0099] The notification unit 112 of the controller 6 stores information indicating whether feedback by the indicator of the controller 6 is on / off, and information indicating whether feedback by vibration of the controller 6 is on / off, among the settings on the feedback setting screen 330. When feedback by the indicator of the controller 6 is set to on, the notification unit 112 notifies the user of the change in profile information using the light-emitting unit 86. When feedback by vibration of the controller 6 is set to on, the notification unit 112 notifies the user of the change in profile information using the vibrator 90.
[0100] According to the information processing system 1 of the embodiment, when the profile information applied to the operation on the controller 6 is switched, it is possible to provide feedback in a form that is convenient for the user. Furthermore, according to the information processing system 1, it becomes easier for the user to recognize that the setting information has been switched.
[0101] Next, operations related to setting and editing a profile will be described. FIG. 12 schematically shows screen transitions related to setting a profile. While an application is being executed (in this embodiment, while the game screen 300 is being displayed), the setting screen generation unit 218 of the information processing device 10 detects, based on user operation information on the controller 6, that an operation has been input on the function button 88 as the first button as well as an operation on the OPTIONS button 82 as the second button. When the setting screen generation unit 218 detects that an operation has been input on the function button 88 as well as an operation on the OPTIONS button 82, the setting screen generation unit 218 generates data for a setting screen for profile information (hereinafter also referred to as a "profile setting screen"). The display control unit 220 of the information processing device 10 causes the display device 4 to display the profile setting screen instead of the game screen 300.
[0102] The profile setting screen includes a profile top screen 310 and a profile edit screen 320. When the OPTIONS button 82 is operated together with the function button 88 while the game screen 300 (which may include the function menu window 302) is displayed, the screen normally transitions from the game screen 300 to the profile top screen 310.
[0103] The profile top screen 310 is a screen for selecting profile information to be stored in the controller 6 and profile information to be erased (deleted) from the controller 6. The profile top screen 310 includes a profile creation button 312 and profile information to be stored in the controller 6. The profile creation button 312 is a soft button for creating a new profile, and pressing the profile creation button 312 transitions to a profile edit screen 320, which will be described later.
[0104] Any profile information stored in the profile information acquisition unit 212 of the information processing device 10 can be set as the profile information on the profile top screen 310. Each piece of profile information on the profile top screen 310 includes a profile ID, a profile name, and corresponding button information, and an image indicating the type of operation button 76 associated with each piece of profile information is added. In addition, a record button 314, a delete button 316, and an edit button 318 are set for each piece of profile information. The any profile information may be profile information previously set by the user on the information processing device 10, or profile information set by another user that has been downloaded and obtained via a network.
[0105] The record button 314 is a soft button for recording corresponding profile information in the controller 6. When the user selects the record button 314 corresponding to certain profile information, the update instruction unit 224 of the information processing device 10 transmits a signal to the controller 6 instructing it to store the profile information. The setting update unit 114 of the controller 6 stores the profile information specified by the signal in the profile storage unit 100.
[0106] The delete button 316 is a soft button for deleting the corresponding profile information from the controller 6. When the delete button 316 corresponding to certain profile information is selected by the user, the update instruction unit 224 of the information processing device 10 transmits a signal to the controller 6 instructing it to delete the profile information. The setting update unit 114 of the controller 6 erases the profile information specified by the signal from the profile storage unit 100.
[0107] The edit button 318 is a soft button for editing the corresponding profile information. When the edit button 318 corresponding to certain profile information is selected by the user, the setting screen generation unit 218 of the information processing device 10 generates data for a profile edit screen 320 in which the current setting values defined by the profile information are set. The display control unit 220 displays the profile edit screen 320 on the display device 4.
[0108] The profile editing screen 320 is a screen on which the user edits the contents of a new profile or an existing profile (for example, profile information stored in the controller 6). The profile editing screen 320 includes a screen element for editing the function assignment to the buttons, a screen element for adjusting the sensitivity of the analog stick 77, and a screen element for adjusting the dead zone of the analog stick 77.
[0109] In the embodiment, whenever a specific profile is edited on the profile editing screen 320, the update instruction unit 224 of the information processing device 10 reflects the edited content in the specific profile information stored in the profile storage unit 204, and transmits the edited content to the controller 6 each time. The setting update unit 114 of the controller 6 reflects the edited content on the profile editing screen 320 in the specific profile information stored in the profile storage unit 100. As a modified example, the timing at which the edited content on the profile editing screen 320 is reflected in the profile information stored in each of the information processing device 10 and the controller 6 may be the timing at which the profile editing screen 320 transitions to another screen.
[0110] When it is detected that the user has input a predetermined back operation while the profile editing screen 320 is displayed, the display control unit 220 of the information processing device 10 terminates the display of the profile editing screen 320 and re-displays the profile top screen 310. Furthermore, when it is detected that the user has operated the OPTIONS button 82 while operating the function button 88 while the profile top screen 310 is displayed, the display control unit 220 terminates the display of the profile top screen 310 and re-displays the game screen 300.
[0111] In the embodiment, the profile editing screen 320 may be displayed while an application is running (for example, while the game screen 300 is being displayed), and for example, the profile editing screen 320 may be displayed from the game screen 300 via the profile top screen 310. In this way, when it is detected that the user has operated the OPTIONS button 82 while operating the function button 88 while the game is running in the background and the profile editing screen 320 is being displayed, the display control unit 220 of the information processing device 10 terminates the display of the profile editing screen 320 and displays the game screen 300 again. In other words, a direct transition is made from the profile editing screen 320 to the game screen 300.
[0112] Furthermore, when the display control unit 220 detects that the user has operated the OPTIONS button 82 while operating the function button 88 while the game screen 300 is being displayed, and the profile setting screen most recently displayed was the profile editing screen 320, the display control unit 220 terminates the display of the game screen 300 and re-displays the same profile editing screen 320. The same profile editing screen 320 edits the same profile information as the profile editing screen 320 from which the game screen 300 was transitioned.
[0113] That is, on the condition that a direct transition has been made from the profile editing screen 320 to the game screen 300, the display control unit 220 makes a direct transition to the profile editing screen 320, which is the transition source to the game screen 300, rather than making a transition to the profile top screen 310 in response to an operation of the function button 88+OPTIONS button 82 on the game screen 300. The display control unit 220 determines a screen transition in response to an operation of the first button and a predetermined second button (function button 88+OPTIONS button 82) while the game screen 300 is being displayed, in accordance with the screen transition history.
[0114] Additionally, a back button 322 is arranged on the profile editing screen 320. The back button 322 is a software button for transitioning to the screen of the currently running application. When the display control unit 220 displays the profile editing screen 320 while a game is running in the background, the display control unit 220 sets the appearance of the back button 322 to indicate an active state.
[0115] When the active back button 322 on the profile editing screen 320 is selected by the user, the display control unit 220 terminates the display of the profile editing screen 320 and displays the game screen 300 again, just as when the function button 88 and the OPTIONS button 82 are operated. That is, a direct transition is made from the profile editing screen 320 to the game screen 300. Even when a direct transition is made from the profile editing screen 320 to the game screen 300 by using the back button 322, if the function button 88 and the OPTIONS button 82 are operated on the game screen 300, a direct transition is made from the game screen 300 to the profile editing screen 320.
[0116] According to the information processing system 1 of the embodiment, when the user inputs a predetermined operation using the function button 88 of the controller 6 while an application is running, information related to the profile information of the controller 6 is presented to the user. This makes it possible to support the user's operations related to the profile of the controller 6. For example, by displaying the function menu window 302 in response to a long press of the function button 88, multiple pieces of profile information that the user can select are presented to the user, thereby making it possible to support the user's selection of profile information.
[0117] Furthermore, in setting the profile information, the user can easily (1) edit the profile information on the profile editing screen 320, (2) move to the game screen 300 and check the results of editing the profile information (for example, check the movement of the game character, etc.), and (3) return to the same profile editing screen 320 as in 1 above and re-edit the profile information based on the check results in 2 above. In other words, the information processing device 10 can support the user in efficiently optimizing the profile information through trial and error.
[0118] The present invention has been described above based on the embodiments. These embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present invention.
[0119] A modified example will now be described. The multiple types of feedback systems included in the notification unit of the information processing system 1 (for example, one or both of the notification unit 112 of the controller 6 and the notification unit 222 of the information processing device 10) may further include a feedback system that provides auditory information as feedback indicating switching of the profile information of the controller 6. Auditory information can also be referred to as an auditory stimulus, and is information (for example, an audio signal) that is sensed by the human ear.
[0120] For example, the feedback setting screen 330 may allow selection of audio feedback as a feedback system when switching profile information. When profile information is switched and audio feedback is selected as a feedback system, the notification unit 112 of the controller 6 may cause a speaker (not shown) of the controller 6 to output a predetermined sound indicating the switching of profile information. Furthermore, when profile information is switched and audio feedback is selected as a feedback system when switching profiles, the notification unit 222 of the information processing device 10 may cause the headphones 8 to output a predetermined sound indicating the switching of profile information.
[0121] In this modification, the notification unit of the information processing system 1 may provide the user with feedback using at least two of visual information, tactile information, and auditory information in response to a single change in profile information. Different users may find different feedback methods convenient, but this modification adds auditory feedback, making it easier to provide feedback about the profile change in a way that is convenient for each user. This also makes it easier for the user to recognize that the profile information has been changed.
[0122] Another modified example will be described. The setting screen generation unit 218 of the information processing device 10 may generate a setting screen (also referred to as a "menu setting screen") on which the user sets the display contents of the function menu window 302 in response to a user operation. The display control unit 220 may cause the display device 4 to display the menu setting screen. On the menu setting screen, it may be possible to select one of a plurality of patterns related to the display contents. The setting screen generation unit 218 may generate the function menu window 302 including the contents determined by the pattern selected on the menu setting screen.
[0123] The multiple display content patterns selectable on the menu setting screen may include "All Functions," "Assigned Profile," and "Selected Profile." The "All Functions" pattern is a pattern that displays a list of all setting change functions using the function button 88 as shown in FIG. 8. The "Assigned Profile" pattern displays a list of profile information currently assigned to the operation buttons 76 of the controller 6 (in the example of FIG. 8, default profile, sniper rifle profile, melee profile 1, and melee profile 2). The "Selected Profile" pattern displays profile information currently selected on the controller 6 (melee profile 1 in the example of FIG. 8).
[0124] Any combination of the above-described examples and modifications is also useful as an embodiment of the present invention. A new embodiment resulting from a combination will have the combined effects of the combined examples and modifications. It will also be understood by those skilled in the art that the functions to be performed by each constituent element in the claims can be realized by each component shown in the examples and modifications, either individually or in combination.
[0125] The technical ideas described in the above embodiments and modifications can be expressed as the aspects described in the following items. [Item 1-1] The first button and a second button different from the first button; a storage unit that stores setting information related to operations on the operation device; a change unit that switches setting information to be applied to an operation on the operation device when an operation on the second button is input together with an operation on the first button; An operating device comprising: According to this operation device, the user can quickly switch the setting information to be applied to the operation, thereby improving the convenience of the operation device. [Item 1-2] a generating unit that generates user operation information to be transmitted from the operation device to an external information processing device based on setting information applied to the operation of the operation device; The operating device according to item 1-1. According to this operation device, the setting information selected by the user can be reflected in the user's operation information transmitted from the operation device to the information processing device. [Item 1-3] the storage unit stores the plurality of setting information in association with different second buttons, when an operation on a specific second button is input together with an operation on the first button, the change unit switches setting information to be applied to the operation on the operation device to setting information associated with the specific second button. The operating device according to item 1-1 or 1-2. This operation device allows the user to quickly and easily switch to the setting information desired from among a plurality of setting information. [Item 1-4] The second buttons include a button used to operate an application and a button used to operate a system. An operating device according to any one of items 1-1 to 1-3. With this operating device, the user can quickly instruct the execution of various processes related to switching of setting information by combining the first button with a button used to operate an application, or by combining the first button with a button used to operate the system. [Items 1-5] the storage unit stores the setting information in association with a button used to operate the application; when an operation on a button used to operate the application is input together with the operation on the first button, the change unit switches setting information applied to the operation on the operation device to setting information associated with the button used to operate the application. Item 1-4. The operating device according to item 1-4. This operating device allows the user to quickly switch between setting information by using buttons used to operate applications. [Items 1-6] the change unit further executes a change process related to audio output when an operation on a button used for operating the application is input together with the operation on the first button. Item 1-4 or 1-5. According to this operation device, the user can further change the manner of audio output by using buttons used to operate applications. [Items 1-7] the second buttons include a direction key and a specific button different from the direction key; the change unit switches setting information to be applied to the operation of the operation device when an operation on the specific button is input together with an operation on the first button, and executes a change process for a setting item whose value changes continuously when an operation on the direction key is input together with an operation on the first button. An operating device according to any one of items 1-1 to 1-3. This operating device can realize environment change processing suited to the type of button to be operated, such as a specific button or a direction key (for example, switching of setting information or change processing related to setting items whose values change continuously). [Items 1-8] the second button includes a plurality of types of buttons, the change unit switches setting information to be applied to an operation on the operation device or executes a change process related to audio output, depending on the type of the second button whose operation is input together with the operation on the first button. An operating device according to any one of items 1-1 to 1-3. This operating device can realize processing for changing the environment (for example, switching of setting information and processing for changing audio output) that is suited to the type of button to be operated. [Items 1-9] The first button and a second button different from the first button; a storage unit that stores setting information related to operations on the operation device; a processor, when an operation on the second button is input together with an operation on the first button, the processor switches setting information to be applied to the operation on the operation device. Operating device. According to this operation device, the user can quickly switch the setting information to be applied to the operation, thereby improving the convenience of the operation device. [Items 1-10] an information processing device that executes an application; an operating device, The operating device is The first button and a second button different from the first button; a storage unit that stores setting information related to operations on the operation device; a generating unit that generates user operation information based on the setting information; a change unit that switches setting information to be applied to an operation on the operation device when an operation on the second button is input together with an operation on the first button; and the information processing device receives the operation information transmitted from the operation device, and executes the application based on the operation information. Information processing system. According to this information processing system, by executing an application based on operation information that reflects setting information selected by the user, it is possible to better reflect the user's intentions and operations in the progress of the application. [Item 1-11] the change unit of the operation device transmits an instruction to change audio output to the information processing device when an operation on a button used to operate the application is input together with the operation on the first button; the information processing device changes the manner of audio output from the audio output device in response to the instruction to change the audio output. The information processing system according to any one of items 1 to 10. According to this information processing system, the user can quickly make changes to the audio output in a manner similar to changing the setting information. [Item 1-12] An operation device including a first button, a second button different from the first button, and a storage unit that stores setting information related to operations on the operation device, A computer program for realizing a function of switching setting information applied to operations on the operating device when an operation on the second button is input together with an operation on the first button. This computer program allows the user to quickly switch the setting information to be applied to operations on the operation device, thereby improving the convenience of the operation device.
[0126] [Item 2-1] an acquisition unit that acquires setting information related to operations on the operation device, the setting information being stored in the operation device; a display control unit that, when it is detected that a predetermined operation using a first button provided on the operation device has been input during execution of an application, causes a display unit to display information related to setting information regarding operations on the operation device, which information has been acquired by the acquisition unit; An information processing device comprising: According to this information processing device, when a user inputs a predetermined operation using the first button of the operating device while an application is running, information related to setting information regarding operations on the operating device is presented to the user, thereby assisting the user in operating the setting information. [Item 2-2] the acquisition unit acquires a plurality of pieces of setting information that are stored in the operation device and that can be selected by a user; the display control unit displays a list of the plurality of pieces of setting information as information related to setting information related to operations on the operation device. The information processing device according to Item 2-1. According to this information processing device, it is possible to provide the user with information about a plurality of pieces of setting information that the user can select, thereby assisting the user in selecting setting information. [Item 2-3] the predetermined operation is a long press operation on the first button, The information processing device according to Item 2-2. According to this information processing device, it is possible to provide the user with information relating to a plurality of pieces of setting information that the user can select in response to a simple operation on the first button. [Item 2-4] the plurality of pieces of setting information acquired by the acquisition unit are associated with second buttons different from each other and provided on the operation device; the list includes information on a second button associated with each of the plurality of setting information. The information processing device according to item 2-2 or 2-3. This information processing device can assist the user in selecting desired setting information from among a plurality of pieces of setting information. [Item 2-5] The list includes information on shortcut assignments for voice operations in addition to the plurality of pieces of setting information. The information processing device according to any one of items 2-2 to 2-4. This information processing device can further assist the user in performing voice operations. [Item 2-6] when it is detected that an operation on a second button different from the first button has been input together with the operation on the first button, the display control unit displays a setting screen of the setting information as information related to the setting information regarding the operation on the operation device. An information processing device according to any one of items 2-1 to 2-5. According to this information processing device, a setting screen for setting information can be provided to the user in response to a simple operation by the user. [Item 2-7] the setting screen is a screen for selecting setting information to be stored in the operation device or deleted from the operation device; Item 2-6. The information processing device according to item 2-6. This information processing device can assist the user in selecting setting information to be stored in the operation device or deleted from the operation device. [Item 2-8] the setting screen is a screen for editing the contents of setting information stored in the operation device; Item 2-6. The information processing device according to item 2-6. This information processing device can assist the user in editing the setting information. [Item 2-9] the display control unit, when it is detected that an operation on a second button different from the first button has been input together with an operation on the first button while the screen of the application is being displayed, and when the most recently displayed setting screen of the setting information was a screen for editing the contents of the setting information, displays a screen for editing the contents of the same setting information; Item 2-8. The information processing device according to item 2-8. According to this information processing device, direct screen transition between the application screen and the setting screen for the setting information is possible, thereby assisting the user in efficiently editing the setting information while checking the results. [Item 2-10] a button for transitioning to a screen of the application currently being executed is disposed on the screen for editing the content of the setting information; The information processing device according to item 2-8 or 2-9. According to this information processing device, direct screen transition between the application screen and the setting screen for the setting information is possible, thereby assisting the user in efficiently editing the setting information while checking the results. [Item 2-11] further comprising an update unit; the display control unit displays a setting screen of the setting information as information related to the setting information regarding the operation of the operation device; the update unit stores the setting information edited on the setting screen in the operation device. An information processing device according to any one of items 2-1 to 2-10. According to this information processing device, the edited contents of the setting information by the user on the setting screen can be reflected on the operation device. [Item 2-12] a processor; The processor acquires setting information related to operations on the operation device, the setting information being stored in the operation device; and when it is detected that a predetermined operation using a first button provided on the operation device has been input during execution of the application, executing a step of displaying, on a display unit, information related to the setting information regarding the operation on the operation device acquired in the acquiring step. Information processing device. According to this information processing device, when a user inputs a predetermined operation using the first button of the operating device while an application is running, information related to setting information regarding operations on the operating device is presented to the user, thereby assisting the user in operating the setting information. [Item 2-13] an information processing device that executes an application; an operating device, the operation device stores setting information related to operations on the operation device; The information processing device includes: an acquisition unit that acquires setting information related to operations on the operation device, the setting information being stored in the operation device; a display control unit that, when it is detected that a predetermined operation using a first button provided on the operation device has been input during execution of the application, causes a display unit to display information related to setting information regarding operations on the operation device acquired by the acquisition unit. Information processing system. According to this information processing system, when a user inputs a predetermined operation using the first button of an operating device while an application is running, information related to setting information regarding operations on the operating device is presented to the user, thereby assisting the user in operating the setting information. [Item 2-14] a function of acquiring setting information related to operations on the operation device, the setting information being stored in the operation device; a function of displaying, on a display unit, information related to setting information regarding operations on the operation device acquired by the acquiring function, when it is detected that a predetermined operation using a first button provided on the operation device has been input during execution of an application; A computer program for realizing the above on an information processing device. According to this computer program, when a user inputs a predetermined operation using the first button of an operating device while an application is running, information related to setting information regarding operations on the operating device is presented to the user, thereby assisting the user in operating the setting information.
[0127] [Item 3-1] An operation device and a notification unit are provided, the operation device stores a plurality of setting information related to operations on the operation device, the setting information being selectable by a user; the notification unit has a plurality of types of feedback systems for notifying a user when setting information applied to an operation on the operation device has been switched; Information processing system. According to this information processing system, when the setting information applied to the operation of the operating device is switched, feedback can be provided in a form that is convenient for the user, and it is also easier for the user to recognize that the setting information has been switched. [Item 3-2] the multiple feedback systems provide information sensed by different types of senses; The information processing system according to Item 3-1. According to this information processing system, feedback can be provided in a form that is convenient for the user, and the user can easily recognize that the setting information has been switched. [Item 3-3] the plurality of types of feedback systems includes a feedback system that provides visual information; The information processing system according to item 3-1 or 3-2. According to this information processing system, feedback can be provided to the user by visual information when visual perception is convenient for the user. [Item 3-4] the visual information is displayed on a display unit of the operation device. The information processing system according to Item 3-3. According to this information processing system, visual information is displayed as feedback on the operation device operated by the user, making it easier for the user to recognize that the setting information has been switched. [Item 3-5] the visual information is displayed on a display device different from the operation device. The information processing system according to Item 3-3. According to this information processing system, when the user looks at a display device other than the operation device, the user can easily recognize that the setting information has been switched. [Item 3-6] the visual information is displayed on both a display unit of the operation device and a display device different from the operation device; The information processing system according to Item 3-3. According to this information processing system, it becomes easier for the user to recognize that the setting information has been switched. [Item 3-7] the plurality of types of feedback systems includes a feedback system that provides tactile information; The information processing system according to any one of items 3-1 to 3-6. This information processing system can provide the user with feedback in the form of tactile information when tactile sensing is convenient for the user. [Item 3-8] the plurality of types of feedback systems include a feedback system that presents auditory information; An information processing system according to any one of items 3-1 to 3-7. According to this information processing system, feedback can be provided to the user by auditory information when auditory perception is convenient for the user. [Item 3-9] the notification unit provides feedback to the user using at least two of visual information, tactile information, and auditory information. The information processing system according to item 3-1 or 3-2. According to this information processing system, it becomes easier for the user to recognize that the setting information has been switched. [Item 3-10] the notification unit provides the user with one or more types of feedback selected by the user from the plurality of types of feedback. The information processing system according to items 3-1 to 3-9. According to this information processing system, feedback can be provided in a form selected by the user and convenient for the user. [Item 3-11] an operating device and a processor; the operation device stores a plurality of setting information related to operations on the operation device, the setting information being selectable by a user; When the setting information to be applied to the operation of the operation device is switched, the processor activating at least one feedback system among a plurality of types of feedback systems for notifying the user of the fact; Information processing system. According to this information processing system, when the setting information applied to the operation of the operating device is switched, feedback can be provided in a form that is convenient for the user, and it is also easier for the user to recognize that the setting information has been switched. [Industrial Applicability]
[0128] The present invention can be applied to a system including an operation device into which an operation is input. [Explanation of symbols]
[0129] 1 Information processing system, 4 Display device, 6 Controller, 10 Information processing device, 76 Operation button, 88 Function button, 100 Profile storage unit, 110 Change unit, 112 Notification unit, 212 Profile information acquisition unit, 220 Display control unit, 222 Notification unit.
Claims
1. An operation device, a display device different from the operation device, and a notification unit, the operation device stores a plurality of setting information related to operations on the operation device, the setting information being selectable by a user; the display device displays an execution result of an application based on an operation input to the operation device; the operation device is provided with a first button and a plurality of second buttons different from the first button, the plurality of pieces of setting information are associated with second buttons different from each other and provided on the operation device; when an operation of a specific second button is input together with the operation of the first button, the operation device switches so that setting information associated with the specific second button is applied to the operation of the operation device; the notification unit has a plurality of types of feedback systems for notifying a user when setting information applied to an operation on the operation device has been switched; the plurality of types of feedback systems include a feedback system that provides visual information; The visual information is displayed on both the display device and the display unit of the operation device. Information processing system.
2. the multiple feedback systems provide information sensed by different types of senses; The information processing system according to claim 1 .
3. the plurality of types of feedback systems includes a feedback system that provides tactile information; The information processing system according to claim 1 .
4. the plurality of types of feedback systems include a feedback system that presents auditory information; The information processing system according to claim 1 .
5. the notification unit provides feedback to the user using at least two of visual information, tactile information, and auditory information. The information processing system according to claim 1 .
6. the notification unit provides the user with one or more types of feedback selected by the user from the plurality of types of feedback. The information processing system according to claim 1 .
7. The display device displays information about the change of setting information to be applied to operations on the operation device, superimposed on an image related to the running application. The information processing system according to claim 1 .
8. An operation device, a display device different from the operation device, and a processor, the operation device stores a plurality of setting information related to operations on the operation device, the setting information being selectable by a user; the display device displays an execution result of an application based on an operation input to the operation device; the operation device is provided with a first button and a plurality of second buttons different from the first button, the plurality of pieces of setting information are associated with second buttons different from each other and provided on the operation device; when an operation of a specific second button is input together with the operation of the first button, the operation device switches so that setting information associated with the specific second button is applied to the operation of the operation device; When the setting information to be applied to the operation of the operation device is switched, the processor activating at least one feedback system from among a plurality of types of feedback systems for notifying the user of the fact; the plurality of types of feedback systems include a feedback system that provides visual information; The visual information is displayed on both the display device and the display unit of the operation device. Information processing system.
Citation Information
Patent Citations
Electronic apparatus
JP2002244789A
Information processing system and information processing device
JP2015084944A
System and method for shifting haptic feedback function between passive and active modes
JP2018088260A
Remote controller for lighting fixture, lighting fixture, and lighting system
JP2019208150A