Operating device, information processing apparatus, information processing method, and program

Abstract

This operating device, which comprises a direction instruction operating member that is operated by being pushed in any direction by a user, and an operating member of a different type to the direction instruction operating member, generates operation data including operating information representing operation content with respect to the direction instruction operating member and the different type of operating member, and transmits the operation data to an information processing apparatus, wherein, if a request is received to utilize a substitution input function for substituting the direction instruction operating member for the different type of operating member, the operating information representing the operation content with respect to the different type of operating member, to be included in the operation data, is determined in accordance with the operation content of the user with respect to the direction instruction operating member.

Description

Operation device, information processing device, information processing method, and program

[0001] The present invention relates to an operation device that accepts operation input from a user, an information processing device, an information processing method, and a program.

[0002] For example, an operating device connected to an information processing device such as a home game console typically has multiple operating members such as operating buttons. Each of these operating members is assigned a specific function, and the user issues instructions to the information processing device by operating the operating member corresponding to the function they wish to execute. However, when multiple operating buttons are used, the ease of operation of each operating button may vary from user to user depending on factors such as their placement. Therefore, a technology has been proposed that allows the user to freely change the functions assigned to each of the multiple operating buttons, for example by swapping them around.

[0003] In the above-described conventional technology, although it is possible to change the assignment of functions between the same type of operation members (e.g., operation buttons) corresponding to the same type of operation input, it is not possible to change the assignment of functions between different types of operation members. This is because different types of operation members have different input contents, making it difficult to use one type of operation member as a substitute for another type of operation member. However, some people may prefer to use a specific type of operation member, and in such cases, the above-described conventional technology alone may not be sufficient to improve user convenience.

[0004] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an operation device, an information processing device, an information processing method, and a program that can further improve user convenience.

[0005] The operating device of the present invention is an operating device connected to an information processing device, and includes: a direction indicating operating member that is operated by a user by pressing it in any direction; an operating member of a type different from the direction indicating operating member; an operation data generation unit that generates operation data including operation information indicating the operation content for the direction indicating operating member and the other type of operating member; and an operation data transmission unit that transmits the operation data to the information processing device, wherein when a request is made to use an alternative input function in which the direction indicating operating member is a substitute for the other type of operating member, the operation data generation unit determines the operation information indicating the operation content for the other type of operating member included in the operation data according to the operation content of the user for the direction indicating operating member.

[0006] The information processing device of the present invention is an information processing device connected to an operation device that has a direction indication operation member that is operated by a user by pressing it in any direction, and an operation member of a type different from the direction indication operation member, and is characterized in that it includes: a reception unit that receives from the user a request to use an alternative input function that uses the direction indication operation member as a substitute for the other type of operation member, and a transmission unit that transmits information indicating the content of the received usage request to the operation device.

[0007] The information processing method of the present invention is characterized in that it causes a computer connected to an operation device that includes a direction indicating operation member that is operated by a user by pressing it in any direction, and an operation member of a type different from the direction indicating operation member, to execute the steps of receiving from the user a request to use an alternative input function that uses the direction indicating operation member as a substitute for the other type of operation member, and transmitting information indicating the content of the received request to the operation device.

[0008] A program according to the present invention causes a computer connected to an operation device including a direction indicating operation member that is operated by being pressed in any direction by a user and an operation member of a type other than the direction indicating operation member to execute the steps of receiving, from the user, a request to use an alternative input function that uses the direction indicating operation member as a substitute for the other type of operation member, and transmitting information indicating the content of the received request to the operation device. This program may be provided by being stored on a computer-readable, non-transitory information storage medium.

[0009] 1 is an overall configuration diagram of an information processing system including an operation device according to an embodiment of the present invention; FIG. 2 is a diagram showing an example of the appearance of an operation device according to an embodiment of the present invention; FIG. 3 is a functional block diagram showing functions realized by the information processing system; FIG. 4 is a diagram showing an example of operation data; FIG. 5 is a diagram explaining operation information of a tilt operation member; FIG. 6 is a diagram explaining an example in which a tilt operation member is used as a substitute for one operation button; FIG. 7 is a diagram explaining an example in which a tilt operation member is used as a substitute for multiple function buttons; FIG. 8 is a diagram explaining an example in which a tilt operation member is used as a substitute for multiple directional instruction buttons; FIG. 9 is a diagram explaining an example in which a tilt operation member is used as a substitute for multiple function buttons and directional instruction buttons.

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0011] 1 is a diagram showing the overall configuration of an information processing system 1 including an operation device 20 according to an embodiment of the present invention. As shown in the figure, the information processing system 1 includes an information processing device 10, a display device 14, and the operation device 20.

[0012] The information processing device 10 is, for example, a home game console or a personal computer, and includes a control unit 11, a storage unit 12, and an interface unit 13. The information processing device 10 is also connected to a display device 14 and an operation device 20.

[0013] The control unit 11 includes at least one processor and executes various information processes in accordance with programs stored in the storage unit 12. The storage unit 12 includes at least one memory element and stores the programs executed by the control unit 11 and data to be processed by the programs. Specific examples of the processes executed by the control unit 11 in this embodiment will be described later.

[0014] The interface unit 13 includes a communication interface for transmitting and receiving information between the display device 14 and the operation device 20. The information processing device 10 receives various information such as operation data from the operation device 20 via the interface unit 13, and transmits various control commands to the operation device 20. Note that the information processing device 10 and the operation device 20 may transmit and receive data via wireless communication such as the Bluetooth (registered trademark) standard, or may be connected via a wired communication connection according to a standard such as USB. The interface unit 13 also supplies a video signal including information on the video to be displayed to the display device 14.

[0015] The display device 14 is a home television receiver or the like, and displays an image corresponding to the video signal transmitted from the information processing device 10 .

[0016] The operation device 20 is, for example, a controller for a home game console, and is a device used to receive operation inputs from a user. Fig. 2 shows an example of the appearance of the operation device 20. In this embodiment, the operation device 20 includes a control circuit 21, a plurality of operation buttons 22, a plurality of trigger buttons 25, a plurality of force-feedback mechanisms 26, and a plurality of tilt operation members 27. In this embodiment, the operation buttons 22 include four function buttons 23 and four direction buttons 24.

[0017] The control circuit 21 is configured to include a microcontroller and the like, and executes processing for controlling each part of the operation device 20. Specifically, the control circuit 21 outputs a control signal for operating the force sense presentation mechanism 25 in accordance with a control command received from the information processing device 10. In addition, the control circuit 21 periodically scans the state of each operation member provided on the operation device 20 to identify the operation content performed by the user, and transmits operation data D indicating the operation content to the information processing device 10.

[0018] The operation buttons 22 are operation members that are the target of operation when pressed by the user. The control circuit 21 only determines whether or not the operation buttons 22 are pressed by the user. In other words, the control circuit 21 determines when each operation button 22 is pressed.

[0019] The function buttons 23 are a type of operation button 22 and are used to execute various functions for application programs being executed by the information processing device 10. In this embodiment, the operation device 20 has four function buttons 23: 23A, 23B, 23C, and 23D. The functions assigned to these function buttons 23 may differ for each application program.

[0020] The direction instruction buttons 24 are a type of operation button 22 and are used by the user to indicate a direction. Specifically, the operation device 20 has four direction instruction buttons 24: a right direction instruction button 24A, an up direction instruction button 24B, a left direction instruction button 24C, and a down direction instruction button 24D. When the user presses one of these direction instruction buttons 24, it is considered that the direction corresponding to the pressed direction instruction button 24 has been indicated. Furthermore, when the user presses two adjacent direction instruction buttons 24 simultaneously, it is considered that the direction intermediate between the directions corresponding to the two pressed direction instruction buttons 24 has been indicated. For example, when the user presses the right direction instruction button 24A and the down direction instruction button 24D simultaneously, the application program executed by the information processing device 10 can consider that the user has indicated the downward right direction, and can execute a process corresponding to the indicated direction.

[0021] The trigger button 25 is an operation member that the user presses to operate, similar to the operation button 22. However, unlike the operation button 22, the trigger button 25 is configured to be capable of measuring the amount of depression, which indicates how much the user has depressed the button. Specifically, the trigger button 25 has a movable portion that can move within a certain range and a measuring portion that measures how much the movable portion has moved in response to the user's operation. The control circuit 21 uses the measurement results of the measuring portion to identify the amount of depression caused by the user's operation. By including this value of the amount of depression in the operation data D, the information processing device 10 can perform processing according to the operation content, such as whether the user has slightly depressed the trigger button 25 or deeply depressed it. In this embodiment, the operation device 20 has two trigger buttons 25L and 25R, one on the left and one on the right.

[0022] Furthermore, in this embodiment, a force sense presentation mechanism 26 is connected to each trigger button 25. The force sense presentation mechanism 26 is a device that presents a force sense to the user's body when the user performs an operation to press the trigger button 25. When the user presses the trigger button 25, the force sense presentation mechanism 26 can present a force that resists the operation.

[0023] The tilt operation member 27 is an operation member that can be operated by tilting it in any direction by the user. In this embodiment, the operation device 20 has two tilt operation members 27L and 27R on the left and right. The tilt operation member 27 has a movable portion that protrudes from the surface of the housing of the operation device 20, and the user can tilt it in any direction 360° by pressing the movable portion with the fingers of either hand. This movable portion is biased so that it automatically returns to the center position (neutral position) when the user is not applying force. The control circuit 21 determines in which direction and to what extent the user tilted each tilt operation member 27. Note that how the user's operation content for the tilt operation member 27 is determined will be described in detail later.

[0024] Functions realized by the information processing device 10 and the operation device 20 in this embodiment will be described below with reference to the functional block diagram of FIG. 3 . As shown in FIG. 3 , the information processing device 10 functionally includes an alternative input request accepting unit 51, an alternative input request sending unit 52, and an application executing unit 56. These functions are realized by the control unit 11 executing a program stored in the storage unit 12. The application executing unit 56 is realized by the control unit 11 executing a given application program. The functions of the alternative input request accepting unit 51 and the alternative input request sending unit 52 may be realized by the application program itself that realizes the application executing unit 56, or may be realized by a separate program such as a system program. These programs may be provided to the information processing device 10 via a communication network such as the Internet, or may be provided by being stored on a computer-readable information storage medium such as an optical disc.

[0025] Furthermore, the operation device 20 is functionally configured to include an alternative input request receiving unit 53, an operation data generating unit 54, and an operation data transmitting unit 55. These functions are realized by executing a program stored in the control circuit 21. This program may also be provided to the operation device 20 from the outside, for example, via the information processing device 10.

[0026] The alternative input request receiving unit 51 of the information processing device 10 receives a request to use the alternative input function from a user. Here, the alternative input function refers to a function that substitutes an operation input for a specific operation member arranged on the operation device 20 with another operation member. In particular, in this embodiment, the tilt operation member 27 substitutes an operation input for a type of operation member other than the tilt operation member 27. Hereinafter, the type of operation member to be substituted is referred to as a target operation member, and the operation member used as a substitute for the target operation member (here, the tilt operation member 27) is referred to as an alternative operation member. As will be described in detail later, by using the alternative input function, the user can perform an operation input to the information processing device 10 similar to that performed when operating the target operation member by operating an alternative operation member instead of actually operating the target operation member.

[0027] Specifically, in this embodiment, the user can use the tilt operation member 27 as a substitute for different types of operation buttons 22 or trigger buttons 25. Also, one tilt operation member 27 can be used as a substitute for multiple operation buttons 22 or multiple trigger buttons 25. A method for realizing the alternative input function will be described later.

[0028] The alternative input request sending unit 52 of the information processing device 10 sends information indicating the request content for the alternative input function received by the alternative input request receiving unit 51 (hereinafter referred to as alternative input instruction information) to the operation device 20. The alternative input instruction information includes at least information indicating the correspondence between the target operation members and the alternative operation members. As a specific example, when a user requests to use an alternative input function in which the four function buttons 23 are the target operation members and the tilt operation member 27R is the alternative operation member (i.e., when the four function buttons 23 are assigned to the tilt operation member 27R), alternative input instruction information indicating the correspondence between these target operation members and the alternative operation members is sent to the operation device 20.

[0029] The alternative input request receiving unit 53 of the operation device 20 receives the alternative input instruction information transmitted by the alternative input request transmitting unit 52 of the information processing device 10 and temporarily stores the contents of the information in the memory in the control circuit 11. When the alternative input request receiving unit 53 receives the alternative input instruction information, the operation device 20 thereafter continuously executes processing for realizing the alternative input function as described below. This processing continues until the information processing device 10 issues an instruction to end use of the alternative input function.

[0030] The operation data generation unit 54 of the operation device 20 periodically scans the state of each operation member within the operation device 20 and generates operation data D indicating the user's operation content based on the scanning results. In particular, in this embodiment, when the use of an alternative input function is requested, the operation data generation unit 54 determines operation information indicating the operation content for the target operation member based on the user's operation content for the alternative operation member by referencing previously received alternative input instruction information. As a specific example, if alternative input instruction information specifying four function buttons 23 as the target operation members and the tilt operation member 27R as the alternative operation member is received, the operation data generation unit 54 identifies the user's intended operation with respect to the four function buttons 23 based on the current state of the tilt operation member 27R and generates the identified result as operation information indicating the operation input content for the four function buttons 23. In this case, the operation data generation unit 54 ignores the actual state of the four function buttons 23 that are the target operation members. Therefore, even if some state change occurs due to the user unintentionally touching the target operation member, the content of that change is not reflected in the operation data D. In addition, while the alternative input function is being executed, the operation data generation unit 54 generates operation information indicating that no operation is being performed on the alternative operation member itself (i.e., operation information indicating that the tilt operation member 27 as the alternative operation member is in the neutral position).

[0031] In this embodiment, the operation data D has a data format of a predetermined fixed length, and the content represented by the information stored in that portion is determined by its position within the operation data D. Fig. 4 is a diagram schematically illustrating an example of the operation data D. In the example of this diagram, the operation data D stores, in order from the beginning, a data ID, operation information for the tilt operation member 27L, operation information for the tilt operation member 27R, operation information for the trigger button 25L, operation information for the trigger button 25R, operation information for each operation button 22, and the like.

[0032] The operation information for each tilt operation member 27 is represented by position coordinates on a two-dimensional plane that indicate the position of its movable part. That is, the operation information for each tilt operation member 27 is represented by a pair of X-axis coordinate values ​​indicating the tilt in the left-right direction and Y-axis coordinate values ​​indicating the tilt in the up-down direction. Here, the coordinate values ​​for each of the X-axis and Y-axis take on values ​​ranging from a minimum of 0 to a maximum of 255, with the coordinate values ​​for each axis at the neutral position (point O) being the median value of 128. The operation data generation unit 54 acquires measurement values ​​indicating the tilt of the tilt operation member 27 in each of the left-right and up-down directions, and normalizes the acquired measurement values ​​to values ​​between 0 and 255 to obtain the X-axis and Y-axis coordinate values. This pair of coordinate values ​​is stored in the operation data D as operation information indicating the operation content for the tilt operation member 27.

[0033] 5 is a diagram illustrating operation information of the tilt operation member 27 represented by such coordinate values. Point O in the diagram corresponds to the neutral position, and when the user is not operating the tilt operation member 27, the operation data generation unit 54 acquires the coordinate value of this point O as operation information of the tilt operation member 27. When the user tilts the tilt operation member 27 to the right, the coordinate value on the X axis increases, and when the user tilts the tilt operation member 27 to the left, the coordinate value on the X axis decreases. Furthermore, when the user tilts the tilt operation member 27 upward, the coordinate value on the Y axis increases, and when the user tilts the tilt operation member 27 downward, the coordinate value on the Y axis decreases.

[0034] 5, circle C centered on neutral position O indicates the movable range of the tilt operation member 27, and corresponds to the range within which the tilt operation member 27 is physically restricted so that it cannot be tilted any further. Therefore, although coordinate values ​​on both the X and Y axes can range from 0 to 255, coordinate values ​​corresponding to positions outside circle C in the figure are not actually output. Note that the positions where the coordinate values ​​of each axis take their maximum or minimum values ​​are set slightly inside the circumference of circle C so that the minimum or maximum value is reliably output as the coordinate value for each axis when the tilt operation member 27 is tilted to its maximum in each of the up, down, left, and right directions.

[0035] Point P in FIG. 5 shows an example of operation information for the tilt operation member 27. In this example, the position coordinates (Xp, Yp) of point P are acquired as operation information. At this time, the direction of point P as viewed from point O indicates the direction (operation direction) in which the user tilted the tilt operation member 27, and the distance from point O to point P indicates the magnitude of the tilt amount (operation amount). Hereinafter, the tilt direction of the tilt operation member 27 is represented by an azimuth angle θ, with the positive direction of the X axis being 0 degrees and the counterclockwise direction being the positive direction, and the tilt amount is represented by the distance R from point O. The operation data generation unit 54 can identify the tilt operation performed by the user by calculating the azimuth angle θ and the tilt amount R using coordinate values ​​on the X axis and Y axis.

[0036] The operation information of the trigger buttons 25L and 25R is represented by a numerical value indicating the amount of depression. Here, the operation information of each trigger button 25 is represented by a numerical value ranging from a minimum value of 0 to a maximum value of 255. That is, while a trigger button 25 is not being operated, the operation data generation unit 54 outputs 0 as the operation information of that trigger button 25, and when the trigger button 25 is depressed to the maximum, it outputs 255 as the operation information.

[0037] As described above, among the operation buttons 22, the direction instruction buttons 24 may be operated individually or two adjacent buttons may be pressed simultaneously. Therefore, the operation data generation unit 54 determines which of the eight directions the user is indicating, or whether no direction is being indicated, based on which of the four direction instruction buttons 24 is pressed, and includes operation information (indication direction information) indicating the determination result in the operation data D.

[0038] The operation information of the other operation buttons 22 is represented by a logical value indicating whether or not each operation button 22 has been pressed. For example, the operation data generating unit 54 outputs 0 as the operation information of a certain operation button 22 when the operation button 22 is not pressed, and outputs 1 when the operation button 22 is pressed.

[0039] Here, when the use of the alternative input function is requested, the operation data generation unit 54 determines the operation information of the target operating member in the operation data D according to the operation content of the alternative operating member. As described above, in this embodiment, the tilting operating member 27 is used as the alternative operating member, so the operation data generation unit 54 determines the operation information of the target operating member according to at least one of the operation direction and operation amount of the user with respect to the tilting operating member 27, which is the alternative operating member. For example, the operation data generation unit 54 determines whether or not to include operation information indicating that an operation has been performed on the target operating member in the operation data D according to the operation amount of the user with respect to the alternative operating member. Furthermore, when one alternative operating member is used to substitute for operation inputs for multiple target operating members, operation information indicating that an operation has been performed on one of these multiple target operating members, which is determined according to the operation direction of the user with respect to the alternative operating member, may be included in the operation data D. As an example, when a request is made to use an alternative input function in which the tilt operation member 27R replaces the four function buttons 23, the operation data generation unit 54 determines operation information (X in FIG. 4 ) indicating whether each of these function buttons 23 has been pressed, depending on the operation content (operation direction and operation amount) of the tilt operation member 27R. Note that a specific example of the process in which the operation data generation unit 54 determines the operation information of the target operation member depending on the operation content of the user with respect to the alternative operation member will be described later.

[0040] On the other hand, the operation data generation unit 54 determines the operation information of the alternative operation member to be content indicating that no operation has been performed (here, the X-axis coordinate value is 128 and the Y-axis coordinate value is 128), regardless of the actual operation content. In this way, the operation data generation unit 54 determines the operation information itself of the target operation member in the operation data D according to the operation content of the alternative operation member, so that the generated operation data D can always be data in the same format, regardless of whether an alternative input function is used, or regardless of which alternative operation member is used to perform alternative input for which target operation member.

[0041] The operation data transmission unit 55 periodically transmits the operation data D most recently generated by the operation data generation unit 54 to the information processing device 10. The operation data generation process by the operation data generation unit 54 and the operation data transmission process by the operation data transmission unit 55 are periodically executed, whereby the latest operation content of the user is notified to the information processing device 10. Note that even when the use of the alternative input function is requested, the operation data transmission unit 55 may transmit operation information such as position coordinates acquired for the alternative operation member separately from the operation data D.

[0042] The application execution unit 56 of the information processing device 10 executes an application program and performs various processes, such as game processing, in response to the user's operation. Here, the application execution unit 56 executes processes in response to the user's operation input by referencing the operation data D transmitted by the operation data transmission unit 55. As described above, the data format of the operation data D does not change depending on whether or not the alternative input function is used. Therefore, the application execution unit 56 can simply use the operation data D as data indicating the operation input performed by the user, regardless of whether or not the alternative input function is used, and does not need to change the processing content depending on the use of the alternative input function. In other words, the application program executed by the application execution unit 56 does not need to be a program created to support the alternative input function.

[0043] Hereinafter, several specific examples will be described as to how the operation data generating unit 54 determines the operation information of the target operation member in accordance with the operation content for the alternative operation member.

[0044] First, as a first example, a case will be described in which the tilt operation member 27 is used as a substitute for one operation button 22. In this case, when the user tilts the tilt operation member 27, which is the substitute operation member, by a predetermined threshold tilt amount Rth or more, the operation data generation unit 54 determines that the user has performed an operation to press the operation button 22, which is the target operation member.

[0045] 6 is a diagram illustrating the operation of an alternative operating member for which it is determined that a pressing operation of the target operating member has been performed in this example. Specifically, the shaded area in the figure indicates the position coordinates for which it is determined that a pressing operation of the target operating member has been performed, and the area inside indicates the position coordinates for which it is determined that a pressing operation has not been performed. This shaded area indicates the area where the amount of tilt R is greater than or equal to Rth.

[0046] In this example, the user can tilt the alternative operation member in any direction that is easiest for the user, thereby executing the same operation input on the information processing device 10 as if the target operation member had been pressed down. Furthermore, by performing an operation to return the tilt of the alternative operation member to its original position, the information processing device 10 can recognize that the pressing operation on the target operation member has ended. In particular, when the user releases their hand from the tilt operation member 27, the tilt operation member 27 automatically returns to the neutral position, and at that point the operation data generation unit 54 determines that the pressing operation on the target operation member has ended. This allows the user to tilt the tilt operation member 27 and then release their finger to cause the information processing device 10 to recognize that the pressing operation has ended, just as the user can end the pressing operation by pressing the operation button 22 and then releasing their finger.

[0047] The threshold slope Rth may be a predetermined value. Alternatively, the threshold slope Rth may be a value that can be changed depending on the instruction content received from the user by the alternative input request receiving unit 51 of the information processing device 10. Specifically, for example, when receiving a request to execute an alternative input function from the user, the alternative input request receiving unit 51 also receives a specification regarding the magnitude of the threshold slope Rth, and the operation data generating unit 54 determines the magnitude of the threshold slope Rth depending on the specification received from the user. If the threshold slope Rth is large, the operation button 22 cannot be pressed unless the tilt operation member 27 is tilted significantly, thereby reducing the risk of erroneous input. Conversely, if the threshold slope Rth is small, the operation button 22 can be pressed by simply tilting the tilt operation member 27 lightly, thereby improving operation sensitivity.

[0048] Although only one value is used as the threshold slope Rth here, the value of the threshold slope Rth may be changed when determining that a pressing operation has started and when determining that a pressing operation has ended. In particular, by making the threshold slope Rth for determining that a pressing operation has started larger than the threshold slope Rth for determining that a pressing operation has ended, it becomes more difficult to determine that pressing operations have been performed multiple times in succession, and it is possible to make it less likely that a phenomenon such as chattering will occur.

[0049] Next, as a second example, a case will be described in which one tilt operation member 27 is used as a substitute for multiple operation buttons 22. In this example, the operation data generation unit 54 determines which of the multiple operation buttons 22 has been pressed, depending on the direction in which the user tilts the tilt operation member 27 (operation direction).

[0050] More specifically, the operation data generation unit 54 preliminarily sets a corresponding range of azimuth angle θ (corresponding direction range) for each of the multiple operation buttons 22, which are the target operation members. When the user performs a tilt operation on an alternative operation member, if the azimuth angle θ of the tilt operation falls within any of the corresponding direction ranges, it is determined that the user has operated the operation button 22 associated with the corresponding direction range that includes that azimuth angle θ. At this time, the operation data generation unit 54 refers not only to the azimuth angle θ of the tilt operation but also to the magnitude of the tilt amount R. As in the first example, if the tilt amount R is equal to or greater than the threshold tilt amount Rth, it is determined that the user has pressed the operation button 22 corresponding to the azimuth angle θ at that time. On the other hand, if the tilt amount R is less than the threshold tilt amount Rth, the operation data generation unit 54 determines that none of the target operation members have been operated.

[0051] As a specific example, a case will be described in which the four function buttons 23 are the target operation members and the tilt operation member 27L is the alternative operation member. In this example, tilting the tilt operation member 27L to the right, up, left, and down corresponds to the actual layout of the function buttons 23 on the surface of the operation device 20, and is used as an alternative to the function buttons 23A, 23B, 23C, and 23D, respectively.

[0052] In this case, if all of the 360-degree directions in which tilt operation is possible are assigned to any of the multiple operation buttons 22, there is a risk that an operation near the boundary of the corresponding direction range corresponding to each operation button 22 may be erroneously determined to be an operation for the operation button 22 corresponding to an adjacent corresponding direction range. Therefore, the operation data generation unit 54 may set a buffer range between two adjacent corresponding direction ranges in which no operation button 22 is associated with any of the operation buttons 22, so that the corresponding direction range associated with each of the multiple operation buttons 22 that are target operation members is not directly adjacent to another corresponding direction range. When the azimuth angle of the tilt operation is included in this buffer range, the operation data generation unit 54 determines that the user is not operating any of the target operation members, as in the case where the tilt amount R is less than the threshold tilt amount Rth.

[0053] 7 is a diagram illustrating the relationship between the operation direction of the tilt operation actually performed by the user on the alternative operation member in this example and the operation content for the target operation member identified by the operation data generation unit 54. Table 1 also shows the correspondence relationship between the operation direction range and the target operation member. In the example shown in this figure, a corresponding direction range of 45° is set for each of the four target operation members, and a buffer range of 45° is set between each corresponding direction range.

[0054] Note that even when multiple operation buttons 22 are replaced, the magnitude of the threshold tilt amount Rth may be changeable, just as when a single operation button 22 is replaced. Furthermore, the magnitude of the threshold tilt amount Rth may be set to a different value for each corresponding direction range in response to a user instruction or the like. For example, if a user feels that it is easy to tilt the tilt operation member 27 upward but difficult to tilt it downward, the magnitude of the threshold tilt amount Rth for each corresponding direction range is determined so that the threshold tilt amount Rth for the corresponding direction range set in the upward direction is set to a relatively large value, and the threshold tilt amount Rth for the corresponding direction range set in the downward direction is set to a relatively small value. This makes it possible to perform an operation input with a small tilt operation for the operation button 22 corresponding to the corresponding direction range in the downward direction.

[0055] Furthermore, the size of the buffer range may be a predetermined size, or may be changeable in response to a user instruction, etc. Specifically, for example, when accepting a request from a user to execute an alternative input function, the alternative input request accepting unit 51 also accepts a designation such as whether to make the buffer range wider, narrower, or not to use the buffer range, and the operation data generating unit 54 determines the size of the buffer range in response to the designation accepted from the user.

[0056] Furthermore, the size and position of the corresponding direction ranges corresponding to each operation button 22, as well as the size of the buffer ranges disposed therebetween, may be individually determined in accordance with user instructions, etc. For example, if a user finds it easy to tilt the tilt operation member 27 to the right, the corresponding direction ranges corresponding to each of the multiple operation buttons 22 that are target operation members may be set within the right half of the range (i.e., the range in which the azimuth angle θ satisfies 0≦θ≦90° and 270°≦θ<360°), and the left half of the range (the range in which 90°<θ<270°) may all be set as the buffer range. This allows the user to realize operation inputs for each of the multiple target operation members simply by tilting the tilt operation member 27 to the right.

[0057] The operation data generation unit 54 may also associate a range between two adjacent corresponding direction ranges with the operation of simultaneously pressing these two target operation members. As a specific example, a case will be described in which the tilt operation member 27R is used as a substitute for the four direction instruction buttons 24. When using the direction instruction buttons 24 to indicate a direction, as described above, the user may simultaneously press two adjacent direction instruction buttons 24 to indicate a direction intermediate between the directions corresponding to these two direction instruction buttons 24. Therefore, the operation data generation unit 54 associates the intermediate range between the corresponding direction ranges corresponding to two adjacent direction instruction buttons 24 with the operation of simultaneously pressing these two direction instruction buttons 24. This allows the user to use the alternative operation member to realize not only the operation of pressing one operation button 22, but also the operation of simultaneously pressing two adjacent operation buttons 22.

[0058] 8 is a diagram illustrating the relationship between the actual operation content of the user with respect to the alternative operation member in this example and the operation content of the target operation member identified by the operation data generation unit 54. Table 2 also shows the relationship between the operation direction range and the corresponding operation input content in this example. In this example, instead of the buffer range in FIG. 7 , an intermediate range is set between the corresponding direction ranges corresponding to adjacent directional instruction buttons 24, and when the tilt operation member 27 is tilted into this intermediate range, the operation data generation unit 54 generates operation data D indicating that the two corresponding directional instruction buttons 24 have been pressed simultaneously.

[0059] The operation data generation unit 54 may determine the content of the operation input for the target operation member by taking into account not only the latest position of the tilt operation member 27 but also previously acquired position information. For example, in the example shown in FIG. 8 , if the user operates the tilt operation member 27 rightward and then leftward by a certain amount, it may be assumed that the user intends to perform an operation input indicating a leftward direction, even if the tilt operation is not performed until the tilt amount R becomes equal to or greater than the threshold tilt amount Rth. Therefore, the operation data generation unit 54 may calculate the movement speed of the position coordinates by referring to the time-series data of the position coordinates of the tilt operation member 27, and determine that the direction instruction button 24 corresponding to that direction has been pressed if the tilt operation member 27 moves in a predetermined direction at a movement speed equal to or greater than a given threshold. Alternatively, if the movement direction of the tilt operation member 27 changes and the amount of movement from the changed position as a starting point becomes equal to or greater than a predetermined value, it may determine that the direction instruction button 24 corresponding to the corresponding direction range including the azimuth angle θ of the movement direction from the changed position as a starting point has been pressed.

[0060] Next, a third example will be described. Like the second example, this third example is also an example in which one tilt operation member 27 is used in place of multiple operation buttons 22. However, in this third example, the operation data generation unit 54 determines which operation button 22 is to be regarded as having been operated based on both the direction of the tilt operation (operation direction) and the tilt amount R (operation amount).

[0061] Specifically, in this third example, the corresponding ranges corresponding to each of the multiple operation buttons 22 are determined not only with respect to the azimuth angle θ indicating the operation direction by the user, but also based on both the azimuth angle θ and the tilt amount R indicating the operation amount. When the operation data generation unit 54 determines that both the azimuth angle θ indicating the operation direction and the tilt amount R indicating the operation amount are included in the corresponding ranges corresponding to a certain operation button 22, it generates operation data D indicating that the operation button 22 has been pressed.

[0062] 9 is a diagram showing an example of the correspondence between the operation contents of the alternative operation members and the target operation members in this example 3. In this example, a total of eight operation buttons 22, including four function buttons 23A, 23B, 23C, and 23D and four direction buttons 24A, 24B, 24C, and 24D, are set as the operation target members, and the operation data generation unit 54 determines which of these eight operation target members is to be regarded as having been operated based on the position of one tilt operation member 27.

[0063] In the example of Figure 9, for example, function button 23B and up button 24B are associated with the same numerical range for azimuth angle θ, 45°≦θ<135°. However, function button 23B is associated with a different numerical range for tilt amount R, Rth0≦R≦Rth1, while up button 24B is associated with a different numerical range, R≧Rth2. Here, Rth0, Rth1, and Rth2 are each given threshold tilt amounts, where Rth0<Rth1<Rth2. As a result, even if the user tilts tilt operation member 27 upward, if the magnitude of tilt amount R is Rth0 or more and Rth1 or less, function button 23B is considered to have been operated, and if the magnitude of tilt amount R is Rth2 or more, up button 24B is considered to have been operated. For other directions, different operation buttons 22 are similarly considered to have been operated depending on the magnitude of the tilt amount.

[0064] In this example, the numerical range in which the tilt amount R is greater than the threshold value Rth1 and smaller than the threshold value Rth2 is set as a buffer range, as in the second example, and when the tilt amount R falls within this numerical range, it is determined that none of the operation buttons 22 has been operated. Also, although not shown in the figure, in this third example, as in the example of Fig. 7 , a buffer range for the azimuth angle θ, in which it is determined that none of the operation buttons 22 has been operated, may be provided between adjacent corresponding ranges along the circumferential direction. Furthermore, as in the example of Fig. 8 , an intermediate range, in which it is determined that these operation buttons 22 have been operated simultaneously, may be provided between two corresponding ranges associated with different operation buttons 22.

[0065] In this example, if the user wishes to operate the up direction button 24B, the user will tilt the tilt operation member 27 upward from the home position, and during this operation, the tilt operation member will necessarily pass through the range corresponding to the function button 23B. At this time, it is undesirable for the function button 23B to be momentarily determined to have been operated, which is contrary to the user's intention.

[0066] Therefore, when the rate of change in the position of the tilt operation member 27 (i.e., the amount of movement per unit time of the movable part of the tilt operation member 27) becomes equal to or less than a predetermined threshold, the operation data generation unit 54 may determine the target operation member to be operated by the user based on the position of the tilt operation member 27 at that time. In this case, the operation data generation unit 54 determines that none of the operation buttons 22 are operated while the user is quickly operating the tilt operation member 27, and determines that the target operation member corresponding to the area including that position has been operated when the user stops the tilt operation member 27 at any position. Furthermore, regardless of the position to which the user moves the tilt operation member 27, the tilt operation member 27 returns to the home position when the user releases their hand. In this case, the operation data generation unit 54 ignores the corresponding range through which the tilt operation member 27 passes when returning to the home position. Note that the criterion for determining that a specific target operation member has been operated when the rate of change becomes equal to or less than a predetermined threshold described here may also be applied to the first and second examples described above.

[0067] Also in this third example, similarly to the second example, the various thresholds used by the operation data generation unit 54 for determination and the position and size of the corresponding ranges corresponding to each operation button 22 may be changeable in response to a user instruction, etc. Also, the threshold value for the change speed may be different for each corresponding range. For example, the threshold value for the change speed for determining that the operation button 22 corresponding to the corresponding range has been operated may be different for the inner corresponding range corresponding to the function button 23 and the outer corresponding range corresponding to the direction instruction button 24.

[0068] Next, as a fourth example, a case will be described in which the tilt operation member 27 is used as a substitute for the trigger button 25. In this example, the operation data generation unit 54 determines how much the trigger button 25 is pressed, depending on the tilt amount R when the user tilts the tilt operation member 27.

[0069] As an example, the operation data generation unit 54 may calculate the depression amount of the trigger button 25 by multiplying the value of the tilt amount R by a given coefficient. In this case, the coefficient is determined so that the maximum value of the tilt amount R matches the maximum depression amount. This allows the user to realize an operation input to the trigger button 25 by tilting the tilt operation member 27 in any direction.

[0070] Here, the relationship between the tilt amount R of the alternative operation member and the depression amount of the target operation member is not limited to a proportional relationship, but may also be a nonlinear relationship. For example, if the trigger button 25 has play and the depression amount is recognized as zero (i.e., no operational input is made to the trigger button 25) from the moment the movable part begins to be pressed until it is moved a certain amount, similarly, when using the alternative input function, the depression amount may be set to zero until the tilt amount R of the alternative operation member exceeds a predetermined value. Furthermore, the depression amount of the target operation member may be calculated using different coefficients for each numerical range of the tilt amount R, so as to realize a change such that the depression amount does not increase much while the tilt amount R is small and then increases rapidly when the tilt amount R becomes large to a certain extent. Furthermore, the depression amount may be calculated from the tilt amount R using a higher-order function such as a quadratic function. In either case, the operation data generation unit 54 calculates the depression amount so that the depression amount is minimum (0 in this case) when the tilt amount R is zero and maximum (255 in this case) when the tilt amount R is maximum. This allows the user to achieve operation input to the trigger button 25 in a range from the minimum value to the maximum value by adjusting the tilt amount R of the alternative operation member.

[0071] The operation data generation unit 54 may determine the value of the push-in amount based on time-series data acquired in the past, in addition to the latest value of the tilt amount R. For example, the operation data generation unit 54 may perform a predetermined digital filter process on time-series data of the tilt amount R acquired in the past, in order to perform noise removal that ignores minute fluctuations in the tilt amount R, and calculate the push-in amount using the value of the tilt amount R after the digital filter process has been applied.

[0072] Furthermore, in the description so far, one alternative operation member is used as an alternative to one trigger button 25, but one alternative operation member may be used as an alternative to multiple trigger buttons 25. In this case, as in the second example, a corresponding directional range of the azimuth angle θ is associated with each of the multiple trigger buttons 25. As an example, if the corresponding directional range in the right direction is associated with trigger button 25R and the corresponding directional range in the left direction is associated with trigger button 25L, the user can realize an operation input for trigger button 25R by tilting the alternative operation member rightward, and can realize an operation input for trigger button 25L by tilting the alternative operation member leftward.

[0073] As described above, in this embodiment, the force sense presentation mechanism 26 is connected to the trigger button 25, and a force sense is presented to the user operating the trigger button 25. However, when the tilt operation member 27 is substituted for the operation of the trigger button 25, the user does not actually operate the trigger button 25, and therefore, no force sense can be presented to the user even if the force sense presentation mechanism 26 is operated. Therefore, when a request is made to execute an alternative input function in which the operation member that is the target of force sense presentation (here, the trigger button 25) is used as the target operation member, the control circuit 21 may ignore the instruction to present a force sense to that target operation member and not control the force sense presentation mechanism 26.

[0074] As described above, according to the operating device 20 of this embodiment, the tilt operating member 27 can be used as an alternative operating member to realize operation input to the operation button 22 or the trigger button 25, allowing the user to realize operation input to the information processing device 10 more freely and in a manner that is most convenient for the user.

[0075] It should be noted that the embodiments of the present invention are not limited to those described above. For example, in the above description, the operation device 20 is a controller for a home game console, but is not limited thereto and may be any type of device that accepts user operations. Furthermore, the types, numbers, positions, etc. of operation members that the operation device 20 is provided with in the above description are merely examples, and the operation device 20 may be provided with any number of various operation members as long as it has at least one operation member that can be used as an alternative operation member.

[0076] Furthermore, in the above explanation, examples have been given of the case where the alternative operating member is used as a substitute for one operating button 22, a case where it is used as a substitute for four operating buttons 22, and a case where it is used as a substitute for eight operating buttons 22, but this is not limited to this and one alternative operating member may be used as a substitute for any number of operating buttons 22.

[0077] Furthermore, in the above description, the force sense presentation mechanism 26 presents a force sense to the user when the user operates the trigger button 25, but it may also present a force sense to the user when an operation is performed on the operation button 22. In this case as well, while the alternative input function is being used, the control of the force sense presentation mechanism 26 that presents a force sense to the target operation member that has been designated as the target may be suspended.

[0078] In the above description, the tilt operation member 27 is used as an alternative operation member. However, a direction indicating operation member, which indicates a direction by a user pressing a movable part in a desired direction, can also be used as an alternative operation member. As a specific example, a slide operation member is known that indicates a desired direction by sliding a movable part parallel to the main body of the operation device 20, rather than tilting the movable part. Such a slide operation member can also be used to perform an alternative input for the operation button 22 or the trigger button 25, using information on the operation direction and amount of the slide operation member, in the manner described above.

[0079] In the above description, the request to use the alternative input function is made by an operation input to the information processing device 10, but this is not limiting and the request may be made directly to the operation device 20 by, for example, operating a switch provided on the operation device 20. In this case, the user can operate the switch in advance to request the operation device 20 to use the alternative input function associated with that switch. In this case, the application execution unit 56 of the information processing device 10 can execute processing according to the transmitted operation data D regardless of whether the operation device 20 is executing the alternative input function.

[0080] Furthermore, in the above description, the operation device 20 is directly connected to the information processing device 10, but this is not limiting and the operation device 20 may be connected to the information processing device 10 via a communication network or the like. For example, in a cloud-based service, the operation device 20 may be directly connected to a relay device, and a server device connected to the relay device via a communication network such as the Internet may function as the information processing device 10 according to the embodiment of the present invention. In this case, the relay device receives operation data D indicating the content of a user's operation on the operation device 20 from the operation device 20 and transmits it to the information processing device 10. Even in this case, the information processing device 10 can execute the processing of an application program by referring to the operation data D received from the relay device, as in the above-described embodiment.

[0081] Furthermore, the functions described above as being realized by the information processing device 10 may be realized by a plurality of computers. As an example, the functions of the alternative input request accepting unit 51 and the alternative input request sending unit 52 may be realized by a client device directly connected to the operation device 20, and the function of the application executing unit 56 may be realized by a server device connected to the client device via a communication network.

[0082] 1 Information processing system, 10 Information processing device, 11 Control unit, 12 Memory unit, 13 Interface unit, 20 Operation device, 21 Control circuit, 22 Operation button, 23 Function button, 24 Direction instruction button, 25 Trigger button, 26 Force feedback mechanism, 27 Tilt operation member, 51 Alternative input request acceptance unit, 52 Alternative input request transmission unit, 53 Alternative input request reception unit, 54 Operation data generation unit, 55 Operation data transmission unit, 56 Application execution unit.

Claims

1. An operation device connected to an information processing device, A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; an operation data generating unit that generates operation data including operation information indicating operations performed on the direction indicating operation member and the different type of operation member; an operation data transmission unit that transmits the operation data to the information processing device; Including, When a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, the operation data generation unit determines operation information indicating an operation content for the other type of operation member included in the operation data according to an operation content of the user for the direction indicating operation member. An operating device, the operation data generation unit generates the operation data including operation information indicating that the user has not performed an operation on the direction indicating operation member when utilization of the alternative input function is requested. An operating device characterized by:

2. An operation device connected to an information processing device, A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; an operation data generating unit that generates operation data including operation information indicating operations performed on the direction indicating operation member and the different type of operation member; an operation data transmission unit that transmits the operation data to the information processing device; Including, When a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, the operation data generation unit determines operation information indicating an operation content for the other type of operation member included in the operation data according to an operation content of the user for the direction indicating operation member. An operating device, a force feedback mechanism that provides a force feedback to a user who operates the different type of operation member in response to an instruction from the information processing device; a control unit that, when a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, limits control of the force sense presentation by the force sense presentation mechanism for the other type of operation member; Further comprising: An operating device characterized by:

3. An operation device connected to an information processing device, A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; an operation data generating unit that generates operation data including operation information indicating operations performed on the direction indicating operation member and the different type of operation member; an operation data transmission unit that transmits the operation data to the information processing device; Including, When a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, the operation data generation unit determines operation information indicating an operation content for the other type of operation member included in the operation data according to an operation content of the user for the direction indicating operation member. An operating device, the operation device includes, as the different type of operation member, a plurality of operation buttons that are pressed and operated by the user, the operation data generation unit preliminarily sets a corresponding range of the operation direction of the direction indicating operation member corresponding to each of the plurality of operation buttons, and when the operation direction of the user with respect to the direction indicating operation member is included in the corresponding range, includes in the operation data operation information indicating that the operation button corresponding to the corresponding range has been pressed, and when the user has operated the direction indicating operation member at a moving speed equal to or higher than a given threshold, selects a target operation member for which operation information indicating that the operation has been performed is to be included in the operation data based on the operation direction. An operating device characterized by:

4. An operation device connected to an information processing device, A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; an operation data generating unit that generates operation data including operation information indicating operations performed on the direction indicating operation member and the different type of operation member; an operation data transmission unit that transmits the operation data to the information processing device; Including, When a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, the operation data generation unit determines operation information indicating an operation content for the other type of operation member included in the operation data according to an operation content of the user for the direction indicating operation member. An operating device, the operation device includes, as the different type of operation member, a plurality of operation buttons that are pressed and operated by the user, the operation data generation unit preliminarily sets a corresponding range of the operation direction of the direction indicating operation member corresponding to each of the plurality of operation buttons, and when the operation direction of the user with respect to the direction indicating operation member is included in the corresponding range, includes in the operation data operation information indicating that the operation button corresponding to the corresponding range has been pressed, and when the position of the direction indicating operation member has changed by an amount of movement equal to or greater than a given threshold value, starting from a position where the movement direction of the direction indicating operation member has changed, selects a target operation member for which operation information indicating that an operation has been performed is to be included in the operation data based on the movement direction from the starting point. An operating device characterized by:

5. An operation device connected to an information processing device, A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; an operation data generating unit that generates operation data including operation information indicating operations performed on the direction indicating operation member and the different type of operation member; an operation data transmission unit that transmits the operation data to the information processing device; Including, When a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, the operation data generation unit determines operation information indicating an operation content for the other type of operation member included in the operation data according to an operation content of the user for the direction indicating operation member. An operating device, the operation device includes, as the different type of operation member, a plurality of operation buttons that are pressed and operated by the user, the operation data generation unit preliminarily sets a corresponding range that corresponds to each of the plurality of operation buttons and is determined based on both an operation direction and an operation amount of the direction indicating operation member, and when the operation direction and the operation amount of the user with respect to the direction indicating operation member are included in the corresponding range, the operation data includes operation information indicating that an operation button corresponding to the corresponding range has been pressed. An operating device characterized by:

6. In the operating device according to claim 5, The operation data generation unit selects a target operating member, the operation information indicating that an operation has been performed being included in the operation data, based on a direction and amount of operation by the user in a state in which a rate of change in the position of the direction indicating member becomes equal to or less than a predetermined value. An operating device characterized by:

7. 6. The operating device according to claim 1, The operation data generation unit determines, in accordance with an amount of operation of the direction indicating operation member by the user, whether or not to include in the operation data operation information indicating that an operation has been performed on the different type of operation member. An operating device characterized by:

8. 8. The operating device according to claim 7, the operation device includes, as the different type of operation member, an operation button that is pressed and operated by the user, The operation data generating unit includes, in the operation data, operation information indicating that the operation button has been pressed, when an amount of operation of the direction indicating operation member by the user is equal to or greater than a given threshold value. An operating device characterized by:

9. 9. The operating device according to claim 8, The given threshold value is a value that can be changed according to an instruction from the user. An operating device characterized by:

10. The operating device according to any one of claims 3 to 5, At least one of the position and the size of a corresponding range of the operation direction corresponding to each of the plurality of operation buttons is determined in response to an instruction from the user. An operating device characterized by:

11. The operating device according to any one of claims 3 to 5, The operation data generation unit sets a buffer range between two adjacent corresponding ranges that does not correspond to any of the operation buttons, and when the operation direction of the user with respect to the direction indicating operation member is included in the buffer range, includes operation information indicating that none of the plurality of operation buttons is pressed in the operation data. An operating device characterized by:

12. The operating device according to any one of claims 3 to 5, The operation data generation unit sets an intermediate range between two adjacent corresponding ranges, and when the operation direction of the user with respect to the direction indicating operation member is included in the intermediate range, includes in the operation data operation information indicating that two operation buttons corresponding to the two corresponding ranges are pressed simultaneously. An operating device characterized by:

13. 6. The operating device according to claim 1, the operation device includes, as the different type of operation member, a trigger button capable of measuring an amount of depression when a depression operation is performed by the user, The operation data generation unit calculates a pressing amount of the trigger button in accordance with an operation amount of the direction indicating operation member by the user, and generates the operation data including the calculated pressing amount value as an operation content of the trigger button. An operating device characterized by:

14. A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; An information processing device connected to an operation device comprising: a reception unit that receives, from the user, a request for use of an alternative input function in which the direction indicating operation member is substituted for the other type of operation member; a transmission unit that transmits information indicating the content of the received usage request to the operation device; a receiving unit that receives from the operation device operation data including operation information indicating operation contents for the direction indicating operation member and the other type of operation member, and when a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, the operation data including operation information determined according to the operation contents of the user for the direction indicating operation member; Including, The operation data received by the receiving unit includes operation information indicating that the user has not performed an operation on the direction indicating operation member when the use of the alternative input function is requested. Or, the information processing device further includes an instruction unit that instructs a force sense presentation mechanism of the operation device to present a force sense to a user operating the different type of operation member; When a user requests the use of an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, control of the force sense presentation by the force sense presentation mechanism for the other type of operation member is limited. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons to be pressed and operated by the user, and a corresponding range of an operation direction of the direction indicating operation member is set in advance in correspondence with each of the plurality of operation buttons; The operation data received by the receiving unit includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the user's operation direction with respect to the direction indicating operation member is included in the corresponding range, and includes operation information indicating that an operation with respect to a target operation member selected based on the operation direction has been performed when the user's operation with respect to the direction indicating operation member is performed at a moving speed equal to or higher than a given threshold value. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons to be pressed and operated by the user, and a corresponding range of an operation direction of the direction indicating operation member is set in advance in correspondence with each of the plurality of operation buttons; The operation data received by the receiving unit includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the operation direction of the user with respect to the direction indicating operation member is included in the corresponding range, and includes operation information indicating that an operation has been performed on a target operation member selected based on the movement direction from a starting point when the position of the direction indicating operation member has changed by an amount of movement equal to or greater than a given threshold value, starting from a position where the movement direction of the direction indicating operation member has changed. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons that are pressed and operated by the user, and a corresponding range is previously set for each of the plurality of operation buttons, the corresponding range being determined based on both an operation direction and an operation amount of the direction indication operation member; When the operation direction and the operation amount of the direction indicating operation member by the user are within the corresponding range, the operation data received by the receiving unit includes operation information indicating that an operation button corresponding to the corresponding range has been pressed.

23. An information processing apparatus comprising:

15. A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; A computer connected to an operation device comprising: receiving, from the user, a request for use of an alternative input function in which the direction indicating operation member is substituted for the other type of operation member; transmitting information indicating the content of the received usage request to the operation device; a receiving step of receiving from the operation device operation data including operation information indicating operation contents for the direction indicating operation member and the other type of operation member, the operation data including operation information determined according to operation contents of the user for the direction indicating operation member as the operation information indicating the operation contents for the other type of operation member when a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member; An information processing method for executing The operation data received in the receiving step includes operation information indicating that the user has not performed an operation on the direction indicating operation member when the use of the alternative input function is requested. Or, the information processing device further includes an instruction unit that instructs a force sense presentation mechanism of the operation device to present a force sense to a user operating the different type of operation member; When a user requests the use of an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, control of the force sense presentation by the force sense presentation mechanism for the other type of operation member is limited. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons to be pressed and operated by the user, and a corresponding range of an operation direction of the direction indicating operation member is set in advance in correspondence with each of the plurality of operation buttons; The operation data received in the receiving step includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the user's operation direction with respect to the direction indicating operation member is included in the corresponding range, and includes operation information indicating that an operation with respect to a target operation member selected based on the operation direction has been performed when the user's operation with respect to the direction indicating operation member is performed at a moving speed equal to or higher than a given threshold value. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons to be pressed and operated by the user, and a corresponding range of an operation direction of the direction indicating operation member is set in advance in correspondence with each of the plurality of operation buttons; The operation data received in the receiving step includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the operation direction of the user with respect to the direction indicating operation member is included in the corresponding range, and includes operation information indicating that an operation has been performed on a target operation member selected based on the movement direction from a starting point when the position of the direction indicating operation member has changed by an amount of movement equal to or greater than a given threshold value, starting from a position where the movement direction of the direction indicating operation member has changed. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons that are pressed and operated by the user, and a corresponding range is previously set for each of the plurality of operation buttons, the corresponding range being determined based on both an operation direction and an operation amount of the direction indication operation member; The operation data received in the receiving step includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the operation direction and the operation amount of the direction indicating operation member by the user are within the corresponding range.

23. An information processing method comprising:

16. A direction indicating operation member that is operated by being pushed in any direction by a user; an operating member of a different type from the direction indicating operating member; A computer connected to an operation device comprising: receiving, from the user, a request for use of an alternative input function in which the direction indicating operation member is substituted for the other type of operation member; transmitting information indicating the content of the received usage request to the operation device; a receiving step of receiving from the operation device operation data including operation information indicating operation contents for the direction indicating operation member and the other type of operation member, the operation data including operation information determined according to operation contents of the user for the direction indicating operation member as the operation information indicating the operation contents for the other type of operation member when a request is made to use an alternative input function in which the direction indicating operation member is substituted for the other type of operation member; A program for executing The operation data received in the receiving step includes operation information indicating that the user has not performed an operation on the direction indicating operation member when the use of the alternative input function is requested. Or, the information processing device further includes an instruction unit that instructs a force sense presentation mechanism of the operation device to present a force sense to a user operating the different type of operation member; When a user requests the use of an alternative input function in which the direction indicating operation member is substituted for the other type of operation member, control of the force sense presentation by the force sense presentation mechanism for the other type of operation member is limited. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons to be pressed and operated by the user, and a corresponding range of an operation direction of the direction indicating operation member is set in advance in correspondence with each of the plurality of operation buttons; The operation data received in the receiving step includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the user's operation direction with respect to the direction indicating operation member is included in the corresponding range, and includes operation information indicating that an operation with respect to a target operation member selected based on the operation direction has been performed when the user's operation with respect to the direction indicating operation member is performed at a moving speed equal to or higher than a given threshold value. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons to be pressed and operated by the user, and a corresponding range of an operation direction of the direction indicating operation member is set in advance in correspondence with each of the plurality of operation buttons; The operation data received in the receiving step includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the operation direction of the user with respect to the direction indicating operation member is included in the corresponding range, and includes operation information indicating that an operation has been performed on a target operation member selected based on the movement direction from a starting point when the position of the direction indicating operation member has changed by an amount of movement equal to or greater than a given threshold value, starting from a position where the movement direction of the direction indicating operation member has changed. Or, the operation device includes, as the different type of operation member, a plurality of operation buttons that are pressed and operated by the user, and a corresponding range is previously set for each of the plurality of operation buttons, the corresponding range being determined based on both an operation direction and an operation amount of the direction indication operation member; The operation data received in the receiving step includes operation information indicating that an operation button corresponding to the corresponding range has been pressed when the operation direction and the operation amount of the direction indicating operation member by the user are within the corresponding range. program.