Operation device, information processing system, information processing method, and program

Abstract

This operation device includes a plurality of mutually separated and independent modules, the plurality of modules each being connected to information processing devices. At least some of the plurality of modules include an operation member for accepting operation input from a user. Each of the plurality of modules includes at least one flat linking section provided with a linking mechanism for linking to other modules. A plurality of light-emitting units are arranged along the outer periphery of the flat linking sections. When any of the plurality of modules is to be linked, in response to an instruction from the information processing device, each of the two modules to be linked lights up at least some of the plurality of light-emitting units arranged on the flat linking sections to be linked.

Description

Operation device, information processing system, information processing method, and program

[0001] The present invention relates to an operation device that accepts operation input from a user, and an information processing system, an information processing method, and a program that utilizes the operation input accepted by the operation device.

[0002] 2. Description of the Related Art For example, an information processing device that executes a game program or the like is provided with an operation device that includes operation members such as buttons and analog sticks so that the information processing device can receive various operation inputs from a user.

[0003] Typically, the size and shape of an operating device, as well as the type, number, and arrangement of operating members provided on the operating device, are fixed. As a result, some people may find the arrangement of operating members difficult to use because it does not suit their preferences. Furthermore, the number and type of operating members required for inputting operations vary depending on the content of the program executed by the information processing device, and it may be difficult to meet the needs of such diverse programs with a limited number of operating devices.

[0004] Therefore, it is conceivable to increase the degree of freedom in the configuration of an operating device by providing an operating device that allows for any combination of multiple modules. However, when allowing a user to combine such modules, it may be difficult to allow the user to combine modules in a way that is in line with the intention of the program executed by the information processing device.

[0005] The present invention has been made in consideration of the above-mentioned circumstances, and one of its objectives is to provide an operating device that has a high degree of freedom in configuration and that allows the user to easily change such configuration, as well as an information processing system, an information processing method, and a program that utilizes the operation input received by the operating device.

[0006] An operating device according to one aspect of the present invention includes a plurality of modules that are separate and independent from one another, each of which is connected to an information processing device, wherein at least some of the plurality of modules include an operating member for receiving operation input from a user, each of the plurality of modules includes at least one connecting plane portion equipped with a connecting mechanism for connecting to other modules, and each of the plurality of modules includes a plurality of light-emitting units arranged along the outer periphery of the connecting plane portion, and when one of the plurality of modules is to be connected, each of the two modules to be connected illuminates at least some of the light-emitting units arranged on the connecting plane portion to be connected in response to an instruction from the information processing device.

[0007] An information processing system according to one aspect of the present invention is an information processing system including an operating device including a plurality of modules that are separate and independent from each other, and an information processing device connected to the operating device, wherein at least some of the plurality of modules include operating members for receiving operation input from a user, and each of the plurality of modules includes at least one connecting plane portion equipped with a connecting mechanism for connecting to other modules, and when any of the plurality of modules is to be connected, the information processing device transmits to each of the modules to be connected an instruction to illuminate at least some of the light-emitting elements among the plurality of light-emitting elements arranged on the connecting plane portion to be connected.

[0008] An information processing method according to one aspect of the present invention is an information processing method executed by an information processing device connected to an operation device that includes a plurality of modules that are separate and independent from each other, at least some of the plurality of modules including an operating member for receiving operation input from a user, and each of the plurality of modules including at least one connecting flat surface having a connecting mechanism for connecting to other modules, the information processing method including the steps of: determining that any of the plurality of modules should be connected; and transmitting, to each of the modules to be connected based on the determination, an instruction to illuminate at least some of the plurality of light-emitting elements arranged on the connecting flat surface to be connected.

[0009] According to one aspect of the present invention, there is provided a program for controlling an information processing device connected to an operation device including a plurality of modules that are separate and independent from one another, at least some of the plurality of modules including an operating member for receiving operation input from a user, and each of the plurality of modules including at least one connecting flat surface having a connecting mechanism for connecting to other modules, the program causing the information processing device to execute the steps of: determining that any of the plurality of modules should be connected; and transmitting, to each of the modules to be connected based on the determination, an instruction to cause at least some of the plurality of light-emitting units arranged on the connecting flat surface to emit light. The program may be provided by being stored on a computer-readable, non-transitory information storage medium.

[0010] FIG. 1 is a diagram illustrating an overall overview of an information processing system according to an embodiment of the present invention. FIG. 1 is a diagram illustrating an example of a plurality of modules included in an operation device. FIG. 2 is a diagram illustrating an example of a configuration of an operation module. FIG. 3 is a diagram illustrating an example of an operation device in a state in which a plurality of modules are combined. FIG. 4 is a diagram illustrating an example of light emission control when guiding a connection mode between modules. FIG. 5 is a diagram illustrating another example of light emission control when guiding a connection mode between modules. FIG. 6 is a diagram illustrating yet another example of light emission control when guiding a connection mode between modules. FIG. 7 is a diagram illustrating an example of a mechanism for identifying the connection orientation between modules. FIG. 8 is a diagram illustrating an example of light emission control when guiding a connection mode between modules in a stepwise manner. FIG. 9 is a diagram illustrating a state in which another module is connected to a module equipped with a rotating member. FIG. 10 is a functional block diagram illustrating functions implemented by an information processing device.

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0012] 1 shows an overview of an information processing system 1 according to an embodiment of the present invention. The information processing system 1 includes an operation device 10 that accepts operation inputs from a user, and an information processing device 100 that operates in response to the operation inputs from the user accepted by the operation device 10.

[0013] The operating device 10 according to this embodiment is configured to include a plurality of modules 20. These modules 20 are separate and independent from each other, and can be connected to each other for use.

[0014] Of the multiple modules 20 that make up the operation device 10, at least some of the modules 20 are equipped with operation members for receiving operation input from the user. Hereinafter, a module 20 equipped with an operation member will be referred to as an operation module. The operation device 10 may also include a module 20 that does not have an operation member. Hereinafter, a module 20 that does not have an operation member will be referred to as a special module.

[0015] 2 shows a specific example of the types of multiple modules 20 included in the operation device 10. In the example shown in this figure, the operation device 10 includes seven types of modules 20: modules 20a, 20b, 20c, 20d, 20e, 20f, and 20g. Of these, five types of modules 20, modules 20a-20d and 20g, are operation modules, and modules 20e and 20f are special modules. Note that the operation device 10 may include multiple modules 20 of the same type.

[0016] Each of the multiple modules 20 has a substantially identical overall shape. Specifically, the main body 21 of each module 20 has a substantially cubic shape, and its outer surface is composed of six substantially square-shaped flat surfaces. Hereinafter, the six flat surfaces constituting the outer surface of the main body 21 will be referred to as the top surface 21a, front surface 21b, right side surface 21c, left side surface 21d, back surface 21e, and bottom surface 21f. The horizontal direction of the module 20a is the x-axis, the depth direction (front-to-back direction) is the y-axis, and the vertical direction (up-down direction) is the z-axis. The right direction as viewed from the front of the main body 21 is the x-axis positive direction, the direction from front to back is the y-axis positive direction, and the direction toward the top is the z-axis positive direction. The top surface 21a faces the positive side of the z-axis, the front surface 21b faces the negative side of the y-axis, the right side surface 21c faces the positive side of the x-axis, the left side surface 21d faces the negative side of the x-axis, the back surface 21e faces the positive side of the y-axis, and the bottom surface 21f faces the negative side of the z-axis.

[0017] Of the multiple modules 20, modules 20a-20d, which are operation modules, include a main body 21 and an operation member 22. As shown in FIG. 2, module 20a includes four buttons as the operation member 22. Module 20b includes four buttons with different shapes from those of module 20a as the operation member 22. Module 20c includes a trigger button as the operation member 22. Note that these buttons and trigger buttons may be buttons that can measure the amount of depression by the user. Module 20d includes a tilt operation member as the operation member 22 that the user tilts to operate.

[0018] The special module does not have the operation member 22, but has members used for specific purposes. The unique functions of the special module will be described later.

[0019] The configuration and function of each module 20 included in the operation device 10 will be described below, using module 20a as an example. While the configuration will be described here using module 20a as the subject, other operation modules may have a similar configuration except that they have different types of operation members 22. Special modules may also have a similar configuration except that they do not have operation members 22 but instead have members used for specific purposes.

[0020] 3, the module 20a includes a main body 21 and an operation member 22. The main body 21 incorporates a control unit 31, a communication unit 32, and an attitude sensor 33.

[0021] As described above, the main body 21 has a substantially cubic shape, and the operating member 22 is disposed on one of the six flat surfaces that form the outer surface of the main body 21. In this embodiment, the operating member 22 is disposed on the top surface 21 a.

[0022] The control unit 31 includes at least one processor and controls each unit of the module 20a. The communication unit 32 is a wireless communication interface and transmits and receives information to and from the information processing device 100. In particular, in this embodiment, the control unit 31 periodically scans the user's operations on the operation members 22 and transmits operation signals indicating the results to the information processing device 100 via the communication unit 32. In addition, in accordance with control commands received from the information processing device 100 via the communication unit 32, the control unit 31 performs control such as emitting light from a light-emitting unit 35 (described later).

[0023] The attitude sensor 33 detects the current attitude and / or attitude changes of the main body 21. The attitude sensor 33 may include, for example, an acceleration sensor or a gyro sensor. Alternatively, the attitude sensor 33 may be an inertial measurement unit (IMU) incorporating these sensors. The control unit 31 periodically transmits the detection result of the attitude sensor 33 to the information processing device 100 together with an operation signal indicating the operation content of the operation member 22.

[0024] Furthermore, of the six flat surfaces that make up the outer surface of the main body 21, at least a portion of the surface on which the operating member 22 is not disposed functions as a connecting flat surface. In this embodiment, four flat surfaces, excluding the top surface 21a and the bottom surface 21f, each function independently as a connecting flat surface. That is, a connecting mechanism 34 is disposed on each of the front surface 21b, right side surface 21c, left side surface 21d, and back surface 21e, thereby connecting the module 20a to a maximum of four other modules 20.

[0025] The coupling mechanism 34 is a mechanism for coupling the coupling plane of one module 20 to the coupling plane of another module 20. This coupling mechanism 34 couples the two modules 20 to each other, allowing them to be used in an integrated state. In this embodiment, the coupling mechanism 34 is configured to be able to couple to any coupling plane of any module 20, regardless of type. For example, if each coupling plane is provided with either a plug or a receptacle, and the plug is inserted into the mating receptacle to couple the coupling planes, it would be impossible to couple coupling planes that only include plugs, or coupling planes that only include receptacles. The coupling mechanism 34 in this embodiment is not designed to couple only to a specific type of coupling plane, but rather to be able to couple to any coupling plane.

[0026] As a specific example, the connecting mechanism 34 may be composed of multiple magnets arranged facing the connecting planes within the main body 21. In this example, when the connecting planes of two modules 20 are brought close to each other, a magnetic force is generated between the magnets arranged near the connecting planes, connecting the two modules 20 to each other. When viewed from the side facing the connecting planes, the multiple magnets are arranged so that, with their opposite poles facing the front, they are positioned symmetrically across the diagonal of the connecting planes and across two lines passing through the center of the connecting planes and parallel to the outer periphery. This arrangement can be achieved with as few as eight magnets. With this arrangement, when the connecting planes of the two modules 20 are brought face to face, the magnets face each other with their opposite poles facing the front, and the connecting planes are connected by the attractive force of the magnets.

[0027] Furthermore, by arranging the magnets with opposite poles facing the front surface in positions symmetrical with respect to the two diagonals of the connecting plane sections and the two lines passing through the center of the connecting plane sections and parallel to the outer periphery, the connecting plane sections can be brought into contact with each other so that the magnets with opposite poles facing the front surface face each other in any of four directions obtained by rotating one connecting plane section by 90°. In other words, the connecting plane sections can be connected to each other even when one module 20 is oriented in any of the four directions (0°, 90°, 180°, or 270°) relative to the other module 20 with the connecting direction as the rotation axis.

[0028] According to this method, the surface of the connecting plane portion can be flat, and there is no need to form protrusions or the like on the connecting plane portion to physically engage with the connecting plane portion of another module 20. Therefore, when connecting two modules 20, the user can easily connect them by simply bringing their connecting plane portions into contact with each other. Furthermore, because the connecting plane portion has no irregularities, it is easy to connect multiple modules 20 in a grid-like pattern with no gaps when viewed from above.

[0029] Alternatively, the coupling mechanism 34 may be configured with a claw portion protruding from the surface of the coupling flat portion and an insertion portion formed in a recessed shape on the surface of the coupling flat portion, into which a claw portion of the coupling partner is inserted and engages. In this example, as with the magnet example described above, the claw portion and the insertion portion are arranged in positions that are symmetrical with respect to the diagonal of the coupling flat portion, so that the coupling flat portions of the two modules 20 are placed opposite each other, and the claw portion arranged on one coupling flat portion can be inserted into the insertion portion arranged on the other coupling flat portion.

[0030] The claws in this example may be configured to be housed within the main body 21 when the connecting flat surface is not connected to another module 20, and to protrude by a user operation or the like when connecting to another module 20. Similarly, the insertion section may be configured to be closed when the connecting flat surface is not connected, and to become recessed in conjunction with the claws when the claws protrude by a user operation or the like, or when the claws located on the connecting partner module 20 are inserted. This makes it possible to prevent the claws and the like from getting in the way when using the connecting flat surface without connecting to another module 20.

[0031] In either method, when two modules 20 are connected, the flat connecting portions, each having a flat, approximately square shape, come into contact with each other without any gaps and are fixed together. This allows the user to hold the operation device 10, in which the two modules 20 are integrated, in their hands and perform operation inputs to the information processing device 100 by operating the operation members 22 provided on each module 20. Furthermore, since each module 20 in this embodiment has multiple connecting flat portions, the user can combine a large number of modules 20 in any arrangement by repeatedly connecting different modules 20 to each connecting flat portion, thereby configuring operation devices 10 having various shapes as a whole and in which the various operation members 22 are arranged in various positions and orientations.

[0032] 4 shows an example of an operation device 10 constructed by combining a total of seven modules 20. In this example, operation modules 20a, 20b, and two modules 20d are connected in the same orientation with their top surfaces 21a, on which the operation members 22 are arranged, facing upward. Meanwhile, the left side surface 21d of module 20c is connected to the back surface 21e of module 20d, and the top surface 21a, on which the operation members 22 are arranged, faces right as viewed from the front side of the page. Furthermore, the front surface 21b of module 20e is connected to the right side surface 21c of module 20c, and the right side surface 21c of module 20f is connected to the left side surface 21d of module 20e.

[0033] Furthermore, in this embodiment, as described above, each connecting plane portion has a flat shape without protrusions, etc., and can be connected simply by contacting the connecting plane portions. Therefore, in this figure, it is also possible to later insert another module 20 into the space surrounded on three sides by modules 20d, 20c, and 20f, and connect these three modules 20.

[0034] Furthermore, in this embodiment, a plurality of light-emitting units 35 are arranged on the outer periphery of the connecting plane portion of each module 20. These light-emitting units 35 emit light in response to a control command from the information processing device 100. For example, the light-emitting units 35 may emit light when it is desired to alert the user to the operation member 22 that the user should use, or when it is desired to draw the user's attention to a specific module 20 for dramatic effect. The light-emitting units 35 may also emit light when the remaining charge of the rechargeable battery built into the module 20 is low.

[0035] Furthermore, when the user wishes to connect specific modules 20 together, the information processing device 100 illuminates the light emitting units 35 arranged on the outer periphery of the target connecting flat portions to guide the user as to which connecting flat portions of which modules 20 should be connected. This allows the information processing device 100 to clearly guide the user as to which connecting flat portions of which modules 20 should be connected.

[0036] Furthermore, in this embodiment, two or more light-emitting units 35 are arranged on the outer periphery of one connecting flat section. Therefore, when guiding a user to the connecting flat section to which modules 20 to connect, the information processing device 100 may cause the multiple light-emitting units 35 arranged on the outer periphery of the connecting flat section to emit light in different modes. This allows the information processing device 100 to guide the user not only to the connecting flat section to which modules 20 to connect, but also to the connection orientation when connecting two modules 20 (i.e., the orientation of one module 20 relative to the other module 20 when connected to each other). By bringing the two connecting flat sections into contact with each other so that the light-emitting units 35 emitting light in the same mode face each other, the user can connect the modules 20 to be connected specified by the information processing device 100 in the orientation specified by the information processing device 100.

[0037] Specifically, in this embodiment, each module 20 has eight light-emitting units 35 at the eight vertices of the main body 21, which has a substantially cubic shape. Each of these light-emitting units 35 is disposed at a position where three planes intersect. Furthermore, each of these light-emitting units 35 is disposed so as to be visible from any of the three planes that are in contact with the light-emitting unit 35. For example, the light-emitting unit 35 disposed at the intersection of the top surface 21a, the front surface 21b, and the right side surface 21c is visible from above, the front, and the right.

[0038] With this arrangement, each of the six flat surfaces constituting the outer surface of the main body 21 has a substantially square shape, with four light emitting units 35 provided at the four vertices on the periphery. Furthermore, between two adjacent connecting flat surfaces that can be connected to different modules 20, two light emitting units are arranged that are visible from the direction facing either of the two connecting flat surfaces. By arranging the light emitting units 35 at the vertices of each flat surface in this way, a configuration can be achieved in which multiple light emitting units 35 are arranged on the periphery of each connecting flat surface, with a small number of units.

[0039] The information processing device 100 guides the user to connect specific connecting flat portions of specific modules 20 by illuminating the light emitting units 35 arranged on the outer periphery of the connecting flat portions of the specific two modules 20 that the user wants to connect to each other. As an example, if the user wants to connect the right side surface 21c of module 20a and the left side surface 21d of module 20b, the information processing device 100 illuminates the four light emitting units 35 surrounding each connecting flat portion.

[0040] Furthermore, the information processing device 100 guides the user as to the connection direction by causing the plurality of light-emitting units 35 surrounding each of the connection flat sections to be connected to emit light in different modes. Some specific examples of light-emitting control in this case will be described below.

[0041] As a first example, an example in which the light emitting portions 35 arranged on the outer periphery of the connecting flat portion emit light in different colors to guide the direction of connection will be described with reference to FIGS. 5 and 6. FIG.

[0042] In this embodiment, each light-emitting unit 35 can emit light in one of at least two colors. In this first example, the information processing device 100 also specifies the color to be emitted when illuminating the light-emitting unit 35. By causing the multiple light-emitting units 35 arranged on the periphery of one connecting flat unit to emit light in different colors, the information processing device 100 can guide the user not only to the connecting flat units to be connected, but also to the orientation when connecting them. By connecting two connecting flat units so that the light-emitting units 35 emitting light of the same color face each other, the user can connect the modules 20 specified by the information processing device 100 in the orientation specified by the information processing device 100.

[0043] 5 illustrates light-emission control for guiding the right side surface 21c of module 20a and the left side surface 21d of module 20b to be connected in a manner that aligns the positive direction of the z-axis (i.e., the top surfaces 21a of both modules face the same direction). In this case, the information processing device 100 controls the two upper (positive z-axis) light-emitting elements 35 adjacent to the top surface 21a of the four light-emitting elements 35 arranged on the outer periphery of the right side surface 21c of module 20a to emit red light, and the two lower (negative z-axis) light-emitting elements 35 adjacent to the bottom surface 21f to emit blue light. In the figure, the light-emitting elements 35 with diagonal lines indicate that they are emitting red light, and the light-emitting elements 35 with dotted shading indicate that they are emitting blue light. Light-emitting elements 35 without any hatching indicate that they are not emitting light. Similarly, the information processing device 100 causes the upper two light-emitting units 35 adjacent to the top surface 21a of the four light-emitting units 35 arranged on the outer periphery of the left side surface 21d of the module 20b to emit red light, and the lower two light-emitting units 35 adjacent to the bottom surface 21f to emit blue light. This allows the user to connect the two modules 20 so that the red light-emitting units 35 face each other and the blue light-emitting units 35 face each other, thereby connecting the two modules 20 so that the top surfaces 21a of both units face upward and both operation members 22 are lined up on the upper surfaces.

[0044] Similarly, when the right side surface 21c of module 20a and the left side surface 21d of module 20b are to be connected in different orientations, the information processing device 100 changes the color of light emitted by each light-emitting unit 35. Specifically, it is assumed here that the operation member 22 of module 20a is to be positioned upward and the operation member 22 of module 20b is to be positioned closer to the user (front side) than the user. In this case, as shown in FIG. 6 , the information processing device 100 causes the two upper light-emitting units 35 (on the positive z-axis side) adjacent to the top surface 21a of the four light-emitting units 35 on the outer periphery of the right side surface 21c of module 20a to emit red light, and the two lower light-emitting units 35 (on the negative z-axis side) adjacent to the bottom surface 21f to emit blue light. On the other hand, of the four light-emitting units 35 on the outer periphery of the left side surface 21d of the module 20b, the two light-emitting units 35 on the far side (positive y-axis direction) adjacent to the rear surface 21e are illuminated red, and the two light-emitting units 35 on the near side (negative y-axis direction) adjacent to the front surface 21b are illuminated blue. In this case, if the user connects the two connecting flat surfaces so that the light-emitting units 35 emitting the same color face each other, as in the previous example, the two modules 20b will be connected with the module 20b rotated 90 degrees toward the front compared to the previous example. In this way, the information processing device 100 can use the light-emitting colors of the light-emitting units 35 to guide the user on the orientation when connecting the two modules 20.

[0045] In the above description, four light-emitting units 35 are arranged on the periphery of each connecting flat section, two of which are illuminated with a first color (here, red) and the other two with a second color (here, blue). However, one light-emitting unit 35 may be illuminated with the first color and the remaining three with the second color. By illuminating three of the light-emitting units 35 arranged at the four vertices with the same color, the connecting flat sections to be connected can be more clearly highlighted. On the other hand, by illuminating one light-emitting unit 35 with a different color, the user can be guided to connect two modules 20 in the correct orientation. Furthermore, each light-emitting unit 35 may be configured to emit light in three or more colors. In this case, the information processing device 100 can illuminate the four light-emitting units 35 on the periphery of one connecting flat section with three or four colors to more clearly show the user the correspondence between the connecting flat sections when connecting two modules 20.

[0046] As a second example, an example in which the direction of connection is guided by illuminating some of the light-emitting units 35 and not illuminating others of the multiple light-emitting units 35 arranged on the connecting plane portion will be described using Figure 7.

[0047] In this example, three of the four light-emitting units 35 located on each of the two connecting flat sections to be connected are illuminated and one is not illuminated. By illuminating the three light-emitting units 35, the user can determine which connecting flat section is the one to be connected. Furthermore, by connecting the connecting flat sections so that the three illuminated light-emitting units 35 face the three illuminated light-emitting units 35 on the other side and the non-illuminated light-emitting units 35 face the non-illuminated light-emitting units 35, the two modules 20 can be connected in the orientation guided by the information processing device 100.

[0048] In this example, unlike the first example, instead of illuminating all of the light-emitting units 35 arranged on the outer periphery of the connecting flat sections, some are illuminated and some are not illuminated to guide the user in the connection direction. Therefore, compared to when all of the light-emitting units 35 arranged on the connecting flat sections are illuminated in a certain color, it is easier for the user to understand which light-emitting units 35 correspond to which light-emitting units 35 when connecting the connecting flat sections.

[0049] As a specific example, Fig. 7, like Fig. 6, shows an example of guidance control when connecting the right side surface 21c of module 20a and the left side surface 21d of module 20b so that the operation member 22 of module 20a is positioned upward and the operation member 22 of module 20b is positioned closer (toward the front) than the user. Here, of the four light-emitting units 35 arranged on the right side surface 21c of module 20a, one light-emitting unit 35 adjacent to the top surface 21a and the front surface 21b is not illuminated, while the other light-emitting units 35 are illuminated. Also, of the four light-emitting units 35 arranged on the left side surface 21d of module 20b, one light-emitting unit 35 adjacent to the top surface 21a and the back surface 21e is not illuminated, while the other light-emitting units 35 are illuminated.

[0050] In this case, the user connects modules 20a and 20b with the top surface 21a of module 20b facing forward so that the non-emitting light-emitting units 35 face each other. In this way, by not emitting light from one of the four light-emitting units 35 arranged on the outer periphery of the connecting flat unit, the connection orientation can be uniquely identified.

[0051] As a third example, an example will be described in which some of the light-emitting units 35 arranged on the connecting flat sections to be connected are lit and some of the light-emitting units 35 are flashed, thereby guiding the direction of connection. In this example, unlike the second example, all four light-emitting units 35 arranged on each of the two connecting flat sections to be connected are illuminated, but the light-emitting pattern is different. That is, of the four light-emitting units 35, some of the light-emitting units 35 are lit (continuously emitting light), and the other light-emitting units 35 are flashed (alternately turning on and off).

[0052] As a specific example, the information processing device 100 lights up one of the four light-emitting units 35 arranged on the connecting planar unit to be connected and causes three of the other light-emitting units to flash. This allows the user to determine which connecting planar unit is the connecting planar unit to be connected. Furthermore, by connecting the connecting planar units so that the three flashing light-emitting units 35 face the three flashing light-emitting units 35 on the other unit and the lit light-emitting units 35 face the lit light-emitting units 35 on the other unit, the two modules 20 can be connected in the orientation guided by the information processing device 100. In this example, too, by flashing some of the light-emitting units 35 and lighting up some of the light-emitting units 35, it is easier for the user to understand the correspondence between the light-emitting units 35 compared to when all of the light-emitting units 35 are continuously emitting light of a certain color.

[0053] As a fourth example, a case will be described in which multiple light-emitting units 35 arranged on the connecting flat surface portions of the connection targets are made to flash in different flashing patterns. In this example, unlike the third example, all four light-emitting units 35 arranged on the connecting flat surface portions of the connection targets are made to flash. However, among the four light-emitting units 35, some light-emitting units 35 are made to flash in a pattern different from the flashing pattern of the other light-emitting units 35.

[0054] As a specific example, the information processing device 100 blinks one of the four light-emitting units 35 at a relatively slow cycle and blinks the other three light-emitting units 35 at a relatively fast cycle, allowing the user to determine which light-emitting units 35 correspond to each other.

[0055] In addition, the information processing device 100 may not simply blink the multiple light-emitting units 35 at different cycles, but may also change the blinking pattern by, for example, varying the ratio of the length of the on time to the length of the off time between the multiple light-emitting units 35.

[0056] The above-described methods for guiding the user about the connecting plane portion of the connecting target and the connection direction may be used in combination. For example, the information processing device 100 may cause some of the light-emitting units 35 arranged on the connecting plane portion of the connecting target to emit light, and may cause the light-emitting units 35 to emit light in different colors or flashing patterns.

[0057] As a specific example, the information processing device 100 may illuminate two diagonally arranged light emitting units 35 out of four light emitting units 35 arranged on the connecting flat surface to be connected. When two light emitting units 35 arranged on the same side are illuminated, it is not possible to identify which of the two surfaces sharing that side is the connecting flat surface to be connected. However, by illuminating the two diagonally arranged light emitting units 35, it is possible to uniquely identify the connecting flat surface to be connected.

[0058] Furthermore, if two diagonally arranged light-emitting units 35 are illuminated in the same manner, there are two possible orientations for matching the light-emitting units 35 with the two other light-emitting units 35, and the connection orientation cannot be uniquely determined. However, by making the two diagonally arranged light-emitting units 35 illuminate in different manners (e.g., different colors), the orientation for matching the light-emitting units 35 emitting light in the same manner can be uniquely determined, and a specific connection orientation can be determined. According to this example, compared to the first example in which all four light-emitting units 35 arranged on the connection flat surface to be connected are illuminated, the number of light-emitting units 35 that are illuminated is smaller, thereby reducing power consumption.

[0059] Fig. 8 shows an example of a guiding method for illuminating the light-emitting units 35 arranged diagonally in this manner. This example, similar to Fig. 5, shows light-emitting control for guiding the right side surface 21c of module 20a and the left side surface 21d of module 20b to be connected in such a way that the positive z-axis directions of both modules are aligned (i.e., the top surfaces 21a of both modules are oriented in the same direction). Also, similar to Fig. 5, the light-emitting units 35 with diagonal lines are shown emitting red light, and the light-emitting units 35 with dotted shading are shown emitting blue light.

[0060] As shown in the figure, the information processing device 100 illuminates the four light-emitting units 35 arranged on the outer periphery of the right side surface 21c of the module 20a, the light-emitting units 35 adjacent to the top surface 21a and the back surface 21e in red, and the light-emitting units 35 adjacent to the bottom surface 21f and the front surface 21b in blue. Meanwhile, the other two of the four light-emitting units 35 are kept unlit. By illuminating the two light-emitting units 35 in this way, the user can recognize that the right side surface 21c of the module 20a is the connection target.

[0061] Similarly, the information processing device 100 causes the light-emitting units 35 adjacent to the top surface 21a and back surface 21e of the four light-emitting units 35 arranged on the outer periphery of the left side surface 21d of the module 20b to emit red light, causes the light-emitting units 35 adjacent to the bottom surface 21f and front surface 21b to emit blue light, and does not emit light for the other two light-emitting units 35. This allows the user to connect the two modules 20 so that the red light-emitting units 35 face each other and the blue light-emitting units 35 face each other, thereby connecting the two modules 20 so that the top surfaces 21a of both modules face upward and both operation members 22 are lined up on the top surfaces.

[0062] The module 20a may be provided with an identification mechanism for identifying the type of another module 20 connected to the connecting plane portion that the module 20a is provided with.

[0063] As an example, an identification tag capable of contactless short-range wireless communication based on a standard such as NFC may be disposed near each connecting flat section within the main body 21. This identification tag records identification information for identifying each module 20. When another module 20 is connected to a connecting flat section, the module 20a can identify the type of the other module connected to the connecting flat section by reading the identification information recorded on the identification tag in the connected module 20 via wireless communication.

[0064] The module 20a may also receive identification information from the other connection partner via an optical signal. In this example, a light-emitting unit that transmits an optical signal such as infrared light and a light-receiving unit that receives the optical signal transmitted from the light-emitting unit of the other connection partner are disposed on the surface of each connecting flat portion. In this example, the light-emitting unit and the light-receiving unit are disposed in the center of the connecting flat portion so that optical signals can be transmitted and received between the other connection partners regardless of the orientation of the connected partners.

[0065] Furthermore, when the connection mechanism 34 of each module 20 is configured with a claw portion and an insertion portion, terminal portions capable of transmitting and receiving electrical signals may be disposed on the claw portion and the insertion portion. In this example, when two modules 20 are connected, the claw portion of one module is inserted into the insertion portion of the other module, and at that time, the terminal portions of the other module come into physical contact, enabling direct transmission and reception of electrical signals with the connected module 20. Module 20a can receive identification information from the connected module through communication via this terminal portion.

[0066] Furthermore, the module 20a may be provided with a mechanism for identifying the orientation of the other module 20 when the other module 20 is connected to the connecting plane portion.

[0067] Specifically, magnets and magnetic sensors for identifying the orientation of the connected components may be disposed on the connecting plane. For example, magnets 36 are disposed near two of the four vertices of the connecting plane, and magnetic sensors 37 are disposed near the other two vertices. FIG. 9 is a diagram illustrating an example of the positional relationship between the magnets 36 and the magnetic sensors 37 when two connecting planes face each other. In this diagram, the connecting plane on the left side represents the right side surface 21c of module 20a, and the connecting plane on the right side represents the left side surface 21d of module 20b. Furthermore, two magnets 36 are disposed near the upper vertex (positive z-axis side) of the connecting plane, and two magnetic sensors 37 are disposed near the lower vertex (negative z-axis side).

[0068] As shown in Figure 9(a), when the opposing connecting flat surfaces are oriented in the same direction, the magnets 36 and the magnetic sensors 37 face each other, so that the magnets 36 of module 20b are not present in front of either of the two magnetic sensors 37 arranged in module 20a. As shown in Figure 9(b), when the connecting flat surface of the connected module is rotated 90 degrees clockwise as viewed from module 20a, the magnet 36 arranged in the connected module 20b is present in front of the magnetic sensor 37 on the negative y-axis side of module 20a, and no magnet 36 is present in front of the magnetic sensor 37 on the positive y-axis side. Conversely, as shown in Figure 9(c), when the coupling flat surface of the coupling partner is rotated 90° counterclockwise (i.e., rotated 270° clockwise), the magnet 36 of the coupling partner is not present in front of the magnetic sensor 37 on the negative y-axis side of module 20a, and the magnet 36 arranged on the left side surface 21d of module 20b is present in front of the magnetic sensor 37 on the positive y-axis side. Furthermore, as shown in Figure 9(d), when the coupling flat surface of the coupling partner is rotated 180°, the magnet 36 of the coupling partner is present in front of both of the two magnetic sensors 37 provided on module 20a. Therefore, by referring to the magnetic detection results of each magnetic sensor 37 and determining whether the magnet 36 of the coupling partner is present in front of each magnetic sensor 37, the orientation of the coupling partner can be estimated.

[0069] The identification mechanism for identifying the orientation of the coupled device may be a combination of a light-emitting unit and a light sensor instead of the combination of the magnet 36 and the magnetic sensor 37. As with the combination of the magnet 36 and the magnetic sensor 37 described above, by combining a light-emitting unit that emits light and a light sensor that detects that light, it is possible to identify whether or not a light-emitting unit is present in front of the two light sensors, and thereby estimate the orientation of the coupled device.

[0070] As described above, if each module 20 is equipped with an identification mechanism that identifies the module 20 to be connected and its orientation, guidance control may be performed using the identification results of such an identification mechanism when guiding the user to the connecting flat surface to be connected and the direction of the connection.

[0071] Specifically, first, when the information processing device 100 is controlling the light emission of the light-emitting unit 35 to guide the connecting flat section of the connection target and the connection direction as described above, the information processing device 100 receives a notification from the connecting target module 20 indicating that another module 20 has been connected to the connecting target flat section. Then, if it is determined that the connecting flat section has been connected as guided, the light emission control for the guidance may be stopped. Alternatively, if the connecting flat section has been connected as guided, the light emission control may be maintained as is.

[0072] On the other hand, if a connecting flat section different from the connecting flat section that is the target of guidance is connected to another module 20, or if it is determined that the connecting flat sections are not connected in the correct orientation, light emission control may be performed to notify the user that the connection is incorrect, such as by flashing the light emitting section 35 in a specified color.

[0073] Furthermore, the information processing device 100 may first perform light emission control to guide the connecting flat surface portion of the connection target, and then, after detecting that the user has performed the connection, perform light emission control to guide the direction of the connection as necessary. A specific example of such control will be described with reference to FIG. 10 .

[0074] In this example, the user is guided to ultimately connect module 20a and module 20b in the same orientation as in the example of Figure 6. First, as shown in Figure 10(a), the information processing device 100 causes the four light-emitting units 35 arranged on the connecting flat surfaces to be connected to emit light in the same color. Here, the four light-emitting units 35 arranged on the right side surface 21c of module 20a and the four light-emitting units 35 arranged on the left side surface 21d of module 20b are all shown emitting red light. In this state, it is not possible to guide the user as to the connection orientation, but it is easy for the user to understand which is the connecting flat surface to be connected.

[0075] Thereafter, when the module 20 to be connected detects that the connecting plane portion of the connecting target has been connected to another module 20, it notifies the information processing device 100 of this fact. At this time, each module 20 also notifies the information processing device 100 of information (hereinafter referred to as connection status information) regarding the type of the module 20 to be connected and the direction of connection (the direction in which the module 20 to be connected is facing).

[0076] The information processing device 100 determines whether the modules 20 to be connected are connected in the expected orientation based on the connection status information received from the modules 20. If the modules 20 are connected in the expected orientation, the information processing device 100 turns off the light-emitting units 35 of the connecting planar units that had been emitting light up until that point, and ends the guidance control.

[0077] On the other hand, if it is determined that the modules 20 to be connected are connected but the orientation is different from the expected orientation, a light-emitting instruction is issued to guide the connection orientation. As illustrated above, this may be a control that causes multiple light-emitting units 35 arranged on the connecting flat surface of the connected modules to emit light in different modes (e.g., different colors). As a specific example, the light-emitting color of each light-emitting unit 35 is changed to the same state as in FIG. 6, and two of the four light-emitting units 35 arranged on the outer periphery of the connecting flat surface emit light in red and the other two in blue. Figure 10(b) shows this state.

[0078] When such light emission control is performed, the user rotates one of the connected modules 20 so that the light-emitting units 35 emitting the same color face each other, reconnecting the modules 20. Figure 10(c) shows the state after the connection orientation has been corrected by the user. Specifically, the user rotates module 20b 90 degrees relative to module 20a so that the top surface 21a of module 20b moves from the top toward the front. As a result, the four light-emitting units 35 arranged on each connection plane face the light-emitting units 35 of the connected module that emit the same color, and the two modules are connected in the orientation instructed by the information processing device 100.

[0079] Each time the connection status, such as the type or orientation, of the other modules 20 connected to it changes, each module 20 retransmits the connection status information to the information processing device 100. When the information processing device 100 determines based on the connection status information that the modules 20 to be connected are connected in the correct orientation, it can terminate guidance control and resume processing based on operation input from the user.

[0080] As explained above, by first guiding the connecting flat surface portions of the connection objects, and then guiding the direction of connection after the connecting flat surface portions of the connection objects have been connected, it is possible to guide the user through the work content in stages, making it easier for the user to understand the work content.

[0081] Specific examples of components included in the special module are described below. Module 20e includes a speaker 23 for emitting sound as a special-purpose component, instead of the operation member 22 included in module 20a. Like the operation member 22, the speaker 23 is disposed on the top surface 21a of the main body 21 of module 20e. Module 20e emits sound from the speaker 23 in accordance with an audio signal transmitted from the information processing device 100.

[0082] The module 20f has a vibration mechanism 24 for generating vibrations built into the main body 21. The vibration mechanism 24 generates vibrations in response to a control command from the information processing device 100, so that the vibrations can be presented to a user holding the module 20f and any module 20 directly or indirectly connected thereto. Unlike the other modules 20, the top surface 21a of the module 20f does not have any special-purpose components arranged thereon, and is a flat surface like the other surfaces.

[0083] The module 20g also includes a rotating member 25 rotatably connected to the main body 21. The rotating member 25 is connected to the upper surface 21a of the main body 21 of the module 20g. More specifically, the rotating member 25 has a disk shape, and its upper surface 25a is disposed in a direction parallel to the upper surface 21a of the main body 21. The rotating member 25 is connected to be rotatable around a rotation axis that is perpendicular to the upper surface 21a. That is, the rotating member 25 rotates in the xy plane around the z-axis direction as its rotation axis.

[0084] Furthermore, the upper surface 25a of the rotating member 25 functions as a connecting plane portion that can be connected to other modules 20. That is, the rotating member 25 is provided with a connecting mechanism 34 similar to that provided on each connecting plane portion of the other modules 20, and the other modules 20 can be connected via this connecting mechanism 34. FIG. 11 shows an example of a state in which a module 20a is connected to the upper surface 25a of the rotating member 25. The rotating member 25 is rotatably connected to the main body 21 while the other modules 20 remain connected. Therefore, as indicated by the block arrow in the figure, the module 20a connected to the upper surface 25a of the rotating member 25 can be rotated together with the rotating member 25 around the z-axis direction as the center of rotation. As a result, for example, the front surface 21b of the module 20a can be connected to the rotating member 25, and the operating member 22 arranged on the upper surface 21a of the module 20a can be used by changing its orientation in any direction, such as forward, backward, leftward, or rightward.

[0085] By using this module 20g, the user can use the operation device 10 in a state in which the orientation of the other module 20 connected to the rotating member 25 of module 20g has been changed to a desired orientation. Furthermore, the user can use the operation of changing the orientation of the module 20 connected to the rotating member 25 as an operation input to the information processing device 100. In this case, module 20g functions as an operation module. The content of this operation input may be identified using the detection result of the attitude sensor 33 of the module 20 connected to the rotating member 25. Alternatively, module 20g itself may be equipped with a sensor that measures the rotation direction and amount of rotation of the rotating member 25, and the content of the operation input may be identified using the measurement result of that sensor.

[0086] The user can prepare an operation device 10 in which various types of operation members 22 are arranged in various positions by arbitrarily connecting the above-described multiple modules 20 in response to instructions from the information processing device 100 or according to the user's preferences. Operation signals indicating the content of operation inputs made by the user to each operation member 22 are individually transmitted from each module 20a to the information processing device 100. The information processing device 100 performs various information processes based on these operation signals.

[0087] The configuration and functions of the information processing device 100 according to this embodiment will be described below.

[0088] The information processing device 100 is, for example, a home game console or a personal computer, and as shown in Fig. 1, includes a control unit 101, a storage unit 102, and an interface unit 103. The information processing device 100 is also connected to a display device 104.

[0089] The control unit 101 includes at least one processor such as a CPU, and executes various information processing by executing programs stored in the storage unit 102. Specific examples of the processing executed by the control unit 101 in this embodiment will be described later. The storage unit 102 includes at least one memory device such as a RAM, and stores the programs executed by the control unit 101 and data processed by the programs.

[0090] The interface unit 103 is an interface for data communication between the operation device 10 and the display device 104. The information processing device 100 is capable of wireless data communication with each of the multiple modules 20 that make up the operation device 10 via the interface unit 103. The interface unit 103 also includes a multimedia interface for transmitting a video signal supplied by the information processing device 100 to the display device 104.

[0091] The display device 104 displays on a screen an image corresponding to the video signal supplied from the information processing device 100. The display device 104 may be a stationary display device such as a home television receiver, or may be a portable display device.

[0092] Functions realized by the information processing device 100 in this embodiment will be described below with reference to the functional block diagram of FIG. 12. Functionally, the information processing device 100 is configured to include a module state identification unit 111, an operation information reception unit 112, and a process execution unit 113. These functions are realized by the control unit 101 operating in accordance with one or more programs stored in the storage unit 102. These programs may be provided to the information processing device 100 via a communication line such as the Internet, or may be provided by being stored in a computer-readable, non-transitory information storage medium such as an optical disk.

[0093] The module state identification unit 111 identifies the state of each module 20 based on the information received from each module 20. As described above, each module 20 constituting the operation device 10 is individually connected to the information processing device 100 via wireless communication. While the user is using the operation device 10, each module 20 periodically transmits information relating to its own state to the information processing device 100.

[0094] In particular, the module state identification unit 111 acquires information (connection state information) from each module 20, such as whether or not other modules 20 are connected to each connecting plane portion of the module 20, and if so, what type of module 20 it is, and in what orientation the modules 20 are connected. Based on this information, the module state identification unit 111 identifies the overall orientation and connection state of each module 20. The identification result is reflected in the processing content by the processing execution unit 113, which will be described later.

[0095] The module state identification unit 111 may identify which module 20 the user is using and identify the connection state of each module 20 based on the posture information received from each module 20 .

[0096] The operation information receiving unit 112 receives operation signals from the modules 20 a that constitute the operation device 10 , thereby receiving the contents of the user's operation.

[0097] The process execution unit 113 is realized by the control unit 101 executing a game program or the like, and executes a process according to the operation content received by the operation information reception unit 112. The process execution unit 113 may also determine the process content according to the state of each module 20 identified by the module state identification unit 111.

[0098] In particular, when a user uses a plurality of modules 20 in a state in which the modules 20 are connected in an arbitrary manner, the processing execution unit 113 may execute processing that reflects this connection state. For example, when a user connects a plurality of modules 20 to configure an operation device 10 shaped like a gun, the processing execution unit 113 causes an item such as a weapon that reflects that shape to appear in the game.

[0099] The process execution unit 113 may also identify modules 20 that are connected to each other as the module 20 the user is using, and determine the process content according to the module's type. For example, if the user connects module 20b with multiple buttons to another module 20, it may infer that module 20b is used to indicate direction, and if the user connects module 20d with an analog stick to another module 20 and uses it, it may infer that module 20d is used to indicate direction. In this way, by executing a process according to the type of module 20 that is connected, the user can select the module 20 to use according to their own preferences, etc.

[0100] Furthermore, the processing execution unit 113 may refer to the detection results of the orientation sensor 33 built into the module 20 to identify how the user is moving the operation device 10, and execute processing in accordance with the identification results. In this case, the processing execution unit 113 does not need to refer to all of the detection results of the orientation sensor 33 of each of the multiple modules 20 that are connected to each other, but may identify a representative module 20 and refer to the detection results of the orientation sensor 33 to identify how the user is moving the operation device 10 made up of these connected modules 20.

[0101] Specifically, for example, when an object corresponding to the operation device 10 is displayed on the screen, such as by appearing in a game, the processing execution unit 113 may execute control to move the object based on the orientation information received from each module 20. This allows the user to move the object on the screen by moving the operation device 10. In this case, it is possible to omit small movements by, for example, performing a predetermined filter process on the orientation information received in chronological order. This makes it possible to eliminate small movements of the operation device 10 that are not expected to be in line with the user's intention, noise, and the like.

[0102] Furthermore, the processing execution unit 113 may change the content of the processing depending on the result of identifying the orientation of the connected modules 20. For example, the processing execution unit 113 may identify the orientation of a specific module 20 relative to the user, and then change the direction indicated by the user depending on the identification result, or change the position or orientation of an effect that occurs in the game depending on the user's operation input.

[0103] Furthermore, the process execution unit 113 may execute a process that prompts the user to connect multiple modules 20 as the process progresses. Specifically, for example, when the user acquires a new ability or item as the game progresses, the process execution unit 113 prompts the user to connect an additional module 20 having an operation member 22 for instructing the user to use the ability or item in the game to the operation device 10 currently being used by the user. This allows the number of modules 20 available to the user to be gradually increased as the process progresses.

[0104] Furthermore, in this case, as described above, the processing execution unit 113 can guide the user as to which connecting flat surface to connect and the direction of connection by causing the light emitting unit 35 corresponding to the connecting flat surface to be connected of the modules 20 to be connected to emit light in multiple colors. Note that the processing execution unit 113 can check whether the user is connecting the modules 20 as instructed by the processing execution unit 113, by referring to the connection state of each module 20 identified by the module state identification unit 111.

[0105] Furthermore, the process execution unit 113 may perform control to release the connection of connected modules 20 as the process progresses. For example, if the connection mechanism 34 is equipped with a locking mechanism that keeps the claw portion inserted in the insertion portion, and if this locking mechanism can be released by an actuator or the like in response to a control signal from the control unit 31, the process execution unit 113 can issue a control command to each module 20 to release the connection. This allows the connection to be released at any timing, and multiple modules 20 that were previously connected to automatically return to a separated state. This type of control can be used for game effects, etc.

[0106] Furthermore, when the user operates a specific operation member 22, the process execution unit 113 may execute control to cause the light-emitting units 35 located at the corresponding positions to emit light in response to receiving the operation. For example, when the user operates a trigger button, which is an operation member 22 located on the module 20c, the process execution unit 113 causes the four light-emitting units 35 located on the outer periphery of the top surface 21a of the module 20c on which the operation member 22 is located, to emit light for a predetermined period of time. This allows feedback on the user's operation to be provided on the operation device 10 as well.

[0107] Furthermore, when a user operates a module 20 that has multiple buttons as operation members 22, the process execution unit 113 may cause the light emitting unit 35 of the module 20 that accepted the operation to emit light in a predetermined color according to the type of button that was pressed. This allows the user to intuitively know which button they operated.

[0108] The process execution unit 113 may illuminate not only the light emitting units 35 arranged on the outer periphery of the top surface 21a on which the operation member 22 operated by the user is arranged, but also other light emitting units 35. This allows the user to recognize from the feedback of the light emitting units 35 that they are operating the operation member 22 correctly, even if, for example, the operation is being performed with the top surface 21a facing backward as seen from the user.

[0109] Furthermore, when a user's operation is received on the module 20 having multiple buttons, the process execution unit 113 may illuminate the light-emitting unit 35 at a position corresponding to the pressed button. For example, if four buttons are arranged as operation members 22 on the top surface 21a of the module 20a, and one of these buttons closer to the rear surface 21e is pressed, the process execution unit 113 may illuminate two light-emitting units 35 adjacent to the rear surface 21e, out of the four light-emitting units 35 arranged on the outer periphery of the top surface 21a. This allows the user to intuitively know which button they pressed. Furthermore, the process execution unit 113 may illuminate the light-emitting unit 35 (here, the two light-emitting units 35 adjacent to the rear surface 21e) that faces the light-emitting unit 35 illuminated on the top surface 21a, out of the four light-emitting units 35 arranged on the outer periphery of the bottom surface 21f opposite the top surface 21a. This allows the user to know which side the button they pressed is located on, even if the top surface 21 a is facing the rear when viewed from the user. Note that, although only the light-emitting section 35 on the side where the button is located is illuminated here, the other light-emitting sections 35 may also be illuminated, and the light-emitting section 35 on the side where the button is located may be illuminated with a brightness higher than that of the other light-emitting sections 35, so that the user can recognize the button they pressed.

[0110] The process execution unit 113 may also execute control to illuminate the light-emitting unit 35 to guide the user to the operation member 22 to be operated. For example, when the process execution unit 113 wants the user to operate the trigger button of the module 20c, the process execution unit 113 illuminates the light-emitting unit 35 located on the top surface 21a of the module 20c, where the trigger button is located. This allows the user to easily understand which operation member 22 to operate. The process execution unit 113 may also illuminate the light-emitting unit 35 on the bottom surface 21f as well as the top surface 21a. This allows the user to understand which operation member 22 of which module 20 to operate, even when the top surface 21a of the module 20c is facing the rear or bottom when connected to the modules 20, making it difficult for the user to directly view the top surface 21a.

[0111] Furthermore, similar to the example of illuminating the light-emitting unit 35 corresponding to the position of the button operated by the user described above, when the processing execution unit 113 wants the user to operate one of multiple buttons arranged on one module 20, it may illuminate the light-emitting unit 35 at a position corresponding to the position of that button.

[0112] Furthermore, when the processing execution unit 113 wants the user to perform an operation to move some kind of component, such as rotating another module 20 when the other module 20 is connected to the rotating member 25 of module 20g as illustrated in Figure 11, the processing execution unit 113 may execute control to cause multiple light-emitting units 35 to emit light in sequence in an order corresponding to the movement.

[0113] For example, if another module 20 (here, module 20a) connected to the rotation member 25 is to be rotated clockwise, the process execution unit 113 sequentially turns on the four light-emitting units 35 arranged on the top surface 21a of module 20a and / or the four light-emitting units 35 arranged on the top surface 21a of module 20g, one by one, in a clockwise direction. That is, of the four light-emitting units 35, the upper right light-emitting unit 35, as viewed from the front of the top surface 21a, is first turned on and then turned off, then the lower right light-emitting unit 35 is turned on and then turned off, then the lower left light-emitting unit 35 is turned on and then turned off, and then the upper left light-emitting unit 35 is turned on and then turned off, and then the upper right light-emitting unit 35 is turned on again. This type of control makes it possible to clearly guide the user as to the direction of rotation.

[0114] In addition, if the user rotates the module 20a in the direction opposite to the direction the user wants the module 20a to be rotated, the processing execution unit 113 may execute control to emit light in a predetermined pattern to indicate that the rotation direction is incorrect (for example, control to cause all light-emitting units 35 arranged on the upper surface 21a of the module 20a to flash in a predetermined color at the same time).

[0115] In this way, by successively illuminating the plurality of light-emitting units 35 in a pattern corresponding to the operation that the user is to perform, it is possible to guide the user to the operation that the user is to perform in a manner that is easy to intuitively grasp.

[0116] As described above, according to the operation device 10 and information processing system 1 of the present embodiment, the user can use the operation device 10 in a state in which a plurality of modules 20 are connected arbitrarily according to the user's preferences, etc., to perform operation input to the information processing device 100. Furthermore, the information processing device 100 can allow the user to configure the operation device 10 in a state in which the operation members 22, etc., are provided according to the process being executed by prompting the user to connect a specific module 20 according to the content of the process being executed.

[0117] In the above description, a user performs operation input using a single operation device 10 in which multiple modules 20 are connected together as an integrated unit. However, this is not limited to this, and some of the modules 20 can be used separately. For example, a user may perform operation input by holding a module set in which some operation modules are connected in their right hand and other operation modules in their left hand. Alternatively, some operation modules may be placed on the floor and operated with their feet or other body parts. Furthermore, one user may hold and use a module set consisting of some modules 20, while another user may hold and use a module set consisting of other modules 20. This allows for operation input that is originally intended to be performed by a single user to be shared among multiple users.

[0118] The embodiments of the present invention are not limited to those described above. For example, the shapes and configurations of the modules 20 constituting the operation device 10 are merely examples. The operation device 10 may include modules 20 having shapes other than a cube, but having connecting plane portions substantially identical in shape to the connecting plane portions of the modules 20 described above. Specifically, the operation device 10 may include modules 20 having a substantially triangular prism shape or a substantially rectangular parallelepiped shape. In this case, each module 20 would have a substantially rectangular connecting plane portion on its side. The operation device 10 may also include modules 20 having a substantially regular tetrahedron shape or a substantially regular octahedron shape. In this case, each module 20 would have a substantially triangular connecting plane portion, and these connecting plane portions would be connected to each other for use.

[0119] Regardless of the shape of each module 20, if the connecting plane portion has an approximately polygonal shape, the light-emitting portion 35 can be positioned at the vertex of the connecting plane portion, so that the light-emitting portion 35 can be positioned so that it is visible from multiple adjacent surfaces.

[0120] In the above description, the light emitting units 35 are arranged on the outer periphery of the connecting flat surface, so that the light emitting units 35 can be seen from other surfaces adjacent to the connecting flat surface of the module 20. However, this is not limiting, and the light emitting units 35 do not necessarily have to be arranged on the outer edge as long as multiple light emitting units 35 are arranged along the outer periphery of the connecting flat surface. In this case, it is necessary to arrange a light emitting unit 35 individually for each of the multiple connecting flat surfaces, but even in this case, it is possible to achieve the light emission control for guiding the connecting flat surfaces to be connected and the connection direction as described above.

[0121] Furthermore, the positions and number of connecting flat portions arranged in each module 20 are not limited to those described above. For example, some modules 20 may have the operating member 22 arranged on each of the multiple flat portions, thereby reducing the number of connecting flat portions. Furthermore, there may be modules 20 in which the bottom surface 21f can be used as a connecting flat portion.

[0122] Furthermore, the operation members 22 provided in the operation modules described above are merely examples, and operation modules may have other types of operation members. Furthermore, the special-purpose members provided in the special modules are not limited to those described above. Furthermore, the special modules may have no special-purpose members and may only have a mechanism for connecting to other modules 20. By connecting and using such a special module with other modules 20, it is possible to adjust the position of the operation members 22 provided in a specific operation module or make it easier for the user to grip the operation device 10.

[0123] In the above description, the information processing device 100 is assumed to be located relatively close to the user and directly connected to the operation device 10 and the display device 104. However, the present invention is not limited to this. Instead of a client device directly connected to the operation device 10 and the display device 104 used by the user, a server device connected to the client device via a communication network may function as the information processing device 100 according to the embodiment of the present invention. In this case, the information processing device 100 receives operation signals from each operation module constituting the operation device 10 via the communication network, and transmits control commands to cause the light-emitting unit 35 of each module 20 to emit light.

[0124] Furthermore, at least a portion of the processing described above as being executed by the information processing device 100 may be realized by a control circuit built into each module 20. For example, each module 20 may receive information from the information processing device 100 specifying the connecting planar portions to be connected and the connection direction by the user, determine which light-emitting units 35 to make emit light in what light-emitting mode based on the received information, and execute light-emitting control in accordance with the determined content. Furthermore, light-emitting control according to the user's operation content or the operation content to be performed by the user may also be executed independently by each module 20 in accordance with a prior instruction from the information processing device 100.

[0125] It should be noted that the functions provided by the components described herein may be implemented by any circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), CPUs (Central Processing Units), conventional circuits, and / or combinations thereof, configured or programmed to provide the described functions. A processor includes transistors and other circuits and is considered to be a circuitry or processing circuitry. A processor may also be a programmed processor that executes a program stored in a memory.

[0126] In this specification, a circuit, unit, or means is hardware that is programmed to realize a described function or that performs that function. The hardware may be any hardware disclosed in this specification or any hardware that is programmed to realize or known to perform the described function. If the hardware is a processor, which is considered to be a type of circuit, the circuit, means, or unit is a combination of hardware and software used to operate the hardware and / or processor.

[0127] The present disclosure may include the following aspects. [Item 1] An operation device including a plurality of modules that are separate and independent from one another, each connected to an information processing device, wherein at least some of the plurality of modules include an operation member for receiving operation input from a user, each of the plurality of modules includes at least one connecting flat surface portion equipped with a connecting mechanism for connecting to other modules, and each of the plurality of modules includes a plurality of light-emitting units arranged along an outer periphery of the connecting flat surface portion, and when any of the plurality of modules is to be connected, each of the two modules to be connected illuminates at least some of the light-emitting units arranged on the connecting flat surface portion to be connected in response to an instruction from the information processing device. [Item 2] An operation device according to item 1, wherein each of the two modules to be connected illuminates the multiple light-emitting units arranged on the connecting flat surface portion to be connected in different modes to guide the direction of connection when the two modules are connected. [Item 3] The operation device according to item 2, wherein each of the two modules to be connected guides the connection orientation when connecting the two modules by causing a plurality of light-emitting units arranged on the connecting flat surface of the connection target to emit light in different colors. [Item 4] The operation device according to item 2, wherein each of the two modules to be connected guides the connection orientation when connecting the two modules by causing some of the plurality of light-emitting units arranged on the connecting flat surface of the connection target to emit light and some of the light-emitting units not to emit light. [Item 5] The operation device according to item 2, wherein each of the two modules to be connected guides the connection orientation when connecting the two modules by turning on some of the plurality of light-emitting units arranged on the connecting flat surface of the connection target and causing some of the light-emitting units to flash.[Item 6] The operation device according to item 2, wherein each of the two modules to be connected causes a plurality of light-emitting units arranged on the connecting flat surface of the module to flash in different flashing patterns to guide the user as to the direction of connection when connecting the two modules. [Item 7] The operation device according to item 2, wherein at least one of the plurality of modules has a mechanism for identifying the direction in which another module is connected to the connecting flat surface when the other module is connected to the connecting flat surface, and the at least one module changes the light-emitting state of the plurality of light-emitting units arranged on the connecting flat surface depending on the direction of the other module connected to the connecting flat surface. [Item 8] The operation device according to item 1, wherein at least some of the modules cause at least some of the plurality of light-emitting units to emit light depending on the content of a user's operation on an operation member provided on the module. [Item 9] The operation device according to item 1, wherein at least some of the modules cause at least some of the plurality of light-emitting units to emit light depending on the content of an operation to be performed by the user on an operation member provided on the module in response to an instruction from the information processing device. [Item 10] The operating device according to item 1, wherein the connecting plane portion included in each of the plurality of modules has a substantially rectangular shape, and the plurality of light emitting units are arranged at a plurality of vertices of the connecting plane portion. [Item 11] The operating device according to item 10, wherein at least one of the plurality of modules includes two connecting plane portions that are adjacent to each other and can be connected to different modules, and a light emitting unit that is visible from a direction facing either of the two adjacent connecting plane portions is arranged between the two connecting plane portions.[Item 12] An information processing system including an operation device including a plurality of modules separate and independent from one another, and an information processing device connected to the operation device, wherein at least some of the plurality of modules include an operation member for receiving operation input from a user, and each of the plurality of modules includes at least one connecting flat surface section having a coupling mechanism for coupling to other modules, and the information processing device is configured to: when any of the plurality of modules should be coupled, send to each of the modules to be coupled to cause at least some of a plurality of light-emitting units arranged on the connecting flat surface section to be coupled to light up. [Item 13] An information processing method executed by an information processing device connected to an operation device including a plurality of modules separate and independent from one another, at least some of the plurality of modules including an operation member for receiving operation input from a user, and each of the plurality of modules including at least one connecting flat surface section having a coupling mechanism for coupling to other modules, the information processing method comprising: determining that any of the plurality of modules should be coupled, and transmitting to each of the modules to be coupled to cause at least some of a plurality of light-emitting units arranged on the connecting flat surface section to be coupled based on the determination.[Item 14] A computer-readable, non-transitory information storage medium storing a program for controlling an information processing device connected to an operation device including a plurality of modules that are separate and independent from one another, at least some of the plurality of modules including an operation member for receiving operation input from a user, and each of the plurality of modules including at least one connecting flat surface portion equipped with a connecting mechanism for connecting to other modules, the program causing the information processing device to: determine that any of the plurality of modules should be connected; and transmit, to each of the modules to be connected based on the determination, an instruction to cause at least some of the light-emitting units arranged on the connecting flat surface portion to emit light.

[0128] 1 Information processing system, 10 Operation device, 20 Module, 21 Main body, 22 Operation member, 23 Speaker, 24 Vibration mechanism, 25 Rotation member, 31 Control unit, 32 Communication unit, 33 Attitude sensor, 34 Linking mechanism, 35 Light-emitting unit, 100 Information processing device, 101 Control unit, 102 Memory unit, 103 Interface unit, 104 Display device, 111 Module state identification unit, 112 Operation information reception unit, 113 Processing execution unit.

Claims

1. An operating device comprising a plurality of modules that are separate and independent from one another, each of the plurality of modules being connected to an information processing device, wherein at least some of the plurality of modules comprise operating members for receiving operation input from a user, each of the plurality of modules comprises at least one connecting plane portion having a connecting mechanism for connecting to other modules, each of the plurality of modules comprises a plurality of light-emitting units arranged along the periphery of the connecting plane portion, and when one of the plurality of modules is to be connected, each of the two modules to be connected illuminates at least some of the light-emitting units arranged on the connecting plane portion to be connected in response to an instruction from the information processing device.

2. An operating device as claimed in claim 1, wherein each of the two modules to be connected guides the direction of connection when connecting the two modules by illuminating a plurality of light-emitting elements arranged on the connecting plane surface of the connected module in different ways.

3. An operating device as claimed in claim 2, wherein each of the two modules to be connected has a plurality of light-emitting elements arranged on the connecting plane surface of the connected module that emit light in different colors to guide the direction of connection when connecting the two modules.

4. An operating device as described in claim 2, wherein each of the two modules to be connected guides the direction of connection when connecting the two modules by illuminating some of the light-emitting elements and not illuminating other of the multiple light-emitting elements arranged on the connecting plane portion of the connected module.

5. An operating device as described in claim 2, wherein each of the two modules to be connected lights up some of the light emitting elements and blinks some of the light emitting elements arranged on the connecting plane portion of the connected module, thereby guiding the direction of connection when connecting the two modules.

6. An operating device as described in claim 2, wherein each of the two modules to be connected has a plurality of light-emitting elements arranged on the connecting plane portion of the connected object blinking in mutually different blinking patterns, thereby guiding the direction of connection when connecting the two modules.

7. An operating device as described in claim 2, wherein at least one of the plurality of modules is provided with a mechanism for identifying the orientation of another module connected to the connecting plane section when the other module is connected to the connecting plane section, and the at least one module changes the light emission state of the plurality of light-emitting elements arranged on the connecting plane section according to the orientation of the other module connected to the connecting plane section.

8. An operating device according to claim 1, wherein at least some of the modules cause at least some of the plurality of light-emitting units to emit light in accordance with the content of a user's operation on an operating member provided in the module.

9. An operating device as described in claim 1, wherein at least some of the modules, in response to an instruction from the information processing device, cause at least some of the plurality of light-emitting units to emit light in accordance with the content of the operation to be performed by the user using the operating member provided in that module.

10. An operating device according to claim 1, wherein the connecting plane portion provided on each of the plurality of modules has a substantially polygonal shape, and the plurality of light emitting units are arranged at a plurality of vertices of the connecting plane portion.

11. An operating device according to claim 10, wherein at least one of the plurality of modules includes two connecting plane sections that are adjacent to each other and can be connected to different modules, and a light-emitting section that is visible from the direction opposite either of the two connecting plane sections is disposed between the two adjacent connecting plane sections.

12. An information processing system including an operating device including a plurality of modules that are separate and independent from one another, and an information processing device connected to the operating device, wherein at least some of the plurality of modules include operating members for receiving operation input from a user, and each of the plurality of modules includes at least one connecting plane portion equipped with a connecting mechanism for connecting to other modules, and when any of the plurality of modules should be connected, the information processing device transmits to each of the modules to be connected an instruction to cause at least some of the plurality of light-emitting units arranged on the connecting plane portion to be connected to emit light.

13. An information processing method executed by an information processing device connected to an operation device including a plurality of modules that are separate and independent from one another, at least some of the plurality of modules including an operating member for receiving operation input from a user, and each of the plurality of modules including at least one connecting flat surface portion equipped with a connecting mechanism for connecting to other modules, the information processing method including: a step of determining that any of the plurality of modules should be connected; and a step of transmitting, to each of the modules to be connected based on the determination, an instruction to light up at least some of the light-emitting units arranged on the connecting flat surface portion to be connected.

14. A program for controlling an information processing device connected to an operation device including a plurality of modules that are separate and independent from one another, at least some of the plurality of modules including an operating member for receiving operation input from a user, and each of the plurality of modules including at least one connecting flat surface having a connecting mechanism for connecting to other modules, the program causing the information processing device to execute the steps of: determining that one of the plurality of modules should be connected; and transmitting, to each of the modules to be connected based on the determination, an instruction to light up at least some of the light-emitting elements arranged on the connecting flat surface to be connected.

Images