Information processing device, information processing program, information processing system, and information processing method
The information processing device uses multiple compression methods based on the device's state to maintain data accuracy, addressing the issue of inaccurate data restoration in sensor data compression.
Patent Information
- Application Number
- JP2023102246
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-06-22
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2038-09-14
AI Technical Summary
Existing methods for compressing data from sensors fail to maintain data accuracy during the restoration process.
An information processing device with inertial sensors that employs multiple data compression methods based on the device's attitude or position, selecting an appropriate method depending on the device's state to maintain data accuracy.
The device effectively maintains data accuracy by dynamically selecting compression methods based on the device's state, reducing information loss and ensuring accurate data restoration.
Smart Images

Figure 0007594627000001 
Figure 0007594627000002 
Figure 0007594627000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device including a sensor, an information processing program, an information processing system, and an information processing method. [Background technology]
[0002] 2. Description of the Related Art Conventionally, there have been devices that include a sensor and compress data from the sensor and transmit the compressed data to another device (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 5122036 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in a device equipped with a sensor, there is room for improvement in a method for compressing data detected by the sensor in terms of maintaining the accuracy of the data when the compressed data is restored.
[0005] SUMMARY OF THE PRESENT EMBODIMENTS It is therefore an object of the present invention to provide an information processing apparatus capable of maintaining the accuracy of data when compressing and restoring data based on an output from a sensor. [Means for solving the problem]
[0006] In order to solve the above problems, the present invention employs the following configuration.
[0007] The information processing device of the present invention is an information processing device having an inertial sensor, and includes a first acquisition means, a second acquisition means, a first determination means, a first data compression means, and a second data compression means. The first acquisition means acquires a first value related to an attitude or position of the information processing device based on an output from the inertial sensor at a first timing. The second acquisition means acquires a second value related to an attitude or position of the information processing device based on an output from the inertial sensor at a second timing different from the first timing. The first determination means determines whether a first condition is satisfied based on at least one of the first value and the second value. When it is determined by the first determination means that the first condition is satisfied, the first data compression means compresses at least one of the first value and the second value by a first method, and generates first compressed data including data related to the first value and data related to the second value. When the first determination means determines that the first condition is not satisfied, the second data compression means compresses at least one of the first value and the second value by a second method different from the first method, and generates second compressed data including data relating to the first value and data relating to the second value.
[0008] According to the above, it is possible to determine whether a first condition is satisfied based on a value related to the attitude or position of the device, and if the first condition is satisfied, the data is compressed by the first method, and if the first condition is not satisfied, the data is compressed by the second method. This makes it possible to select an appropriate compression method for maintaining the accuracy of the data according to the state of the information processing device.
[0009] In another configuration, the information processing device may further include a transmission unit that transmits the first compressed data or the second compressed data to another device.
[0010] Based on the above, it is possible to transmit compressed data to another device, and to restore the data in the other device.
[0011] In another configuration, the first determination means may determine whether or not the first condition is satisfied based on at least a difference between the first value and the second value.
[0012] Based on the above, it is possible to determine whether a first condition is satisfied, based on the difference between the first value and the second value.
[0013] In another configuration, the information processing device may further include a third acquisition means for acquiring a third value related to an attitude or a position of the information processing device based on an output from the inertial sensor at a third timing different from the first timing and the second timing. The first determination means may determine whether the first condition is satisfied based on a difference between the average of the first value and the second value and the third value.
[0014] Based on the above, the difference between the average of the first value and the second value and the third value is calculated, and it is possible to determine whether or not the first condition is satisfied based on the difference.
[0015] In another configuration, the first determination means may determine whether the information processing device is in a stationary state as the determination as to whether the first condition is satisfied.
[0016] Based on the above, when the information processing device is in a stationary state, it is possible to compress data by the first method.
[0017] In another configuration, the first determination means may determine whether or not the first condition is satisfied by determining whether or not an amount of change in an attitude or a position of the information processing device is less than a predetermined value.
[0018] Based on the above, when the amount of change in the attitude or position of the information processing device is less than a predetermined value, it is possible to compress data by the first method.
[0019] In another configuration, the first data compression means may, as the first method, generate the first compressed data so that the amount of data of either the data relating to the first value or the data relating to the second value is greater than the amount of data of the other.
[0020] According to the above, the first compressed data is generated so that the amount of one data is greater than the amount of the other data, so that the amount of information lost in one data can be reduced and the accuracy of the data can be maintained when compressed.
[0021] In another configuration, the information processing device may further include a third acquisition means for acquiring a third value related to an attitude or a position of the information processing device based on an output from the inertial sensor at a third timing different from the first timing and the second timing. The first data compression means may compress data related to the third value set based on the first value, the second value, and the third value, and generate the first compressed data further including data related to the compressed third value.
[0022] Based on the above, it is possible to compress data relating to the third value, based on the first value and the second value.
[0023] In another configuration, the first data compression means may, as the first method, compress the data relating to the first value and the data relating to the second value so that the data amount of the data relating to the second value is larger than the data amount of the data relating to the first value, and further compress the data relating to the third value so that the data amount is smaller than the data relating to the first value, and generate the first compressed data including the compressed data relating to the first value, the data relating to the second value, and the data relating to the third value.
[0024] Based on the above, by making the data amounts different for the data relating to the three values, it is possible to reduce the amount of information lost for the data relating to the second value, and it is possible to maintain the accuracy of the data.
[0025] In another configuration, the first data compression means may generate the first compressed data by setting the second value to data relating to the compressed second value, setting the difference between the first value and the second value to data relating to the compressed first value, and setting the difference between the average of the first value and the second value and the third value to data relating to the compressed third value.
[0026] According to the above, the data related to the second value can be compressed and the second value can be set as the data related to the second value, the difference between the first value and the second value can be set as the data related to the first value, and the difference between the first value and the second value can be set as the data related to the third value. This makes it possible to restore the three values while reducing the overall amount of data.
[0027] In another configuration, the information processing device may further include a second determination means for determining whether a second condition different from the first condition is satisfied based on at least the first value and the second value when the first determination means determines that the first condition is not satisfied. The second data compression means may generate the second compressed data when the second determination means determines that the second condition is satisfied.
[0028] According to the above, when it is determined that the first condition is not satisfied, it is determined whether the second condition is satisfied, and when the second condition is satisfied, the data can be compressed by the second method. This makes it possible to select an appropriate compression method according to the state of the device.
[0029] In another configuration, the second determination means may determine whether or not the second condition is satisfied by determining whether or not an attitude or a position of the information processing device changes linearly.
[0030] Based on the above, when the attitude or position of the information processing device changes linearly, data can be compressed by the second method.
[0031] In another configuration, the information processing device may further include a third acquisition means for acquiring a third value related to an attitude or a position of the information processing device based on an output from the inertial sensor at a third timing different from the first timing and the second timing. The second determination means may determine whether or not the second condition is satisfied based on whether or not the first value, the second value, and the third value have linearity.
[0032] Based on the above, it is possible to determine whether the second condition is satisfied, based on whether the first value, the second value, and the third value change linearly.
[0033] In another configuration, the second determination means may determine that the second condition is satisfied at least when a difference between an average of the first value and the second value and the third value is within a predetermined range.
[0034] Based on the above, when the difference is within a predetermined range, the data can be compressed by the second method.
[0035] In another configuration, the second determination means may identify a component having a maximum absolute value among a plurality of components constituting any one of the first value, the second value, and the third value, compare a component corresponding to the identified component with a predetermined value for two values other than the any one of the first value, the second value, and the third value, and determine whether or not the second condition is satisfied based on a result of the comparison.
[0036] According to the above, when the first value, the second value, and the third value each have a plurality of components, for example, it is possible to identify the maximum component in the third value, and determine whether or not the second condition is satisfied based on the result of comparing the same component of the first value and the second value as the identified component with a predetermined value.
[0037] In another configuration, the second data compression means may, as the second method, set data relating to the third value based on an average of the first value and the second value, compress the data relating to the third value, and generate the second compressed data including the compressed data relating to the third value.
[0038] According to the above, instead of setting the value of the third value as it is in the data relating to the third value, the data is set based on the average of the first value and the second value, so that the value set in the data relating to the third value can be made relatively small.
[0039] In another configuration, the information processing device may further include a calculation means for calculating a predetermined reference value based on at least two values of the first value, the second value, and the third value. As the second method, the second data compression means may set data related to at least one value of the first value, the second value, and the third value based on the reference value, compress the data related to the at least one value, and generate the second compressed data including the compressed data.
[0040] According to the above, for example, for the third value, instead of setting the value directly to the data related to the third value, the data is set based on a reference value based on the first value and the second value, so that the value set to the data related to the third value can be made relatively small.
[0041] In another configuration, the second data compression means may, as the second method, compress the data related to the first value, the data related to the second value, and the data related to the third value so that the data amounts of the data related to the first value and the data related to the second value are equal, and the data amounts of the data related to the first value and the data related to the second value are greater than the data amount of the data related to the third value.
[0042] Based on the above, by making the amount of data when compressed relatively large for the data related to the first value and the data related to the second value, the amount of information lost can be reduced and the accuracy of the data can be maintained.
[0043] In another configuration, the second timing may be a timing subsequent to the first timing, and the third timing may be a timing between the first timing and the second timing.
[0044] Based on the above, it is possible to determine the condition and compress the data based on the information output from the inertial sensor at the first timing, the second timing, and the third timing in this order.
[0045] In another configuration, the information processing device may further include a third data compression means, which, when it is determined by the second determination means that the second condition is not satisfied, compresses at least the data related to the first value and the data related to the second value by a third method different from the first method and the second method, to generate third compressed data including the data related to the first value and the data related to the second value.
[0046] Based on the above, when it is determined that the second condition is not satisfied, the data can be further compressed by the third method.
[0047] In another configuration, the first value and the second value may be data including a plurality of components, and the plurality of components may have a predetermined relationship. The data related to the first value and the data related to the second value may be data obtained by omitting at least one component from the plurality of components, and the third compressed data may include information indicating the omitted component of the data related to the first value and information indicating the omitted component of the data related to the second value.
[0048] Based on the above, in compression by the third method, it is possible to omit different components between the first value and the second value.
[0049] In another configuration, the information processing device may further include a first calculation means for calculating the first value representing an attitude or position of the device based on an output from the inertial sensor at the first timing, a second calculation means for calculating the second value representing an attitude or position of the device based on an output from the inertial sensor at the second timing, and a transmission means for transmitting data including the first value and the second value to another device.
[0050] Based on the above, in the information processing device, a value representing the attitude or position of the device can be calculated based on an output from the inertial sensor, and the value can be compressed and transmitted to another device.
[0051] An information processing device according to another invention has an inertial sensor and includes a first acquisition means, a second acquisition means, and a data compression means. The first acquisition means acquires a first value related to an attitude or position of the information processing device based on an output from the inertial sensor at a first timing. The second acquisition means acquires a second value related to an attitude or position of the information processing device based on an output from the inertial sensor at a second timing different from the first timing. The data compression means compresses at least one of the data related to the first value and the data related to the second value so that the amount of data of either one of the data related to the first value and the data related to the second value is greater than the amount of data of the other.
[0052] According to the above, the data is compressed so that the amount of data relating to either the first value or the second value is greater than the amount of the other data, so that the amount of information lost for one of the data can be reduced and the accuracy of the data can be maintained.
[0053] An information processing device according to another invention is an information processing device having an inertial sensor, and includes a first calculation means, a second calculation means, and a transmission means. The first calculation means calculates a first value representing an attitude or position of the device based on an output from the inertial sensor at a first timing. The second calculation means calculates a second value representing an attitude or position of the device based on an output from the inertial sensor at a second timing different from the first timing. The transmission means transmits data including the first value and the second value to another device.
[0054] According to the above, a value representing the attitude or position of the device can be calculated based on an output from an inertial sensor in the device, and the value can be transmitted to another device. This allows the other device to accurately recognize the attitude of the information processing device.
[0055] In another configuration, the information processing device may further include a compression unit configured to compress at least one of the first value and the second value. The transmission unit may transmit the data compressed by the compression unit to the other device.
[0056] Based on the above, the information processing device can compress at least one of the first value and the second value and transmit the compressed value to another device.
[0057] In another configuration, the transmitting means may transmit the data including time information relating to the first timing or the second timing to the other device.
[0058] Based on the above, it is further possible to transmit time information to another device.
[0059] In another configuration, the first value and the second value may be a quaternion representing an attitude of the information processing device.
[0060] Based on the above, a quaternion representing an attitude can be calculated in the information processing device and transmitted to another device.
[0061] In another configuration, the information processing device may further include a determination means, a first data compression means, and a second data compression means. The determination means may determine whether a first condition is satisfied based on at least one of the first value and the second value. The first data compression means may compress at least one of the first value and the second value by a first method when the determination means determines that the first condition is satisfied, and generate first compressed data including data related to the first value and data related to the second value. The second data compression means may compress at least one of the first value and the second value by a second method different from the first method, and generate second compressed data including data related to the first value and data related to the second value when the determination means determines that the first condition is not satisfied.
[0062] Based on the above, it is possible to select an appropriate compression method depending on the state of the information processing device.
[0063] Further, another invention may be a program executed in the information processing device, an information processing method, or an information processing system including the information processing device and another device. Effect of the Invention
[0064] The present invention allows the accuracy of the data to be maintained when compressing and decompressing data from a sensor. [Brief description of the drawings]
[0065] [Figure 1] FIG. 1 shows an example of a state in which a left controller 3 and a right controller 4 are attached to a main unit 2. [Diagram 2] FIG. 1 shows an example of a state in which the left controller 3 and the right controller 4 are removed from the main unit 2. [Diagram 3] A block diagram showing an example of the internal configuration of the main unit 2 and the right controller 4. [Figure 4]A diagram showing the flow of processing when posture data is transmitted from the right controller 4 to the main unit 2. [Diagram 5] A diagram showing an example of multiple modes [Figure 6] A conceptual diagram of Equation 4 [Figure 7] Conceptual diagram of the first condition B [Figure 8A] FIG. 13 is a diagram showing an example of a data structure of first compressed data generated when mode 2 is selected; [Figure 8B] FIG. 13 is a diagram showing an example of a data structure of second compressed data generated when mode 1 is selected; [Figure 8C] FIG. 13 is a diagram showing an example of the data structure of third compressed data generated when mode 0 is selected; [Figure 9] FIG. 10 is a diagram showing a comparison between the posture data before compression when the posture data is compressed in mode 2 and the posture data after the compressed posture data is transmitted to the main unit and restored according to the main unit. [Figure 10] FIG. 13 is a diagram showing an example of data stored in a controller; [Figure 11] 1 is a flowchart showing an example of a process performed in a controller. [Figure 12] 11 is a flowchart showing an example of processing performed in the main unit 2. [Figure 13] A diagram showing an example of the change in controller attitude and the mode selected. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0066] An information processing system according to an example of this embodiment will be described below. An example of an information processing system 1 in this embodiment includes a main body device 2, a left controller 3, and a right controller 4.
[0067] FIG. 1 is a diagram showing an example of a state in which a left controller 3 and a right controller 4 are attached to a main unit 2. As shown in FIG. 1, the left controller 3 and the right controller 4 are each attached to the main unit 2 and integrated together. The main unit 2 is a device that executes various processes (e.g., game processes) in the information processing system 1. The main unit 2 is equipped with a display for displaying images generated by the main unit 2. The left controller 3 and the right controller 4 are information processing devices that include an input unit for a user to input, an inertial sensor for detecting the position and orientation of the controller, and the like.
[0068] Fig. 2 is a diagram showing an example of a state in which the left controller 3 and the right controller 4 have been removed from the main unit 2. As shown in Figs. 1 and 2, the left controller 3 and the right controller 4 are detachable from the main unit 2. In the following, the left controller 3 and the right controller 4 may be collectively referred to as "controller."
[0069] Fig. 3 is a block diagram showing an example of the internal configuration of the main unit 2 and the right controller 4. Note that Fig. 3 shows only the part related to the transmission of posture data of the right controller 4, and other parts are omitted. In the following, only the configuration of the right controller 4 will be described, and the configuration of the left controller 3 will be omitted, but the configuration of the left controller 3 is the same as that of the right controller 4.
[0070] As shown in FIG. 3, the main unit 2 includes a processor 21, a DRAM 22, a controller communication unit 23 for the main unit 2 to communicate with the controller, and a flash memory 24. The main unit 2 also includes a left terminal 25 for wired communication with the left controller 3 and a right terminal 26 for wired communication with the right controller 4. Although not shown, the main unit 2 also includes a battery. The processor 21 is an information processing unit that executes various information processes executed in the main unit 2, and may be composed of only a CPU (Central Processing Unit), for example, or may be composed of a SoC (System-on-a-chip) including multiple functions such as a CPU function and a GPU (Graphics Processing Unit) function. The processor 21 executes various information processes by executing a program (for example, a game program) stored in a storage unit (specifically, an internal storage medium such as the flash memory 24, or an external storage medium inserted into a slot of the main unit 2, etc.).
[0071] The controller communication unit 23 performs wireless communication with the right controller 4 according to, for example, the Bluetooth (registered trademark) standard. Similarly, the controller communication unit 23 performs communication with the left controller 3 according to, for example, the Bluetooth (registered trademark) standard. Note that the main unit 2 and the controllers may perform wireless communication according to other standards (for example, wireless LAN).
[0072] When the left controller 3 and the right controller 4 are detached from the main unit 2, the main unit 2 wirelessly communicates with the left controller 3 and the right controller 4 via the controller communication unit 23. For example, the main unit 2 receives attitude data (described later) from the left controller 3 and / or the right controller 4, and performs various processes based on the received attitude data (for example, controlling the attitude of a virtual camera for displaying game images).
[0073] 3, the right controller 4 includes a processing unit 41, a memory 42, an inertial sensor 43, a flash memory 44, a communication control unit 45, and a terminal 46. In addition to these, the right controller 4 includes input units such as a plurality of buttons and an analog stick (see FIG. 1).
[0074] The processing unit 41 is connected via a bus to the memory 42, the inertial sensor 43, the flash memory 44, the communication control unit 45, and the terminal 46. The processing unit 41 calculates the attitude of the right controller 4 based on the output from the inertial sensor 43, which will be described in detail later.
[0075] The flash memory 44 also stores firmware that controls the right controller 4, a control program for calculating posture data, which will be described later, and the like.
[0076] The communication control unit 45 is capable of communicating with the main unit 2 both by wired communication via the terminal 46 and by wireless communication not via the terminal 46. That is, when the right controller 4 is attached to the main unit 2 as shown in Fig. 1, the communication control unit 45 communicates with the main unit 2 via the terminal 46. Also, when the right controller 4 is detached from the main unit 2 as shown in Fig. 2, the communication control unit 45 performs wireless communication with the main unit 2 (specifically, the controller communication unit 23).
[0077] For example, when the right controller 4 is not attached to the main unit 2 as shown in Fig. 2, the attitude data representing the attitude of the right controller 4 calculated by the processing unit 41 is transmitted to the main unit 2 by wireless communication. Alternatively, when the right controller 4 is attached to the main unit 2 as shown in Fig. 1, the attitude data is transmitted to the main unit 2 by wired communication via the terminal 46. In addition, the communication control unit 45 acquires operation information from each input unit (specifically, each button, analog stick, etc.), and transmits operation data including the acquired information (or information obtained by performing a predetermined process on the acquired information) to the main unit 2.
[0078] The communication between the main unit 2 and the right controller 4 is repeated at a rate of once per predetermined time. In one communication between the main unit 2 and the right controller 4, operation data corresponding to operations on each input unit and attitude data corresponding to the output from the inertial sensor 43 are transmitted from the right controller 4 to the main unit 2. The operation data and attitude data may be transmitted at different times. For example, in communication between the main unit 2 and the right controller 4 at a certain time, either the operation data or the attitude data may be transmitted from the right controller 4 to the main unit 2, and in the same communication at a different time, the other data may be transmitted from the right controller 4 to the main unit 2.
[0079] The inertial sensor 43 is, for example, a six-axis sensor. Specifically, the inertial sensor 43 includes an acceleration sensor and an angular velocity sensor. The acceleration sensor detects the magnitude of acceleration along three predetermined axes (for example, the x, y and z axes shown in FIG. 1). The angular velocity sensor detects angular velocity around three predetermined axes (for example, the x, y and z axes shown in FIG. 1). The processing unit 41 calculates the attitude of the right controller 4 based on the angular velocity value from the inertial sensor 43. Attitude data according to the calculated attitude is compressed and transmitted to the main body device 2. Note that the processing unit 41 may calculate the attitude of the controller based on the acceleration value in addition to the angular velocity value from the inertial sensor 43.
[0080] Note that the configuration shown in Fig. 3 is merely an example, and the physical configuration may be different from that shown in Fig. 3. For example, the communication control unit 45, the processing unit 41, and the memory 42 may be integrated. The controller and / or the main unit 2 may also include other devices, sensors, and apparatuses. In Fig. 3, the controller is shown to include an inertial sensor 43 including an acceleration sensor and an angular velocity sensor, but the acceleration sensor and the angular velocity sensor may be separate sensors.
[0081] (Transmission of posture data to main unit 2) Next, a description will be given of the process when posture data is calculated in the controller and the calculated posture data is transmitted to the main unit 2. Figure 4 is a diagram showing the flow of the process when posture data is transmitted from the right controller 4 to the main unit 2.
[0082] As shown in Fig. 4, first, the acceleration values and angular velocity values from the inertial sensor 43 are sampled at a predetermined frequency. For example, the sampling frequency of the acceleration values and angular velocity values may be 800 Hz. Next, the attitude of the right controller 4 is calculated based on the sampled angular velocity values. Specifically, the angular velocity values output from the inertial sensor 43 are integrated to calculate a quaternion "q" representing the attitude of the right controller 4. This attitude calculation is performed by the processing unit 41.
[0083] The quaternion “q” representing the attitude of the controller is expressed by the following equation 1 using complex numbers i, j, and k. q=w+xi+yj+zk (Eq. 1)
[0084] Here, i, j, and k satisfy the following relationship. i 2 =j 2 =k 2 =ijk=-1, ij=-ji=k, jk=-kj=i, ki=-ik=j
[0085] Additionally, x, y, and z represent the rotation axis, and w represents the rotation angle. A quaternion q is considered as a vector with four components (w, x, y, and z), where the norm of q is 1. That is, w, x, y, and z satisfy the following equation 2. w 2 +x 2 +y 2 +z 2 =1 (formula 2)
[0086] From Equation 2, if three of the four components are transmitted from the controller to the main unit 2, the main unit 2 can restore the remaining component. For this reason, in this embodiment, one of the four components is omitted, and the three components are transmitted from the controller to the main unit 2. In this embodiment, the component to be omitted is the component with the largest absolute value. Information transmitted from the controller to the main unit 2 includes information indicating the omitted component. This makes it possible to reduce the amount of data transmitted from the controller to the main unit 2, and allows the main unit 2 to calculate q, which represents the attitude of the controller, from a vector having three components. Note that the component to be omitted from the four components does not have to be the component with the largest absolute value.
[0087] In the following, a quaternion with four components that represents the attitude of the controller will be written as "q". Also, a vector with three components, one of the four components omitted, will be written as "f". "f" can be said to be the attitude data that represents the attitude of the controller.
[0088] As is clear from Equation 2, the absolute values of the components w, x, y, and z of the quaternion q are each equal to or less than 1, but in this embodiment, each component of the vector f is expressed as an integer. For example, the value obtained by multiplying each component of q by the nth power of 10 is defined as each component of f.
[0089] In addition, q(t), which represents the attitude of the controller at time t, is calculated using the following recurrence formula. q(t)=1 / 2×q(t-1)*ω×Δt (Equation 3) Here, ω is the angular velocity value from the inertial sensor 43. Δt is the sampling period.
[0090] In this embodiment, each of the components (w, x, y, z) of the quaternion q calculated by Equation 3 is data represented by 32 bits.
[0091] Once q, which represents the attitude, is calculated, a thinning process is performed. In the attitude calculation process, q is calculated at 800 Hz (i.e., 800 times per second), but in the thinning process, q is thinned out at, for example, 200 Hz. That is, one of four consecutive qs in the time series calculated in the attitude calculation process is extracted in the thinning process.
[0092] Next, mode selection is performed. Mode selection is a process of selecting which of a plurality of modes the posture data is to be compressed in and transmitted to the main unit 2. The posture data compression method differs depending on the mode. Note that in this embodiment, mode selection is performed when the controller is detached from the main unit 2 (i.e., when the controller and the main unit 2 are wirelessly connected). Mode selection may also be performed when the controller is attached to the main unit 2.
[0093] When one of a plurality of modes is selected in the mode selection, the attitude data is compressed according to the selected mode, and a packet including the compressed attitude data is generated by the communication control unit 45. Then, the generated packet is wirelessly transmitted to the main unit 2, and the packet is received by the main unit 2. The main unit 2 extracts the compressed attitude data from the received packet, expands the data, restores the quaternion q, and performs a predetermined information processing based on the restored q.
[0094] (Details of each mode) Next, each mode will be described in detail with reference to Fig. 5, which shows an example of a plurality of modes.
[0095] As shown in FIG. 5, the multiple modes include mode 2, mode 1, and mode 0. Whether or not a condition is satisfied is determined based on the three quaternions acquired by the thinning process, and a mode is selected according to the determination result. Hereinafter, the three acquired quaternions are denoted as "q0", "q1", and "q2" in the order of acquisition. That is, q acquired based on the output from the inertial sensor 43 at time t0 is denoted as "q0", q acquired based on the output from the inertial sensor 43 at time t1 after time t0 is denoted as "q1", and q acquired based on the output from the inertial sensor 43 at time t2 after time t1 is denoted as "q2". In addition, vector f represented by three components corresponding to "q0", "q1", and "q2", respectively, are denoted as "f0", "f1", and "f2", respectively.
[0096] Specifically, first, it is determined whether mode 2 is applicable, and if it is determined that mode 2 is applicable, mode 2 is selected. If it is determined that mode 2 is not applicable, it is determined whether mode 1 is applicable, and if it is determined that mode 1 is applicable, mode 1 is selected. Then, if it is determined that mode 1 is not applicable, mode 0 is selected. Each mode and the conditions for applying each mode will be described below.
[0097] (Mode 2 explanation) Mode 2 is a mode that is selected when the controller is stationary. Here, "a state in which the controller is stationary" refers to a state in which the angular velocity value detected by the inertial sensor 43 of the controller is "0" or a value so small that the controller can be regarded as stationary. In other words, "a state in which the controller is stationary" refers to a state in which the angular velocity value from the inertial sensor 43 indicates "0" or a value so small that the controller can be regarded as completely stationary or nearly stationary, at least at that point in time.
[0098] Mode 2 is selected when the first condition is satisfied. The first condition is satisfied when the following formula 4 and formula 5 are satisfied. f2-f0<predetermined value (Formula 4) (first condition A) Δf1<predetermined value (Formula 5) (first condition B)
[0099] Here, Δf1 is expressed by the following Equation 6. Δf1=f1-(f2+f0) / 2 (Equation 6)
[0100] FIG. 6 is a diagram conceptually showing formula 4. That is, one of the first conditions (first condition A) for selecting mode 2 is that the difference between f0 and f2 is less than a predetermined value. In FIG. 6, one component of f0, f1, and f2 is shown, and it is shown that the one component is less than a predetermined value. In reality, f0, f1, and f2 are vectors each having three components, and "f2-f0" is a difference vector between vector f2 and vector f0. Therefore, formula 4 shows that the norm of this difference vector "f2-f0" is less than a predetermined value. If formula 4 (first condition A) does not hold, mode 2 is not selected, and it is determined whether or not the second condition for selecting mode 1 holds. The second condition will be described later.
[0101] If the first condition A (Equation 4) is satisfied, then it is determined whether the first condition B is satisfied. FIG. 7 is a diagram conceptually showing the first condition B. Note that FIG. 7 also shows one component of f0, f1, and f2, as in FIG. 6. Specifically, the controller calculates the average of f2 and f0, and calculates the difference (difference vector) between f1 and the average as Δf1. Then, the controller determines whether the norm of Δf1 is less than a predetermined value. Here, the predetermined value of the first condition B may be different from or the same as the predetermined value of the first condition A. If it is determined that the first condition A is satisfied and that the first condition B is satisfied, mode 2 is selected.
[0102] If the first condition A is satisfied, it means that the values of the components f0 and f2 are close to each other. If the first condition B is satisfied, it means that the central sample f1 is not too far from the average of f0 and f2. This means that when the values of the components of the three samples f0, f1, and f2 are plotted on a graph such as that shown in FIG. 7, the three samples line up in a nearly straight line in the horizontal direction. In other words, if the first condition A is satisfied and the first condition B is satisfied, it means that the attitude of the controller has hardly changed at least during this period, and that the controller is stationary.
[0103] When mode 2 is selected, f0, f1, and f2 are compressed, and first compressed data including the compressed data is generated. Fig. 8A is a diagram showing an example of the data structure of the first compressed data generated when mode 2 is selected.
[0104] As shown in FIG. 8A, the first compressed data 210 generated when mode 2 is selected includes a time stamp (TS) 200, mode information (M) 201, and omission information (D) 202.
[0105] The time stamp 200 is time information. The time stamp 200 may be time information when any of the three quaternions q0, q1, and q2 is calculated. The time stamp 200 may also be time information when an angular velocity value (angular velocity value used to calculate any of q0, q1, and q2) is acquired.
[0106] The mode information 201 is information indicating which of the three modes the posture data was compressed in. When mode 2 is selected, for example, "2" is set as the mode information 201.
[0107] Moreover, the omission information 202 is information indicating which of the four components of the quaternion q is omitted. In mode 2, the controller is in a stationary state, and q0, q1, and q2 are not far apart from each other. Therefore, the omitted component (the component with the largest absolute value) is common to q0, q1, and q2. Therefore, in mode 2, one omission information 202 common to the three f0, f1, and f2 is included in the first compressed data 210 and transmitted to the main unit 2.
[0108] The first compressed data 210 also includes an orientation data portion 203 that stores Δf0 (three components), an orientation data portion 204 that stores Δf1 (three components), and an orientation data portion 205 that stores f2 (three components).
[0109] Specifically, 24 bits are assigned to each component of f2. That is, while each component of q and f is represented by 32-bit data as described above, each component of f2 is compressed from 32 bits to 24 bits.
[0110] Therefore, the data size allocated to f2 (the number of bits in the attitude data section 205) is 24 bits x 3 components = 72 bits. For example, if the absolute value of w is the largest among the four components w, x, y, and z of q2, w is omitted (i.e., compressed). Therefore, 24 bits are allocated to each of the x, y, and z components, and the values of these three components are transmitted to the main unit 2 as attitude data f2 representing the attitude of the controller.
[0111] Also, the difference between f2 and f0 (the difference vector between vector f2 and vector f0) is calculated as Δf0, and 13 bits are assigned to each component of the calculated Δf0. Specifically, 13 bits x 3 components = 39 bits are assigned to Δf0. For example, when w is omitted from the four components w, x, y, and z of q0, 13 bits are assigned to each of the x, y, and z components of Δf0. The main unit 2 receives Δf0 and f2 from the controller, and calculates each component of f0 (e.g., the x, y, and z components) based on Δf0 and f2. The main unit 2 then restores q0 by calculating the omitted component of q0 (e.g., the w component) based on the above formula 2.
[0112] Furthermore, 4 bits are assigned to each component of Δf1 calculated based on Equation 6. Specifically, Δf1 is assigned 4 bits x 3 components = 12 bits. The main unit 2 calculates each component of f1 based on Δf1, f2, and Δf0 received from the controller. Then, the main unit 2 calculates the omitted components based on the three calculated components of f1 to restore q1.
[0113] The data size of the posture data portion (Δf0, Δf1, and f2) of the first compressed data 210 in mode 2 shown in Fig. 8A is 13 x 3 + 4 x 3 + 24 x 3 = 123 bits in total. On the other hand, the size of the posture data without compression is 32 bits x 3 components x 3 = 288 bits when each component of the quaternion q is represented by 32 bits. Therefore, although it is necessary to add mode information 201 indicating which of the three modes is selected by compression in mode 2, this mode information 201 is represented by 2 bits, so that the total data size can be reduced compared to the case without compression.
[0114] 8A, a predetermined header is added to generate a packet, and the packet is transmitted from the controller to the main device 2. The main device 2 receives the packet including the first compressed data 210, restores f0, f1, and f2 from the received Δf0, Δf1, and f2, and further restores q0, q1, and q2 based on the formula 2 and the omission information 202.
[0115] In mode 2, more bits are assigned to f2 than Δf0 and Δf1. Therefore, f2 can be transmitted to the main unit 2 with an amount of information close to that of f2 (32 bits) before compression, and more accurate information on the attitude of the controller can be transmitted to the main unit 2. For example, if f0, f1, and f2 are expressed with the same number of bits, as in mode 0 described below, on the premise that the total data amount of the attitude data is kept below the total data amount (123 bits) by the compression method of mode 2, f0, f1, and f2 will each be expressed with 13 bits (because 13 bits x 3 components x 3 = 117, 14 bits x 3 components x 3 = 126). In this case, f2 (and f1 and f0 as well) is compressed from 32 bits to 13 bits, so more information is lost. In that case, the attitude of the controller cannot be accurately restored in the main unit 2 based on the compressed f0, f1, and f2. For example, when a game object is displayed on the main unit 2 so as to match the attitude of the controller, the game object may appear to be shaking slightly even though the controller is actually stationary, because the main unit 2 cannot accurately restore the attitude of the controller. However, in the compression method of mode 2, more bits are allocated to f2, so the amount of information lost when f2 is compressed can be reduced. This allows the attitude of the controller to be restored more accurately in the main unit 2.
[0116] In addition, in mode 2, since the controller is selected while stationary, the value of each component of Δf0, which is the difference between f2 and f0, is relatively small. Therefore, even if the amount of data is relatively small (specifically, 13 bits), this relatively small value can be expressed.
[0117] Similarly, in mode 2, f1 is not transmitted as is to the main device 2, but Δf1, which is the difference between f1 and the average of f2 and f0, is transmitted to the main device 2. In mode 2, since the controller is selected while stationary, the value of each component of Δf1 is relatively small. Therefore, this relatively small value can be expressed even with a relatively small amount of data (specifically, 4 bits).
[0118] (Mode 1 explanation) Returning to Fig. 5, mode 1 is a mode that is selected when the attitude of the controller is changing linearly (the attitude is not changing rapidly). Here, the state in which the attitude of the controller is changing linearly is a state in which the components q0, q1, and q2 are increasing or decreasing at approximately the same rate. That is, for example, in Fig. 7, f0, f1, and f2 are lined up in a straight line in a diagonal direction.
[0119] Specifically, mode 1 is a mode that is selected when the above first condition (first condition A and first condition B) is not satisfied and the second condition is satisfied. The second condition is satisfied when the following second condition A and second condition B are satisfied.
[0120] That is, one of the second conditions (written as second condition A) is that the components of q0 and q2, which are the same as the maximum component of q1 (the component with the maximum absolute value), are greater than a predetermined value. For example, when the maximum component of q1 is "x", if the x components of q0 and q2 are greater than a predetermined value (a predetermined value greater than 0, for example, "0.5"), the second condition A is satisfied. This second condition A is a condition for ensuring that each component of q to be compressed is less than 1. For example, when the maximum component of q1, q0, and q2 is x, the w, y, and z components of q1, q0, and q2 are compressed (vectors f1, f0, and f2 having w, y, and z components are compressed). When the maximum components of q1, q0, and q2 are greater than a predetermined value, the remaining components are less than "1" according to formula 2. If the maximum components of q1, q0, and q2 are 0, the remaining components may be "1" (or close to "1"). When compressing values of "1" or close to "1", the compression accuracy may be reduced. Therefore, in order to ensure the compression accuracy, it is determined whether or not the second condition A is satisfied. Note that, in reality, the data to be compressed is not each component of q, but each component of f obtained by converting q to an integer, but here the components of q are described as being compressed. If the second condition A is not satisfied, mode 1 is not selected, and mode 0 is selected.
[0121] If it is determined that the second condition A is satisfied, then it is determined whether or not the second condition B is satisfied. The second condition B is that each component of Δf1 calculated by Equation 6 can be expressed in 8 bits. Specifically, the second condition B is that the value of each component of Δf1 is within the range of -128 to 127. The fact that each component of Δf1 can be expressed in 8 bits means that each component of Δf1 has a relatively small value. This means that for each component, the value of the central sample f1 is not too far from the average value of f0 and f2. In other words, the determination of whether or not the second condition (the second condition A and the second condition B) is satisfied can be said to be a determination of whether or not f0, f1, and f2 have linearity.
[0122] When each component of Δf1 can be expressed in 8 bits, mode 1 is selected. When mode 1 is selected, f0, f1, and f2 are compressed using a compression method different from that of mode 2, and second compressed data is generated.
[0123] Fig. 8B is a diagram showing an example of the data structure of second compressed data generated when mode 1 is selected. As in Fig. 8A, second compressed data 220 generated when mode 1 is selected includes a time stamp 200, mode information 201, and omission information 202. When mode 1 is selected, for example, "1" is set as the mode information 201.
[0124] The second compressed data 220 also includes an orientation data section 203 that stores f0 (three components), an orientation data section 204 that stores Δf1 (three components), and an orientation data section 205 that stores f2 (three components).
[0125] Each of the components f0 and f2 is compressed from 32 bits to 16 bits. Specifically, in mode 1, f2 is assigned 16 bits x 3 components = 48 bits, and f0 is assigned 16 bits x 3 components = 48 bits.
[0126] Furthermore, with regard to f1, the controller compresses each component of Δf1 calculated based on the above formula 6 from 32 bits to 8 bits. That is, 8 bits×3 components=24 bits are allocated to Δf1.
[0127] As shown in FIG. 8B, in the case of mode 1, the second compressed data 220 also includes the omitted information 202 common to f0, Δf1, and f2. In mode 1, the attitude of the controller is changing linearly. Therefore, for q0, q1, and q2, the component with the maximum absolute value among the four components is common, and therefore the omitted information 202 is common to f0, Δf1, and f2. Therefore, in mode 1, as in mode 2, one omitted information 202 common to the three, f0, f1, and f2, is transmitted to the main unit 2.
[0128] The data size of the posture data portion (f0, Δf1, f2) of the second compressed data 220 in mode 1 shown in FIG. 8B is 16×3+8×3+16×3=120 bits.
[0129] (Mode 0 explanation) Returning to FIG. 5, mode 0 is a mode that is selected when the first condition (first condition A and first condition B) and the second condition (second condition A and second condition B) are not satisfied. In other words, mode 0 is selected when mode 2 is not selected and mode 1 is not selected either. Mode 0 is selected when the controller is in an arbitrary state (for example, a state in which the attitude of the controller is changing rapidly in a short period of time). When mode 0 is selected, f0, f1, and f2 are compressed, and third compressed data is generated.
[0130] Fig. 8C is a diagram showing an example of the data structure of the third compressed data generated when mode 0 is selected. As shown in Fig. 8C, when mode 0 is selected, the third compressed data 230 includes a time stamp 200 and mode information 201, similar to modes 2 and 1. When mode 0 is selected, for example, "0" is set as the mode information 201.
[0131] As shown in FIG. 8C, the third compressed data 230 of mode 0 includes omission information 202a, omission information 202b, and omission information 202c. The omission information 202a is omission information related to f0, and indicates which of the four components of q0 has been omitted. For example, when the w component of the four components w, x, y, and z has been omitted, "0" may be stored in the omission information 202a, and when the x component has been omitted, "1" may be stored in the omission information 202a. Similarly, the omission information 202b is omission information related to f1, and indicates which of the four components of q1 has been omitted. Moreover, the omission information 202c is omission information related to f2, and indicates which of the four components of q2 has been omitted.
[0132] Mode 0 is a mode selected when the controller is not stationary and the change in the attitude of the controller is not linear, for example, when the attitude of the controller is changing rapidly. In this case, the maximum component among the four components may be different for q0, q1, and q2. For example, for q0, the component with the maximum absolute value may be the x component, and for q1, the component with the maximum absolute value may be the y component. Therefore, when mode 0 is selected, the maximum component (the component with the maximum absolute value) is omitted for each of f0, f1, and f2. Therefore, omission information 202 is set for each of f0, f1, and f2.
[0133] When mode 0 is selected, each of the components f0, f1, and f2 is compressed from 32 bits to 13 bits. Specifically, 13 bits x 3 components = 39 bits are assigned to f0, 13 bits x 3 components = 39 bits are assigned to f1, and 13 bits x 3 components = 39 bits are assigned to f2.
[0134] The data size of the posture data portion (f0, f1, f2) of the third compressed data 220 in mode 0 shown in FIG. 8C is 13×3×3=117 bits.
[0135] FIG. 9 is a diagram showing a comparison between the posture data before compression when the posture data is compressed in mode 2 and the posture data after the compressed posture data is transmitted to the main unit and restored according to the main unit.
[0136] The dashed line in Fig. 9 indicates the value of the quaternion q (one of the four components of q) before compression calculated in the controller, and the solid line in Fig. 9 indicates the value of the quaternion q (one of the four components of q) after restoration in the main unit 2.
[0137] As shown in Fig. 9, even when the controller is stationary, the inertial sensor 43 may detect a slight angular velocity, causing the pre-compression attitude data (dashed line) to fluctuate slightly. This attitude data calculated in the controller is compressed in mode 2 and transmitted to the main unit 2. The main unit 2 restores the compressed attitude data. As shown in Fig. 9, this restored attitude data may deviate slightly from the pre-compression attitude data, but the restored attitude data in the main unit 2 and the pre-compression attitude data calculated in the controller are almost the same.
[0138] Although not shown in the figure, if, when the controller is stationary, the posture data is not compressed in mode 2 but is compressed in mode 0, the deviation between the posture data before compression and the restored posture data will be larger than the deviation shown in FIG.
[0139] Furthermore, although not shown in the figure, when the controller posture changes linearly, the deviation between the posture data before compression and the restored posture data is smaller when the posture data is compressed in mode 1 than when the posture data is compressed in mode 0.
[0140] In this manner, in this embodiment, the posture data is compressed in different ways depending on the state of the controller. Specifically, the posture data is compressed in different ways depending on the state determined based on data from the inertial sensor 43 of the controller. This allows the posture data to be accurately restored in the main unit 2.
[0141] (Details of controller processing) Next, the details of the processing performed in the controller will be described. First, the data stored in the controller will be described. Fig. 10 is a diagram showing an example of the data stored in the controller.
[0142] As shown in FIG. 10, the controller (the memory 42 or the flash memory 45) stores a control program, sensor data, attitude data, and compressed data.
[0143] The control program includes a program for calculating q, which represents the attitude of the controller, based on the output from the inertial sensor 43, a program for controlling communication between the controller and the main unit 2, a program for selecting one of the above-mentioned modes, a program for compressing f in the selected mode, a program for generating the compressed data shown in Figures 8A to 8C, and a program for transmitting the compressed data to the main unit 2.
[0144] The sensor data is data that indicates the angular velocity values around each axis output from the inertial sensor 43.
[0145] The attitude data is data indicating a quaternion q that represents the attitude of the controller calculated based on the output from the inertial sensor 43. The attitude data includes at least three samples (q0, q1, q2). The quaternion q has four components: w, x, y, and z. The attitude data also includes a vector f in which one of the four components of q is omitted, and includes f0 corresponding to q0, f1 corresponding to q1, and f2 corresponding to q2.
[0146] Moreover, the compressed data is data obtained by compressing f0, f1, and f2, and is data transmitted from the controller to the main unit 2. Specifically, the compressed data is data shown in Figs. 8A to 8C.
[0147] Next, the details of the processing performed in the controller will be specifically described. Fig. 11 is a flow chart showing an example of the processing performed in the controller. The processing shown in Fig. 11 is performed by the processing unit 41 of the controller executing a control program. Note that Fig. 11 shows only the processing related to the calculation and transmission of the attitude data, but the controller also executes other processing (such as processing related to operation data corresponding to the operation of the buttons and analog stick) in addition to these processing.
[0148] 11, the controller (processing unit 41) acquires angular velocity values around each axis from the inertial sensor 43 (step S100). Next, the controller calculates and acquires a quaternion q representing the attitude of the controller based on the acquired angular velocity values (step S101).
[0149] Following step S101, the controller determines whether it is time to communicate with the main unit 2 (step S102). If it is not time to communicate with the main unit 2 (step S102: NO), the controller executes the process of step S100 again. In this embodiment, the processes of steps S100 to S102 are repeated at intervals of 1 / 800 seconds. Furthermore, in step S102, if the processes of steps S100 to S102 have been performed four times, the result is determined as YES. That is, in this embodiment, acquisition of angular velocity values from the inertial sensor 43 and acquisition of "q" representing the attitude are performed at intervals of 1 / 800 seconds, and the processes from step S103 onwards are repeated at intervals of 1 / 200 seconds.
[0150] If the result of the determination in step S102 is YES, the controller performs a thinning process (step S103). Here, the controller extracts the latest q calculated in step S101.
[0151] Following step S103, the controller determines whether or not a first condition for selecting mode 2 is satisfied (step S104). In this embodiment, the first condition includes a first condition A and a first condition B. The first condition A is that the difference between f2 and f0 is less than a predetermined value. Specifically, the controller first selects a component (e.g., w component) with the largest absolute value among the four components of the quaternion q1, and sets f1 (e.g., a vector having three components x, y, and z) with the largest component omitted. In addition, for q2 and q0, the controller sets f2 and f0 with the same component (e.g., w component) omitted. Then, the controller calculates a difference vector between f2 and f0, and determines, as the first condition A, whether or not the norm of the difference vector is less than a predetermined value. Note that q2 may be the latest q calculated in step S101. Also, q1 may be the q calculated in step S101 immediately before q2 (i.e., the q calculated 1 / 800 seconds ago), and q0 may be the q calculated in step S101 immediately before q1 (i.e., the q calculated 1 / 800 seconds ago). Also, q2 may be the latest q calculated in step S101, q1 may be the q extracted in step S103 before q2 (i.e., the q calculated 1 / 200 seconds ago), and q0 may be the q extracted in step S103 before q1 (i.e., the q calculated 1 / 200 seconds ago).
[0152] If the controller determines that the first condition A is satisfied, it further determines whether or not the first condition B is satisfied in step S104. Specifically, the controller calculates the average of f2 and f0, and calculates the difference between f1 and the average as Δf1. Then, the controller determines, as the first condition B, whether or not the norm of Δf1 is less than a predetermined value.
[0153] When it is determined that the first condition A or the first condition B is not satisfied (step S104: NO), the controller determines whether or not the second condition for selecting mode 1 is satisfied (step S105). Specifically, the controller first determines whether or not the second condition A is satisfied. The second condition A is that the components of q0 and q2, which are the same as the maximum component (absolute value) of q1, are greater than a predetermined value. For example, when the maximum component (absolute value) of q1 is w, the controller determines whether or not the w components of q0 and q2 are greater than a predetermined value. When it is determined that the second condition A is not satisfied, the controller determines NO in step S105. On the other hand, when it is determined that the second condition A is satisfied, the controller further determines whether or not the second condition B is satisfied. The second condition B is that Δf1 can be expressed in 8 bits (within the range of -128 to 127). If the controller determines that the second condition B is satisfied, the result in step S105 is YES, and if the controller determines that the second condition B is not satisfied, the result in step S105 is NO.
[0154] If the determination in step S104 is YES, the controller selects mode 2 and compresses the posture data in the selected mode 2 (step S106). Specifically, as described above, the controller compresses each component of f2 to 24 bits, each component of Δf0, which is the difference between f2 and f0, to 13 bits, and each component of Δf1 to 4 bits. Then, the controller generates first compressed data including these compressed data.
[0155] If the result of the determination in step S105 is YES, the controller selects mode 1 and compresses the posture data in the selected mode 1 (step S107). Specifically, as described above, the controller compresses each component of f2 to 16 bits, each component of f0 to 16 bits, and each component of Δf1 to 8 bits. Then, the controller generates second compressed data including these compressed data.
[0156] If the result of the determination in step S105 is NO, the controller selects mode 0 and compresses the posture data in the selected mode 0 (step S108). Specifically, as described above, the controller compresses each component of f0 to 13 bits, each component of f1 to 13 bits, and each component of f2 to 13 bits. In addition, in step S108, the controller sets omission information 202a to 202c indicating which components are to be omitted for each of q0, q1, and q2. For example, when the controller determines that the x component is to be omitted for q0, the controller sets "1" to the omission information 202a, sets f0 having three components w, y, and z, and compresses each component of f0 to 13 bits. When the controller determines that the y component is to be omitted for q1, the controller sets "2" to the omission information 202b, sets f1 having three components w, x, and z, and compresses each component of f1 to 13 bits. If it is determined that the z component of q2 is omitted, the omission information 202c is set to "3", f2 having three components w, x, and y is set, and each component of f2 is compressed to 13 bits. Then, the controller generates third compressed data including the compressed data for f0, f1, and f2 and the omission information.
[0157] When any one of the processes in steps S106 to S108 has been performed, the controller generates a packet including compressed data, and transmits the generated packet to the main device 2 (step S109).
[0158] (An example of processing performed in the main unit 2) Next, a description will be given of an example of processing performed by the main unit 2. Fig. 12 is a flowchart showing an example of processing performed by the main unit 2. Note that the processing shown in Fig. 12 is repeatedly executed at predetermined time intervals (for example, 1 / 200 second intervals).
[0159] As shown in FIG. 12, the main unit 2 receives a packet from the controller (step S201). Upon receiving the packet from the controller, the main unit 2 restores the posture data f from the received packet (step S202). Specifically, the main unit 2 analyzes the received packet and determines in which mode the packet was compressed based on the mode information 201. The main unit 2 then restores the posture data f0, f1, and f2 using a method according to the compression mode. For example, if compressed in mode 2, the main unit 2 expands each component of f2 from 24 bits to 32 bits. In this case, the main unit 2 calculates f0 based on f2 and Δf0, and expands each component of f0 to 32 bits. The main unit 2 then restores f1 based on f2, f0, and Δf1, and expands each component of f1 to 32 bits.
[0160] Next, the main unit 2 calculates q from the posture data f (step S203). Specifically, the main unit 2 determines which components are omitted based on the omission information 202 included in the packet, calculates the omitted components, and restores the quaternion q. For example, when the posture data is compressed in mode 2 or mode 1, the main unit 2 calculates the omitted components based on the omission information 202 common to f0, f1, and f2, and restores q0, q1, and q2. When the posture data is compressed in mode 0, the main unit 2 calculates the omitted components of f0 based on the omission information 202a corresponding to f0, and restores q0. Similarly, the main unit 2 calculates the omitted components of f1 based on the omission information 202b corresponding to f1, and restores q1. The main unit 2 calculates the omitted components of f2 based on the omission information 202c corresponding to f2, and restores q2.
[0161] Then, the main unit 2 executes a process based on the restored attitude data q (step S204). For example, the process based on the attitude data q may be a process for controlling a virtual camera in a virtual space. Alternatively, the process based on the attitude data q may be a process for controlling a user object in a virtual space.
[0162] The processes shown in the above flowcharts are merely examples, and the order and contents of the processes may be changed as appropriate. Furthermore, the values used in each process and determination may be changed.
[0163] FIG. 13 is a diagram showing an example of a change in the attitude of the controller and a selected mode. The horizontal axis of FIG. 13 indicates time, and the vertical axis indicates q (one of the four components of q) which represents the attitude. In addition, a thick line indicating a mode selected by the above-mentioned method is shown in the upper part of the figure. Specifically, three thick lines are shown in the upper part of the figure, arranged in a top, middle, and bottom order. Of the three thick lines, the bottom thick line indicates a state in which mode 2 is selected, the middle thick line indicates a state in which mode 1 is selected, and the top thick line indicates a state in which mode 0 is selected.
[0164] For example, up to time T1, the controller is in a stationary state, and the value of q is approximately "0". Up to this time T1, mode 2 is selected. If the controller is swung by the user at time T1, the posture of the controller changes, and the value of q changes as shown in FIG. 13. From time T1 to T2, the controller is swung relatively slowly, and during this time, mode 1 is selected. Furthermore, at time T2, the controller is detected as being in a stationary state for an instant, and mode 2 is selected. From time T2 to time T3, the controller is swung slowly again, and mode 1 is selected. Next, if the controller is swung violently from time T3 to T4, the posture of the controller changes suddenly. During this period from T3 to T4, mode 0 is selected. Furthermore, from time T4 to T5, the controller is swung slowly again, and mode 1 is selected. If the controller is swung violently at time T5, mode 0 is selected.
[0165] Thus, in this embodiment, each time communication is performed between the controller and the main unit 2, one of a plurality of modes is selected depending on the state of the controller at that time (specifically, the state determined based on the output from the inertial sensor 43).
[0166] As described above, in this embodiment, one of a plurality of modes is selected depending on the state of the controller (specifically, the angular velocity value output from the inertial sensor 43 at that time), and the attitude data is compressed by a method corresponding to the selected mode. Specifically, the mode is selected depending on whether the controller is stationary, the attitude of the controller is changing linearly, or neither of the above states.
[0167] For example, when the controller is stationary, mode 2 is selected, and the three pieces of posture data are compressed to generate first compressed data such that the data size of one of the three posture data is larger than the data size of the other posture data. The generated first compressed data is then transmitted to the main unit 2. When mode 2 is not selected, it is determined whether the posture of the controller is changing linearly, and if it is determined that the posture of the controller is changing linearly, mode 1 is selected, and the three posture data are compressed by a method corresponding to mode 1.
[0168] Specifically, the controller of this embodiment acquires a first value (e.g., f0) related to the attitude of the controller based on the output from the inertial sensor 43 at a first timing. The controller also acquires a second value (e.g., f2) related to the attitude of the controller based on the output from the inertial sensor 43 at a second timing different from the first timing. The controller then determines whether a first condition (e.g., the above formulas 4 and 5) is satisfied, and if it is determined that the first condition is satisfied, compresses at least one of the first value (e.g., f0) and the second value (e.g., f2) by a first method (mode 2 method). If it is determined that the first condition is not satisfied, the controller compresses the first value and the second value by a second method (mode 1 method or mode 0 method) different from the first method.
[0169] In this way, the controller of this embodiment compresses data in different ways depending on whether the first condition is satisfied, and can dynamically select an appropriate compression method depending on the state of the controller to compress the data related to the attitude. Specifically, the data related to the first value (e.g., f0 or q0) and the data related to the second value (e.g., f2 or q2) are compressed so that the amount of data of either one of them is larger than the amount of data of the other. In other words, the data related to the attitude is compressed so that the compression rate of one of the data is lower than the compression rate of the other data. This makes it possible to reduce the amount of information lost for one of the data compared to the other data, and to accurately restore the attitude of the controller in the main unit 2 while reducing the overall amount of data transmitted to the main unit 2.
[0170] Furthermore, when the controller determines that the first condition is not satisfied, it determines whether or not a second condition (second condition A and second condition B) different from the first condition is satisfied, and when it determines that the second condition is satisfied, it compresses the data by the second method. In the second method, the controller compresses the data related to the first value and the data related to the second value at the same compression rate. Furthermore, the controller compresses the data related to the third value (q1) based on the output from the inertial sensor 43 at a third timing different from the first and second timings so that the data amount is smaller than that of the data related to the first value and the data related to the second value. When the second condition is satisfied, the first value, the second value, and the third value have linearity. Since these values have linearity, if two values are known in the main unit 2, the remaining one value can be accurately estimated. Therefore, in this case, the data related to the first value and the data related to the second value are compressed at a relatively low compression rate, and the data related to the third value at the third timing (more specifically, the timing between the first and second timings) is compressed at a relatively high compression rate. This allows the overall amount of data to be reduced while the attitude of the controller in the main unit 2 can be accurately restored.
[0171] In addition, in this embodiment, the controller calculates the attitude of the controller based on the angular velocity value and transmits the calculated attitude to the main unit 2, so that even if a packet from the controller to the main unit 2 is dropped, the error can be reduced. For example, when the angular velocity value detected by the inertial sensor 43 is transmitted from the controller to the main unit 2, the main unit calculates the attitude of the controller by integrating the received angular velocity value. In this case, if a packet is dropped, the main unit cannot calculate the attitude of the controller, and errors accumulate every time a packet is dropped. In contrast, when the attitude is calculated on the controller side and the calculated attitude is transmitted to the main unit 2 as in the above embodiment, errors do not accumulate even if a packet is dropped. By receiving the attitude calculated by the controller, the main unit 2 can know the accurate attitude of the controller at the time of receiving the packet, even if a packet is dropped.
[0172] Furthermore, in this embodiment, time information is included in the compressed data transmitted from the controller to the main unit 2. Therefore, even if a packet is dropped, the main unit 2 can accurately know the time information at the time when the attitude was calculated in the controller.
[0173] In addition, in this embodiment, the controller calculates the attitude based on the angular velocity values sampled at 800 Hz, and transmits the calculated attitude to the main unit 2 at 200 Hz. This allows the main unit 2 to acquire the attitude of the controller with higher accuracy than when the attitude is calculated on the main unit side, without increasing the frequency of communication between the main unit 2 and the controller. For example, assume that the sampling frequency of the angular velocity values is 800 Hz, and the frequency of communication between the main unit 2 and the controller is 200 Hz. In this case, when transmitting the angular velocity values from the inertial sensor 43 to the main unit 2 and calculating the attitude on the main unit side, the controller may transmit one of the four angular velocity values sampled at 800 Hz to the main unit 2, or may average the four angular velocity values sampled at 800 Hz and transmit the average to the main unit 2. In either case, since the attitude is calculated at 200 Hz, there is a certain limit to the accuracy of the attitude of the controller calculated on the main unit side. On the other hand, in this embodiment, since the controller calculates the attitude at 800 Hz, the attitude of the controller can be acquired with high accuracy on the main unit side.
[0174] (Modification) The posture data compression method of this embodiment has been described above, but the following modifications may be made to the above embodiment.
[0175] For example, in the above embodiment, the first value acquired based on the output from the inertial sensor 43 at the first timing is a quaternion q0 (or f0) representing the attitude of the controller, which is calculated based on the angular velocity value from the inertial sensor 43. The first value may be the angular velocity value itself output from the inertial sensor 43. The same applies to the second value acquired based on the output from the inertial sensor 43 at the second timing and the third value acquired based on the output from the inertial sensor 43 at the third timing.
[0176] In the above embodiment, whether the first condition and the second condition are satisfied is determined based on vector f having three components out of four components of quaternion q representing the attitude of the controller, and a mode is selected. Then, f is compressed in the selected mode and transmitted from the controller to the main unit 2. In another embodiment, whether the first condition and the second condition are satisfied is determined based on q having four components, q is compressed in the selected mode, and transmitted from the controller to the main unit 2. Also, the condition for selecting a mode may be determined based on q, and f is compressed and transmitted in the selected mode.
[0177] In the above embodiment, the attitude of the controller is represented by q (a vector having three components representing the rotation axis and one component representing the rotation angle), but in other embodiments, the attitude of the controller may be represented in other formats. For example, the attitude of the controller may be represented using Euler angles, and attitude data relating to the attitude represented using the Euler angles may be compressed by a method corresponding to one of the multiple modes described above, and transmitted to the main unit 2.
[0178] In the above embodiment, Δf1 was calculated based on the first acquired value (f0), the second acquired value (f1), and the third acquired value (f2) (Equation 6 above). Then, Δf1 was used to determine each mode. For example, in determining whether f0, f1, and f2 have linearity (determining whether the second condition B is satisfied), it was determined whether each component of Δf1 is within a predetermined range. In other embodiments, whether f0, f1, and f2 have linearity may be determined using other methods.
[0179] The term "linearity" used here means that the first acquired value (f0), the second acquired value (f1), and the third acquired value (f2) increase or decrease at a substantially constant rate. For example, when f, which represents the posture, has x-, y-, and z-axis components, the values of the x-, y-, and z-axis components increase or decrease at a constant rate. Whether or not these values have linearity can be determined without using the above formula 6. For example, it can be determined by whether or not the distance between the straight line connecting the first acquired value (the value of each component of f0) and the second acquired value (the value of each component of f1) and the third acquired value (the value of each component of f2) is less than a predetermined value.
[0180] In the above embodiment, the first condition for selecting mode 2 is that the above formula 4 and formula 5 are satisfied, but the first condition is not limited to this. For example, it may be determined whether the first condition A is satisfied based on a comparison between the first value (f0) and the second value (f2). It may also be determined that the first condition is satisfied when the amount of change in the attitude of the controller is less than a predetermined value. The determination that the amount of change in the attitude of the controller is less than the predetermined value may be performed by other methods, not limited to formula 4. For example, it may be determined that the first condition is satisfied when the absolute value of the acquired angular velocity value around each axis is less than a predetermined value (0 or a very small value). In this case, it is possible to determine whether the first condition is satisfied based on the angular velocity value output from the inertial sensor 43 at a certain point in time. That is, in the above embodiment, it is determined whether the first condition is satisfied based on at least the output from the inertial sensor 43 at both the first timing and the second timing, but in other embodiments, it may be determined whether the first condition is satisfied based on the output from the inertial sensor 43 at at least one of the first timing and the second timing.
[0181] For example, when the attitude of the controller at a certain point in time is calculated, if the angular velocity values about the three axes from the inertial sensor 43 acquired thereafter are approximately "0", it can be determined that the controller is approximately stationary. Therefore, the controller can determine whether or not Mode 2 is applicable based on the angular velocity values from the inertial sensor 43, not based on Equations 4 and 5.
[0182] Furthermore, the first condition for selecting mode 2 is not limited to the controller being in a stationary state, but may be the controller being in a predetermined state.
[0183] Moreover, the second condition for selecting mode 1 may be any condition as long as it is a condition for determining whether or not the attitude of the controller is changing linearly. Whether or not the attitude of the controller is changing linearly can be determined by other methods, not limited to the above. For example, if the difference between the angular velocity value of each axis from the inertial sensor 43 at a certain timing and the angular velocity value of each axis from the inertial sensor 43 at the next timing is "0" or within a predetermined range, it can be determined that the attitude of the controller is changing at a constant rate, and it can be determined that the attitude of the controller is changing linearly.
[0184] Also, in the above embodiment, one of the multiple modes is selected according to the state of the controller determined from the inertial sensor 43. In other embodiments, one of the multiple modes may be selected according to the state of the controller determined from something other than the output from the inertial sensor 43. For example, the state of the controller may be determined based on an image from a camera, and one of the multiple modes may be selected according to the determined state of the controller.
[0185] In the above embodiment, when mode 2 is selected, f2 is compressed to 24 bits, the difference between f2 and f0 is calculated as Δf0, and Δf0 is compressed to 13 bits, and Δf1 (the above formula 6) is calculated and Δf1 is compressed to 4 bits. The compression method when mode 2 is selected is merely an example, and the size of each data after compression is not limited to this. When mode 2 is selected, the three data may be compressed by other compression methods. For example, f2 may be uncompressed to 32 bits, and Δf0 and / or Δf1 may be compressed to a smaller number of bits than the above. When mode 2 is selected, for example, f0 may be compressed to 24 bits (or f0 may not be compressed), Δf2, which is the difference between f0 and f2, may be compressed to 13 bits (or a smaller number of bits), and Δf1 may be compressed to 4 bits (or a smaller number of bits). Then, compressed data including these f0, Δf1, and Δf2 may be transmitted to the main device 2. Also, f0 and f1 may be compressed separately without calculating Δf0 and Δf1. That is, when mode 2 is selected, the three pieces of data f0, f1, and f2 may be compressed so that one piece of data is larger than the other pieces of data.
[0186] In the above embodiment, when mode 1 is selected, f0 and f2 are compressed to 16 bits, and Δf1 is compressed to 8 bits. The compression method when mode 1 is selected is merely an example, and the size of each data after compression is not limited to this. When mode 1 is selected, the three data may be compressed by other compression methods. For example, f0 and f1 may be compressed to 16 bits, Δf2 may be calculated, and Δf2 may be compressed to 8 bits. This Δf2 may be calculated based on f0, f1, and f2, and may be data representing the difference between the value of f2 estimated based on the linearity of f0 and f1 and the value of f2 actually calculated based on the angular velocity value. Then, the compressed data including these f0, f1, and Δf2 may be transmitted to the main unit 2.
[0187] In the above embodiment, when mode 2 or mode 1 is selected, the difference between the average of f0 and f2 and f1 is calculated as Δf1, and the calculated Δf1 is compressed and transmitted to the main device 2. In other embodiments, a predetermined reference value may be calculated based on at least two of f0 (or q0), f1 (or q1), and f2 (or q2) without being limited to the average of f0 and f2. Then, based on the calculated reference value, data related to at least one of f0 (or q0), f1 (or q1), and f2 (or q2) may be set and the at least one data may be compressed. For example, a value indicating how far f0, f1, and f2 are from the calculated reference value may be set, and data indicating the set value may be compressed and transmitted to the main device 2.
[0188] In the above embodiment, a determination is made as to which of modes 0 to 2 to select based on the first acquired data (f0), the second acquired data (f1), and the third acquired data (f2), and these three pieces of data are compressed in a mode according to the determination result and transmitted to the main device 2. In other embodiments, a determination is made as to which of modes 0 to 2 to select based on two pieces of data, and the two pieces of data may be compressed and transmitted.
[0189] In other embodiments, the number of modes is not limited to three, but may be two, or may be four or more.
[0190] In the above embodiment, the controller calculates a value related to the attitude of the controller based on the angular velocity value from the inertial sensor, selects a mode according to the state of the controller, and compresses and transmits the data related to the attitude by a method according to the mode. In another embodiment, a value related to the position of the controller (amount of movement in each axis direction) may be calculated based on the acceleration value from the inertial sensor, selects a mode according to the state of the controller, and compresses and transmits the data related to the position by a method according to the mode. The controller can calculate the velocity of the controller in each axis direction by integrating the acceleration value from the inertial sensor, and calculate the position (amount of movement) in each axis direction from the calculated velocity. In this case, the above-mentioned q and f representing the attitude are replaced with vectors representing positions, and each condition for selecting a mode (first condition A, first condition B, second condition A, second condition B) is also determined based on the vectors representing positions.
[0191] Furthermore, in the above embodiment, when the controller and main unit 2 are connected wirelessly, a mode is selected according to the state of the controller, and data relating to the attitude of the controller is compressed using a compression method according to the selected mode and transmitted to the main unit 2. The above mode selection and data compression according to the selected mode may also be performed when the controller and main unit 2 are connected by wire (i.e., when the controller is attached to the main unit 2).
[0192] In the above embodiment, the data related to the posture is compressed and transmitted from the controller to the main unit. In other embodiments, the above-mentioned mode selection and data compression may be performed in any other device, not limited to the controller, and the data may be transmitted to the other device. For example, the above-mentioned mode selection and data compression may be performed in any device, such as a smartphone, a tablet device, a laptop computer, a wearable device, a sensor, etc., and the data may be transmitted to the other device.
[0193] In the above embodiment, it is assumed that the controller and the main unit 2 are locally connected, but in other embodiments, an arbitrary device such as the controller may be remotely connected to another device. In the arbitrary device, the above-mentioned mode may be selected and data may be compressed according to the selected mode, and the compressed data may be transmitted from the arbitrary device to another device via the Internet, for example.
[0194] Although the present invention has been described above, the above description is merely an example of the present invention, and various improvements and modifications may be made. [Explanation of symbols]
[0195] 1. Information Processing Systems 2 Main Unit 3 Left Controller 4 Right Controller 21 Processors 23 Controller communication section 41 Processing section 43 Inertial Sensor 45 Communication control section
Claims
1. An information processing device having an inertial sensor, a first acquisition means for acquiring a first value related to an attitude of the information processing device based on an output from the inertial sensor at a first timing; a second acquisition means for acquiring a second value related to an attitude of the information processing device based on an output from the inertial sensor at a second timing different from the first timing; a first compressed data generating means for generating, when the information processing device is stationary, first compressed data including data relating to the first value and data relating to the second value by a first compression method based on at least a difference between the first value and the second value, regardless of whether the first value and the second value are the same or not; a second compressed data generating means for generating second compressed data including the data relating to the first value and the data relating to the second value by a second compression method different from the first compression method when the information processing device is not stationary; a transmitting unit configured to transmit the first compressed data or the second compressed data to another device.
2. The first compressed data generating means generates the first compressed data even when the information processing device is capable of communicating with the other device, The information processing apparatus according to claim 1 , wherein said second compressed data generating means generates said second compressed data even when said information processing apparatus is capable of communicating with said other apparatus.
3. The information processing apparatus according to claim 1 , further comprising a first determination means for determining whether or not the information processing apparatus is stationary based on at least a difference between the first value and the second value.
4. a third acquisition means for acquiring a third value related to an attitude of the information processing device based on an output from the inertial sensor at a third timing different from the first timing and the second timing; 4. The information processing device according to claim 1, further comprising: a first determination means for determining whether the information processing device is stationary or not based on a difference between an average of the first value and the second value and the third value.
5. The information processing device according to claim 1 , further comprising a first determination means for determining whether or not the information processing device is stationary by determining whether or not an amount of change in the attitude of the information processing device is less than a predetermined value.
6. 6. The information processing device according to claim 1, wherein the first compressed data generating means generates the first compressed data as the first compression method so that a data amount of the data relating to the second value is greater than a data amount of the data relating to the first value.
7. a third acquisition means for acquiring a third value related to an attitude of the information processing device based on an output from the inertial sensor at a third timing different from the first timing and the second timing; 7. The information processing device according to claim 1, wherein the first compressed data generating means generates data relating to the third value that is set based on the first value, the second value, and the third value, and generates the first compressed data further including the data relating to the generated third value.
8. 8. The information processing device according to claim 7, wherein, as the first compression method, the first compressed data generation means generates the data relating to the first value and the data relating to the second value so that a data amount of the data relating to the second value is larger than a data amount of the data relating to the first value, and further generates the data relating to the third value so that a data amount of the data relating to the first value is smaller than that of the data relating to the first value, and generates the first compressed data including the generated data relating to the first value, the data relating to the second value, and the data relating to the third value.
9. 9. The information processing device according to claim 8, wherein the first compressed data generating means generates the first compressed data by setting the second value to the data relating to the generated second value, setting a difference between the first value and the second value to the data relating to the generated first value, and setting a difference between an average of the first value and the second value and the third value to the data relating to the generated third value.
10. a second determination means for determining whether or not a predetermined condition regarding whether or not an attitude of the information processing device changes linearly is satisfied based on at least the first value and the second value when the information processing device is not stationary; 10. The information processing apparatus according to claim 1, wherein the second compressed data generating means generates the second compressed data when the second determining means determines that the predetermined condition is satisfied.
11. a third acquisition means for acquiring a third value related to an attitude of the information processing device based on an output from the inertial sensor at a third timing different from the first timing and the second timing; The information processing apparatus according to claim 10 , wherein the second determination means determines whether or not the predetermined condition is satisfied based on whether or not the first value, the second value, and the third value have linearity.
12. The information processing apparatus according to claim 11 , wherein the second determination means determines that the predetermined condition is satisfied at least when a difference between an average of the first value and the second value and the third value is within a predetermined range.
13. The second determination means is Identifying a component having a maximum absolute value among a plurality of components constituting any one of the first value, the second value, and the third value; 13. The information processing device according to claim 11 or 12, further comprising: a component corresponding to the identified component is compared with a predetermined value for two values other than any one of the first value, the second value, and the third value; and based on the comparison result, it is determined whether or not the predetermined condition is satisfied.
14. 14. The information processing device according to claim 11, wherein, as the second compression method, the second compressed data generation means sets data relating to the third value based on an average of the first value and the second value, generates data relating to the third value, and generates the second compressed data including the generated data relating to the third value.
15. a calculation means for calculating a predetermined reference value based on at least two values of the first value, the second value, and the third value; 15. The information processing device according to claim 11, wherein the second compressed data generation means, as the second compression method, sets data relating to at least one of the first value, the second value, and the third value based on the reference value, generates data relating to the at least one value, and generates the second compressed data including the generated data.
16. 16. The information processing device according to claim 11, wherein the second compressed data generation means generates, as the second compression method, the data relating to the first value, the data relating to the second value, and the data relating to the third value such that the data amounts of the data relating to the first value and the data relating to the second value are equal and the data amounts of the data relating to the first value and the data relating to the second value are greater than the data amount of the data relating to the third value.
17. the second timing is a timing subsequent to the first timing, 17. The information processing apparatus according to claim 4, wherein the third timing is a timing between the first timing and the second timing.
18. 17. The information processing device according to claim 10, further comprising a third compressed data generation means for generating third compressed data including data relating to the first value and data relating to the second value by a third compression method different from the first compression method and the second compression method when the second determination means determines that the specified condition is not satisfied.
19. the first value and the second value are data including a plurality of components; the data related to the first value and the data related to the second value are data obtained by omitting at least one component from the plurality of components, The information processing apparatus according to claim 18 , wherein the third compressed data includes information indicating an omitted component of the data related to the first value, and information indicating an omitted component of the data related to the second value.
20. A program executed by a processor of an information processing device having an inertial sensor, the program comprising: a first acquisition means for acquiring a first value related to an attitude of the information processing device based on an output from the inertial sensor at a first timing; a second acquisition means for acquiring a second value related to an attitude of the information processing device based on an output from the inertial sensor at a second timing different from the first timing; a first compressed data generating means for generating, when the information processing device is stationary, first compressed data including data relating to the first value and data relating to the second value by a first compression method based on at least a difference between the first value and the second value, regardless of whether the first value and the second value are the same, for transmission to another device; A program that causes the information processing device to function as a second compressed data generation means that generates, when the information processing device is not stationary, second compressed data including data relating to the first value and data relating to the second value by a second compression method different from the first compression method, for transmission to another device.
21. An information processing system including a first device having an inertial sensor and a second device communicating with the first device, The first device is a first acquisition means for acquiring a first value related to an attitude of the first device based on an output from the inertial sensor at a first timing; a second acquisition means for acquiring a second value related to an attitude of the first device based on an output from the inertial sensor at a second timing different from the first timing; a first compressed data generating means for generating, when the first device is stationary, first compressed data including data relating to the first value and data relating to the second value by a first compression method based on at least a difference between the first value and the second value, regardless of whether the first value and the second value are the same or not; a second compressed data generating means for generating second compressed data including data relating to the first value and data relating to the second value by a second compression method different from the first compression method when the first device is not stationary; a transmitting means for transmitting the first compressed data or the second compressed data to the second device, The second device is An information processing system comprising: a receiving unit that receives the first compressed data or the second compressed data transmitted by the transmitting unit.
22. An information processing method performed in an information processing device having an inertial sensor, comprising: a first acquisition step of acquiring a first value related to an attitude of the information processing device based on an output from the inertial sensor at a first timing; a second acquisition step of acquiring a second value related to an attitude of the information processing device based on an output from the inertial sensor at a second timing different from the first timing; a first compressed data generating step of generating, when the information processing device is stationary, first compressed data including data related to the first value and data related to the second value by a first compression method based on at least a difference between the first value and the second value, regardless of whether the first value and the second value are the same or not; and a second compressed data generation step of generating second compressed data including data relating to the first value and data relating to the second value by a second compression method when the information processing device is not stationary.
23. An information processing device having an inertial sensor, a first acquisition means for acquiring a first value related to an attitude of the information processing device based on an output from the inertial sensor at a first timing; a second acquisition means for acquiring a second value related to an attitude of the information processing device based on an output from the inertial sensor at a second timing different from the first timing; a first determination means for determining whether or not a first condition that is satisfied when the information processing device is stationary is satisfied based on the first value and the second value; a first compressed data generating means for generating first compressed data including data relating to the first value and data relating to the second value by a first compression method when the first determining means determines that the first condition is satisfied, regardless of whether the first value and the second value are the same; a second compressed data generating means for generating second compressed data including data relating to the first value and data relating to the second value by a second compression method different from the first compression method when the first determination means determines that the first condition is not satisfied; a transmitting unit configured to transmit the first compressed data or the second compressed data to another device.
24. A program executed by a processor of an information processing device having an inertial sensor, the program comprising: a first acquisition means for acquiring a first value related to an attitude of the information processing device based on an output from the inertial sensor at a first timing; a second acquisition means for acquiring a second value related to an attitude of the information processing device based on an output from the inertial sensor at a second timing different from the first timing; a first determination means for determining whether or not a first condition that is satisfied when the information processing device is stationary is satisfied based on the first value and the second value; a first compressed data generating means for generating, when the first determining means determines that the first condition is satisfied, first compressed data including data relating to the first value and data relating to the second value by a first compression method, for transmission to another device, regardless of whether the first value and the second value are the same; a program that functions as a second compressed data generation means that, when the first determination means determines that the first condition is not satisfied, generates second compressed data including data relating to the first value and data relating to the second value by a second compression method different from the first compression method, for transmission to another device.
25. An information processing system including a first device having an inertial sensor and a second device communicating with the first device, The first device is a first acquisition means for acquiring a first value related to an attitude of the first device based on an output from the inertial sensor at a first timing; a second acquisition means for acquiring a second value related to an attitude of the first device based on an output from the inertial sensor at a second timing different from the first timing; a first determination means for determining whether a first condition that is satisfied when the first device is stationary is satisfied based on the first value and the second value; a first compressed data generating means for generating first compressed data including data relating to the first value and data relating to the second value by a first compression method when the first determining means determines that the first condition is satisfied, regardless of whether the first value and the second value are the same; a second compressed data generating means for generating second compressed data including data relating to the first value and data relating to the second value by a second compression method different from the first compression method when the first determination means determines that the first condition is not satisfied; a transmitting means for transmitting the first compressed data or the second compressed data to the second device, The second device is An information processing system comprising: a receiving unit that receives the first compressed data or the second compressed data transmitted by the transmitting unit.
26. An information processing method performed in an information processing device having an inertial sensor, comprising: a first acquisition step of acquiring a first value related to an attitude of the information processing device based on an output from the inertial sensor at a first timing; a second acquisition step of acquiring a second value related to an attitude of the information processing device based on an output from the inertial sensor at a second timing different from the first timing; a first determination step of determining whether or not a first condition that is satisfied when the information processing device is stationary is satisfied based on the first value and the second value; a first compressed data generating step of generating first compressed data including data related to the first value and data related to the second value by a first compression method when it is determined in the first determination step that the first condition is satisfied, regardless of whether the first value and the second value are the same; a second compressed data generating step of generating second compressed data including data relating to the first value and data relating to the second value by a second compression method different from the first compression method when it is determined in the first determination step that the first condition is not satisfied; a transmitting step of transmitting the first compressed data or the second compressed data to another device.
27. A main unit capable of communicating with a controller, The controller: an inertial sensor is provided, and a first value and a second value related to an attitude or a position of the controller are obtained based on outputs from the inertial sensor at a first timing and a second timing, respectively; A calculated value calculated based on the first value and the second value is (1) when a predetermined condition that is satisfied when the controller is stationary is satisfied, generating first compressed data including data related to the first value and data related to the second value by compressing the first value or the second value and the calculated value by a first compression method that includes compressing at least the calculated value, regardless of whether the first value and the second value are the same; (2) if the predetermined condition is not satisfied, compressing the first value and the second value by a second compression method different from the first compression method, the second compression method including compressing at least one of the first value and the second value, thereby generating second compressed data including data related to the first value and data related to the second value; Transmitting transmission data including the generated first compressed data or the generated second compressed data; a receiving means for receiving the transmission data from the controller; a first restoration means for restoring the first compressed data when the transmission data received by the receiving means includes the first compressed data; a second decompression means for decompressing the second compressed data when the transmission data received by the receiving means includes the second compressed data; A main body device comprising:
28. An analysis means for analyzing the received transmission data, the first restoration means, when the analysis means determines that the transmission data includes the first compressed data, restores the first compressed data; 28. The main unit according to claim 27, wherein the second restoration means restores the second compressed data when the analysis means determines that the transmission data includes the second compressed data.
29. 29. The main unit according to claim 27, further comprising information processing means for performing predetermined information processing based on the data restored by said first restoration means or said second restoration means.
30. 30. The main unit according to claim 29, wherein the predetermined information processing is processing for controlling an object in a virtual space.
31. A main unit capable of communicating with a controller, The controller: an inertial sensor is provided, and a first value and a second value relating to an attitude of the controller are obtained based on an output from the inertial sensor at a first timing and a second timing, respectively; (1) when the controller is stationary, generating first compressed data including data related to the first value and data related to the second value by a first compression method based on at least a difference between the first value and the second value, regardless of whether the first value and the second value are the same; (2) generating second compressed data including data related to the first value and data related to the second value by a second compression method different from the first compression method when the controller is not stationary; Transmitting transmission data including the generated first compressed data or the generated second compressed data; a receiving means for receiving the transmission data from the controller; a first processing execution means for executing a first processing for decompressing the first compressed data when the transmission data received by the receiving means includes the first compressed data; a second processing execution means for executing a second processing for decompressing the second compressed data when the transmission data received by the receiving means includes the second compressed data; A main body device comprising:
32. An analysis means for analyzing the received transmission data, the first processing execution means executes the first processing when the analysis means determines that the transmission data includes the first compressed data; 32. The main unit according to claim 31, wherein the second process execution means executes the second process when the analysis means determines that the transmission data includes the second compressed data.
33. 33. The main unit according to claim 31, further comprising an information processing unit that performs predetermined information processing based on the data restored by the first processing or the second processing.
34. The main unit according to claim 33, wherein the predetermined information processing is processing for controlling an object in a virtual space.
35. An information processing method performed in a main unit capable of communicating with a controller, comprising: The controller: an inertial sensor is provided, and a first value and a second value related to an attitude or a position of the controller are obtained based on outputs from the inertial sensor at a first timing and a second timing, respectively; A calculated value calculated based on the first value and the second value is (1) when a predetermined condition that is satisfied when the controller is stationary is satisfied, generating first compressed data including data related to the first value and data related to the second value by compressing the first value or the second value and the calculated value by a first compression method that includes compressing at least the calculated value, regardless of whether the first value and the second value are the same; (2) if the predetermined condition is not satisfied, compressing the first value and the second value by a second compression method different from the first compression method, the second compression method including compressing at least one of the first value and the second value, thereby generating second compressed data including data related to the first value and data related to the second value; Transmitting transmission data including the generated first compressed data or the generated second compressed data; a receiving step of receiving the transmission data from the controller; a first decompression step of decompressing the first compressed data when the transmission data received in the receiving step includes the first compressed data; a second decompression step of decompressing the second compressed data when the transmission data received in the receiving step includes the second compressed data; An information processing method comprising:
36. An information processing method performed in a main unit capable of communicating with a controller, comprising: The controller: an inertial sensor is provided, and a first value and a second value relating to an attitude of the controller are obtained based on an output from the inertial sensor at a first timing and a second timing, respectively; (1) when the controller is stationary, generating first compressed data including data related to the first value and data related to the second value by a first compression method based on at least a difference between the first value and the second value, regardless of whether the first value and the second value are the same; (2) generating second compressed data including data related to the first value and data related to the second value by a second compression method different from the first compression method when the controller is not stationary; Transmitting transmission data including the generated first compressed data or the generated second compressed data; a receiving step of receiving the transmission data from the controller; a first processing execution step of executing a first processing for decompressing the first compressed data when the transmission data received in the receiving step includes the first compressed data; a second processing execution step of executing a second processing for decompressing the second compressed data when the transmission data received in the receiving step includes the second compressed data; An information processing method comprising:
Citation Information
Patent Citations
Denchikoteikozo
JP1976022036A
Sensor node and sensor network system
JP2008310630A
Sensor data history accumulation system, sensor data history accumulation method and program
JP2011192198A
Sensor node and sensor network system
US20080309481A1
Wireless terminal
WO2018030258A1
