Information processing apparatus, information processing program, and information processing system

Abstract

To provide an information processing apparatus, an information processing program, and an information processing system for emitting voice according to a manner of touch.SOLUTION: A mobile information terminal 3 as an information processing apparatus comprises a control unit 30 for functioning as: pressure data acquisition means 300 for acquiring pressure data from a plurality of pressure sensors provided in a sensor unit 2; voice data selection decoding means 301 for selecting and decoding a manner in which a user 5 touches the sensor unit 2 from among a plurality of predetermined candidates based on a combination of changes in the pressure data of the pressure sensor 2; and voice data transmission means 302 for outputting the voice data corresponding to the selected manner of touch so as to be played by an interface apparatus 1.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing program, and an information processing system. [Background technology]

[0002] As a conventional technique, an information processing device has been proposed that controls sound output based on a detected state of the device (see, for example, Patent Document 1).

[0003] The information processing device disclosed in Patent Document 1 includes a control unit that controls the output of sound by the device based on the detected state of the device, and the control unit continuously changes the output mode of the synthetic sound that the device can output in a normal state according to the amount of change in the state. Also, a processor controls the output of sound by the device based on the detected state of the device, and the controlling continuously changes the output mode of the synthetic sound that the device can output in a normal state according to the amount of change in the state. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2020 / 129422 Summary of the Invention [Problem to be solved by the invention]

[0005] According to the information processing device of Patent Document 1 mentioned above, a pressure sensor is given as an example of a sensor that detects the state of the device, and the audio output is continuously changed according to the amount of change in the pressure value detected by the pressure sensor. However, the state of the device is detected based on a one-dimensional parameter, namely the pressure value, and there is a problem in that it is not possible to detect how the device is being touched, such as stroking, kneading, or pinching.

[0006] An object of the present invention is to provide an information processing device, an information processing program, and an information processing system that emit a sound according to the manner of touch. [Means for solving the problem]

[0007] In order to achieve the above object, one aspect of the present invention provides the following information processing device, information processing program, and information processing system.

[0008] [1] Acquire pressure data from multiple pressure sensors installed in the sensor unit; selecting a touching manner for the sensor unit from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor; An information processing device having a control unit that reproduces and processes audio data corresponding to the selected touching manner. [2] The sensor unit has pressure sensors in a surface layer and a deep layer of the sensor unit, The information processing device according to [1], wherein the control unit selects at least stroking, pinching, and kneading as the plurality of candidate touching methods based on a combination of changes in pressure data from the surface pressure sensor and changes in pressure data from the deep pressure sensor. [3] The information processing device according to [1], wherein the voice data is pre-stored voice data or voice data downloaded from an external source. [4] An acquisition means for acquiring pressure data from a plurality of pressure sensors provided in the sensor unit; a selection means for selecting a touching manner for the sensor unit from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor; and a transmitting means for outputting audio data corresponding to the selected touching manner for external playback. [5] A sensor unit having a plurality of pressure sensors; and a terminal that acquires pressure data from a plurality of pressure sensors provided in the sensor unit, selects a manner of touching the sensor unit from a plurality of predetermined candidates based on a combination of changes in the pressure data of the pressure sensors, and plays back and processes audio data corresponding to the selected manner of touching. Effect of the Invention

[0009] According to the invention as set forth in claims 1, 4 and 5, it is possible to emit a sound according to the manner of touch. According to the invention of claim 2, based on a combination of changes in pressure data from a surface pressure sensor and changes in pressure data from a deep pressure sensor, at least stroking, pinching, and kneading can be selected as multiple possible touching methods. According to the invention as defined in claim 3, the voice data can be pre-stored voice data or voice data downloaded from an external source. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a configuration of an information processing system according to an embodiment. [Diagram 3] FIG. 3 is a block diagram showing an example of the configuration of the portable information terminal. [Figure 4] FIG. 4 is a schematic diagram showing an example of the configuration of the sensor unit. [Diagram 5] FIG. 5 is a schematic perspective view showing an example of the configuration of the sensor. [Figure 6] FIG. 6 is a schematic diagram showing an example of the configuration of the selection conditions. [Figure 7] 7(a) to 7(c) are schematic diagrams showing how a user touches the sensor unit and the amount of change in the pressure sensor. [Figure 8] FIG. 8 is a flowchart illustrating the operation of the information processing system. [Figure 9] FIG. 9 is a schematic diagram showing another configuration example of the sensor unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] [Embodiment Mode] (Configuration of Information Processing System) Fig. 1 is a schematic diagram showing an example of the configuration of an information processing system according to an embodiment, and Fig. 2 is a block diagram showing an example of the configuration of an information processing system according to an embodiment.

[0012] This information processing system is composed of a body pillow 4 having an interface device 1, a sensor unit 2, and a speaker 40, and a mobile information terminal 3 that communicates with the interface device 1. The sensor unit 2 has a plurality of pressure sensors, detects the contact of the user 5, and outputs a signal to the interface device 1. The interface device 1 performs AD conversion or the like on the signal output by the sensor unit 2 in the control unit 10 and transmits it to the mobile information terminal 3 as pressure data, and receives voice data as a response of the mobile information terminal 3 to the transmitted pressure data, and drives the speaker 40 in the voice output unit 11 to output voice. The mobile information terminal 3 determines the type of contact of the user 5 with the sensor unit 2 based on the pressure data received from the interface device 1, and determines the voice information to be output based on the determination result. The sensor unit 2 arranged in the body pillow is touched by the user 5, for example, by stroking, kneading, pinching, or the like, but is not limited to this.

[0013] The interface device 1 includes electronic components such as a CPU (Central Processing Unit) having a function for processing information within the main body, an AD / DA converter, an amplifier, and a flash memory.

[0014] The sensor unit 2 has one or more sensors inside, and each sensor uses a capacitance type pressure sensor as an example, but it may also be a pressure sensor using a resistive film type, an optical type, etc., or it may adopt a piezoelectric element, MEMS, etc.

[0015] The mobile information terminal 3 is an information processing device such as a smartphone, a tablet terminal, or a PC (Personal Computer), and includes electronic components such as a CPU having a function for processing information within the main body, a flash memory, and the like.

[0016] The portable information terminal 3 and the interface device 1 are connected to each other by a wired connection such as a Universal Serial Bus (USB) or by a wireless communication such as Bluetooth.

[0017] FIG. 3 is a block diagram showing an example of the configuration of the portable information terminal 3. As shown in FIG.

[0018] The mobile information terminal 3 includes a control unit 30 that is configured with a CPU and the like and controls each unit and executes various programs, and a storage unit 31 that is configured with a storage medium such as a flash memory and stores information. The control unit 30 includes a communication unit that communicates with the outside via a network.

[0019] The control unit 10 executes an application 310, which will be described later, to function as a pressure data acquisition unit 300, a voice data selection unit 301, a voice data transmission unit 302, a billing operation unit 303, and the like.

[0020] The pressure data acquiring means 300 acquires pressure data from the interface device 1 .

[0021] The voice data selection means 301 acquires corresponding voice data from among a plurality of candidates of voice data 311 based on the pressure data acquired by the pressure data acquisition means 300 and on a selection condition 312 .

[0022] The audio data transmitting means 302 transmits the audio data selected by the audio data selecting means 301 to the interface device 1 .

[0023] The billing operation means 303 accesses an external voice data database 6 in response to an operation by the user 5 on the operation unit of the portable information terminal 3 , acquires voice data for a fee or free of charge, and stores it in the storage unit 31 .

[0024] The storage unit 31 stores an application 310 that causes the control unit 30 to operate as each of the above-mentioned means 300-303, voice data 311, selection conditions 312, and the like.

[0025] FIG. 4 is a schematic diagram showing an example of the configuration of the sensor unit 2. As shown in FIG.

[0026] The sensor unit 2 has a surface sensor 20s, which is a pressure sensor provided on the surface of the sensor unit 2, and a deep sensor 20i, which is a pressure sensor provided on the deep layer. Here, the "surface" refers to the inside close to the area of ​​the surface of the sensor unit 2 that the user 5 touches, and the "deep" refers to the inside far from the area.

[0027] FIG. 5 is a schematic perspective view showing an example of the configuration of the sensor.

[0028] The sensor 20 has conductive cloths 200a, 200b each equipped with a terminal, and a non-conductor 201 such as a sponge provided between them, and the capacitance changes according to the distance between the conductive cloths 200a, 200b, which changes according to the pressure applied between the conductive cloths 200a, 200b.

[0029] FIG. 6 is a schematic diagram showing an example of the configuration of the selection condition 312. As shown in FIG.

[0030] The selection conditions 312 include the manner in which the user 5 touches the sensor unit 2, the amount of change in the pressure sensor of each of the surface sensor 20s and the deep sensor 20i (the amount of change in the capacitance of the sensor 20), and the pattern of change in the pressure value of each of the surface sensor 20s and the deep sensor 20i (the pattern of change in the capacitance of the sensor 20).

[0031] (Operation of information processing device) Next, the operation of this embodiment will be described with reference to a flowchart of FIG 8 which illustrates the operation of the information processing system.

[0032] First, in order to use the body pillow 4, the user 5 turns on the power of the body pillow 4 (interface device 1 and sensor unit 2) and starts up the application 310 of the mobile information terminal 3. This operation starts up the interface device 1 and the application 310 of the mobile information terminal 3 (S10). The interface device 1 and the mobile information terminal 3 communicate with each other wirelessly. Note that when the interface device 1 is started up, the control unit 10 of the interface device 1 may automatically establish communication with the mobile information terminal 3 and start up the application 310 (directly or in the background).

[0033] Next, the user 5 uses the body pillow 4 by touching the sensor unit 2 as shown in Fig. 7 described later. The sensor 20 of the sensor unit 2 outputs a signal according to the way the user 5 touches it. The interface device 1 performs AD conversion or the like on the output signal of the sensor unit 2 and transmits it to the mobile information terminal 3 as pressure data.

[0034] The pressure data acquiring means 300 of the portable information terminal 3 receives the pressure data from the interface device 1 and acquires the pressure value (S11).

[0035] Next, the voice data selection means 301 of the mobile information terminal 3 refers to the selection conditions 312 (S12) and determines corresponding voice data from the voice data 311 based on the pressure data acquired by the pressure data acquisition means 300 and the selection conditions 312 shown in Fig. 6 (S13). Specifically, when the user 5 touches as shown in Fig. 7(a) to (c) below, the amount of change in the output value of the pressure sensor 20 changes depending on the way of touching, and the selection conditions 312 are determined by utilizing this.

[0036] 7(a) to (c) are schematic diagrams showing how the user 5 touches the sensor unit 2 and the amount of change in the pressure sensor 20. FIG.

[0037] 7(a), when the user 5 strokes the sensor unit 2, the shape of the surface layer of the sensor unit 2 changes slightly, so that the change in pressure value of the surface layer sensor 20s is small and the change in pressure value of the deep layer sensor 20i is almost 0. Therefore, by setting a small threshold value for the change in pressure value of the surface layer sensor 20s (a value smaller than the dynamic range of the pressure sensor 20) and setting a threshold value for the change in pressure value of the deep layer sensor 20i to a value that is regarded as 0 (a value that allows noise and slight errors to be ignored), the voice data selection means 301 determines that the touch is "stroking" among the selection conditions 312 when the threshold value is satisfied.

[0038] 7(b), for example, when the user 5 pinches the sensor unit 2, the shape of the surface layer of the sensor unit 2 changes significantly, so that the change in pressure value of the surface sensor 20s is large and the change in pressure value of the deep sensor 20i is almost 0. Therefore, by setting a large threshold value for the change in pressure value of the surface sensor 20s (a value larger than the dynamic range of the pressure sensor 20) and setting a value for the change in pressure value of the deep sensor 20i that is regarded as 0 (a value that allows noise and slight errors to be ignored), the voice data selection means 301 determines that the touch is a "pinching" touch among the selection conditions 312 when the threshold value is satisfied.

[0039] 7(c), when the user 5 kneads the sensor unit 2, the shape of the entire sensor unit 2 changes significantly, so that the amount of change in pressure value of the surface sensor 20s increases and the amount of change in pressure value of the deep sensor 20i increases. Therefore, by setting a large threshold value (larger than the dynamic range of the pressure sensor 20) for the amount of change in pressure value of the surface sensor 20s and also setting a large threshold value for the amount of change in pressure value of the deep sensor 20i, the voice data selection means 301 determines that the touch is "kneading" among the selection conditions 312 when the threshold value is satisfied.

[0040] As described above, the amount of change in the surface layer sensor 20s and the deep layer sensor 20i varies depending on the way the user 5 touches the sensor unit 2, so touching ways other than those described above can also be handled by preparing selection conditions 312 in advance. In addition, selection conditions 312 may be prepared for various touching ways by machine learning or the like. In addition, the selection conditions 312 are not limited to table-like information as long as there is a correlation between the touching way and the pressure value, and may exist as learning result information as long as it is obtained by machine learning or the like.

[0041] Next, the voice data selection means 301 of the mobile information terminal 3 acquires the corresponding voice data determined by the above operation from the voice data 311 (S14).

[0042] Next, the voice data transmitting means 302 of the portable information terminal 3 transmits the voice data selected by the voice data selecting means 301 to the interface device 1. The interface device 1 drives the speaker 40 based on the received voice data to output voice (S15).

[0043] In addition, the user 5 operates the mobile information terminal 3 to purchase voice data 311 (and a set of selection conditions 312 for selecting the voice data 311) to be played in response to the sensor unit 2 from the voice data database 6 in addition to the voice data that has been prepared in advance in the mobile information terminal 3.

[0044] The billing operation means 303 accesses the voice data database 6 in response to an operation by the user 5 on an operation unit (not shown) of the mobile information terminal 3, executes processing such as payment, downloads voice data, and stores it in the storage unit 31. By performing these operations, it is possible to increase the variety of sounds that can be output from the speaker 40 via the interface device 1.

[0045] (Effects of the embodiment) According to the embodiment described above, a plurality of sensors are provided in the sensor unit 2, and selection conditions 312 are prepared that define the amount of change and change pattern of the output value of each sensor according to the manner of touch by the user 5. Sound data 311 is selected and played based on the selection conditions 312, so that a sound can be generated according to the manner of touch.

[0046] [Other embodiments] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0047] For example, in the above embodiment, the interface device 1, the sensor unit 2, and the mobile information terminal 3 are each shown as separate devices, but the devices may be integrated in any combination, or some or all of the functions of each device may be included in another device, or each device may be divided into four or more devices.

[0048] Moreover, the sensor unit 2 described in the above embodiment may be configured as described below.

[0049] FIG. 9 is a schematic diagram showing another configuration example of the sensor unit 2. As shown in FIG.

[0050] The sensor unit 2A is another example of the configuration of the sensor unit 2, and includes a surface layer sensor 20s, which is a pressure sensor provided in the surface layer, a deep layer sensor 20i, which is a pressure sensor provided in the deep layer, and a balloon-shaped adjustment member 21. The adjustment member 21 has a structure that can increase or decrease the amount of air inside, and by changing the amount of air, the swelling, hardness, etc. of the sensor unit 2A can be changed, and the distance between the surface layer sensor 20s and the deep layer sensor 20i, etc. can be changed.

[0051] The body pillow 4 may have a plurality of sensor units 2, and may be configured to reproduce different sound data according to the manner in which each sensor unit 2 is touched. Each sensor unit 2 may be configured to be replaceable with another sensor unit 2 having a different feel or size according to the preference of the user 5. Different sound data 311 may be selected according to the replacement of another sensor unit 2.

[0052] In the above embodiment, the functions of the means 300 to 303 of the control unit 30 are realized by a program, but all or part of the means may be realized by hardware such as ASIC. Also, the program used in the above embodiment may be stored in a recording medium such as a CD-ROM and provided. Also, the steps described in the above embodiment may be replaced, deleted, added, etc., without changing the gist of the present invention. [Explanation of symbols]

[0053] 1: Interface device 2, 2A: Sensor section 3: Mobile information terminal 4: Body pillow 5: User 6: Voice data database 10: Control section 11: Audio output section 20: Pressure sensor 20i: Deep Sensor 20s: Surface sensor 21: Adjustment parts 30: Control section 31: Storage section 40: Speaker 200a, 200b: Conductive cloth 201: Non-conductor 300: Pressure data acquisition means 301: Audio data selection means 302: Audio data transmission means 303: Charging operation means 310 : Application 311: Audio data 312: Selection conditions

Claims

1. Acquire pressure data from a plurality of pressure sensors provided in the sensor unit; selecting a touching manner for the sensor unit from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor; An information processing device having a control unit that reproduces and processes audio data corresponding to the selected touching manner.

2. The sensor unit has pressure sensors in a surface layer and a deep layer of the sensor unit, The information processing device according to claim 1 , wherein the control unit selects at least stroking, pinching, and kneading as the plurality of candidate touching methods based on a combination of changes in pressure data from the surface pressure sensor and changes in pressure data from the deep pressure sensor.

3. The information processing apparatus according to claim 1 , wherein the voice data is prestored voice data or voice data downloaded from an external source.

4. An acquisition means for acquiring pressure data from a plurality of pressure sensors provided in the sensor unit; a selection means for selecting a touching manner for the sensor unit from a plurality of predetermined candidates based on a combination of changes in pressure data of the pressure sensor; and a transmitting means for outputting audio data corresponding to the selected touching manner for external playback.

5. a sensor unit provided with a plurality of pressure sensors; and a terminal that acquires pressure data from a plurality of pressure sensors provided in the sensor unit, selects a manner of touching the sensor unit from a plurality of predetermined candidates based on a combination of changes in the pressure data of the pressure sensors, and plays back and processes audio data corresponding to the selected manner of touching.

Images