Input device and information processing system
By converting digital vibration signals to analog and adjusting the sampling frequency, the input device addresses power consumption issues, enhancing battery life and user experience.
Patent Information
- Application Number
- JP2023183502
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-10-25
- Publication Date
- 2025-05-12
- Estimated Expiration
- 2043-10-25
AI Technical Summary
Existing input devices face challenges in efficiently managing power consumption due to the high sampling frequency required for digital vibration signals, which can lead to increased power consumption and reduced battery life.
The input device incorporates a converter to transform digital vibration signals into analog signals, a vibrator to produce haptic feedback, and a controller that adjusts the sampling frequency of digital signals to a lower setting than a predetermined reference frequency, optimizing power usage.
This solution reduces power consumption while maintaining user satisfaction by lowering the sampling frequency, thereby extending battery life and improving the device's operational availability.
Smart Images

Figure 2025072984000001_ABST
Abstract
Description
[Technical field]
[0001] The present application relates to input devices and information processing systems, and more particularly to control of input devices. [Background technology]
[0002] A haptic pen is a digital pen with a haptic feedback function. A digital pen is an input device used for drawing and recording handwritten characters and the like. A digital pen is also called an electronic pen, a smart pen, a stylus, and the like. The haptic feedback is realized by vibrating a vibrator in response to contact with a touch panel that displays characters and the like. In addition, usability is improved by controlling the haptic feedback function. For example, Patent Document 1 describes an interactive stylus for use with an interactive display device. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Special Publication No. 2017-537395 Summary of the Invention [Problem to be solved by the invention]
[0004] Some input devices are equipped with a memory that stores vibration signals that show vibration waveforms in advance, and output the vibration signals to a vibrator in response to contact with the pen tip. SRAM (Static Random Access Memory), which consumes little power, is often used as such memory. In general, SRAM has a small storage capacity, so it tends to be difficult to handle vibration signals that show complex waveforms. Therefore, it has been considered to equip the input device with an MCU (Micro Computing Unit) that stores vibration signals in advance, convert digital vibration signals to analog vibration signals in response to contact, and output them to a vibrator. However, generally, the higher the sampling frequency of the digital signal, the higher the power consumption related to data transfer tends to be. On the other hand, the capacity of small batteries that can be installed in input devices is limited. If the power consumption is high, the device must be repeatedly charged, which may reduce convenience. [Means for solving the problem]
[0005] The present application has been made to solve the above-mentioned problems, and an input device according to one aspect of the present application comprises a converter that converts a digital vibration signal into an analog vibration signal, a vibrator that vibrates based on the analog vibration signal, and a controller that outputs the digital vibration signal to the converter in response to contact with a contact detection unit, and the controller is capable of controlling the sampling frequency of the digital signal to a frequency lower than a predetermined reference frequency.
[0006] The input device may include a storage medium that stores digital vibration signals of a plurality of vibration types and has a sampling frequency set for each of the vibration types, and the controller may output a digital signal of a vibration type indicated by notification information from a host system to the converter at a sampling frequency corresponding to the vibration type.
[0007] In the above input device, a higher sampling frequency may be set for a digital signal of a vibration type having a greater amount of audio components.
[0008] In the above input device, the controller may set the sampling frequency corresponding to an age of the user based on notification information from a host system.
[0009] An information processing system according to another aspect of the present application may include the host system and the above-mentioned input device.
[0010] In the above information processing system, the host system may obtain age information indicating the age from preset user setting information, and include the age information in the notification information and output the notification information to the input device.
[0011] In the above information processing system, an age of the user may be estimated based on a facial image of the user, and age information indicating the age may be included in the notification information and output to the input device. Effect of the Invention
[0012] According to the embodiment of the present application, it is possible to reduce power consumption while ensuring user satisfaction. [Brief description of the drawings]
[0013] [Figure 1] 1 is an external view showing an example of the external configuration of an information processing system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing a schematic configuration example of an information processing system according to an embodiment of the present invention. [Diagram 3] 1 is a block diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present invention; [Figure 4] 5 is a diagram showing an example of writing implement type information according to the embodiment; FIG. [Diagram 5] 5 is a flowchart illustrating an example of vibration control according to the present embodiment. [Figure 6] 10 is a diagram illustrating frequency setting information according to the embodiment; [Figure 7] 13 is a diagram showing another example of writing implement type information according to the embodiment. FIG. [Figure 8] 5 is a flowchart showing an example of a sampling frequency setting process according to the embodiment. [Figure 9] 10 is a flowchart showing another example of the sampling frequency setting process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of the present application will be described with reference to the drawings. First, a configuration example of an information processing system S1 according to the present embodiment will be described. In the following description, the information processing device 1 is a tablet terminal, and the input device 30 is mainly a digital pen having a tactile sensation providing function. The digital pen is a pen-shaped operating medium, and is configured as a writing device. In the present application, the digital pen may be simply called a "pen."
[0015] FIG. 1 is an external view showing an example of the external configuration of an information processing system S1 according to this embodiment. The information processing system S1 includes an information processing device 1 and an input device 30. The information processing device 1 has a touch screen 20, which covers most of the surface of the housing. Other members of the information processing device 1 are housed in the housing. The input device 30 is held by a user and moved while touching the surface of the touch screen 20, and is used for inputting or editing data such as characters, symbols, and figures. The touch screen 20 is configured by superimposing the display surface of the display 21 and the detection surface of the touch sensor 22. The display 21 displays various display screens on the display surface so that they can be seen. The touch sensor 22 detects contact of the input device 30 with the detection surface. The information processing device 1 monitors whether or not the input device 30 has contacted the touch sensor 22, identifies the contact position where the contact was detected, and executes data input or editing based on the input operation. The information processing device 1 causes the display 21 to display a display screen showing the trajectory of the contact position or a figure derived from the trajectory (sometimes referred to as handwriting input or drawing input).
[0016] The input device 30 converts a digital vibration signal (hereinafter referred to as "digital vibration signal") into an analog vibration signal (hereinafter referred to as "analog vibration signal") in response to contact with the touch sensor 22, and vibrates based on the converted analog vibration signal. The input device 30 can control the sampling frequency of the digital vibration signal to a frequency lower than a predetermined reference frequency. As described later, the sampling frequency can be changed according to the type of vibration signal or the maximum audible frequency based on the user's age.
[0017] FIG. 2 is a block diagram showing an example of a schematic configuration of an information processing system S1 according to this embodiment. The information processing device 1 includes a host system 10, a touch screen 20, and a wireless I / F (interface) . The display 21 displays various types of screens based on display data input from the host system 10 . The touch sensor 22 detects whether or not a touch has been made to the touch sensor 22. The touch sensor 22 generates input data indicating a contact position where the touch has been detected, and outputs the generated input data to the host system 10.
[0018] The host system 10 is a computer system that controls the overall functions of the information processing device 1. The host system 10 includes a display processing unit 102, a device setting unit 104, and a vibration control unit 110.
[0019] The display processing unit 102 inputs or edits data according to a contact position indicated by input data from the touch sensor 22. This data input or editing corresponds to a drawing process. For example, the display processing unit 102 identifies a contact position indicated by input data input at regular intervals, and forms a time series of contact positions. The display processing unit 102 generates a movement trajectory based on the formed time series of contact positions, and generates display data showing a display screen including a figure forming the generated movement trajectory. The display processing unit 102 outputs the generated display data to the display 21. As a result, the display processing unit 102 causes the display 21 to display a movement trajectory based on an input operation.
[0020] The device setting unit 104 sets functions related to the input device 30 based on input data from the touch sensor 22 or other input devices. The device setting unit 104, for example, displays a device setting screen (not shown) on the display 21. The device setting screen is a display screen for setting functions of various devices connected to the information processing device 1 by wire or wirelessly. The device setting screen is used for vibration settings such as whether or not vibration is to be presented for a vibration presentable device (including the input device 30) that enables vibration presentation. The vibration settings may include audio settings related to audio presentation. For example, a screen component for specifying the volume may be arranged in the audio settings. The volume corresponds to the amplitude for the vibration signal or the gain for the amplitude reference value. The device setting unit 104 outputs the vibration setting that has been set to the vibration control unit 110 .
[0021] The device setting unit 104 may be able to set a type of vibration (hereinafter, may be referred to as a "vibration type"). When the input device 30 generates vibration in response to contact with the touch sensor 22, it simulates, for example, a vibration generated by writing with an actual writing implement. In this case, the vibration type is specified using the type of writing implement (hereinafter, may be referred to as a "writing implement type"). The device setting unit 104 may include information indicating the set vibration type in the vibration setting and notify the vibration control unit of the information. Specific examples of the vibration type will be described later.
[0022] The device setting unit 104, for example, refers to a user profile previously set in the host system 10 to identify the user's date of birth, and identifies the number of years corresponding to the period from the identified date of birth to that point in time as the user's age. The user profile is acquired, for example, in response to an operational input by the user at the time of initial setup of the information processing device 1. The device setting unit 104 may obtain image data showing an image representing the user's head (face image) and estimate the user's age using a known image recognition technique for the obtained image data. For example, the device setting unit 104 causes the camera 26 (FIG. 4) to capture an image of the user's face and obtains image data showing the captured face image. The device setting unit 104 may include age information indicating the age of the user in the vibration settings and notify the vibration control unit 110 of the same.
[0023] The function of the device setting unit 104 can be realized, for example, by executing a device setting API (Application Programming Interface) function of an operating system (OS). The function of the device setting unit 104 is realized by calling the API function according to an application program (sometimes referred to as an "app" in this application) being executed. The above-mentioned writing sound type can be specified using parameters of an existing device setting API. In this application, execution of a program includes the meaning of executing processes specified by various commands written in the program.
[0024] The vibration control unit 110 controls the vibration of the input device 30 based on the input data from the touch sensor 22. The vibration control unit 110 generates vibration control information in response to the contact indicated in the input data, and outputs the generated vibration control information to the input device 30 using the wireless I / F 28. The function of the vibration control unit 110 may be realized by executing a device driver of the input device 30, for example.
[0025] The vibration control unit 110 outputs a contact notification indicating a contact on the touch sensor 22 to the input device 30, including the contact notification indicative of a contact on the touch sensor 22, in vibration control information based on input data indicating a contact on the touch sensor 22. The vibration control unit 110 may output the vibration control information to the input device 30, including information on a contact position where a contact on the touch sensor 22 is detected, as contact position information. Furthermore, the vibration control unit 110 outputs notification information indicating the vibration settings input from the device setting unit 104 to the input device 30 using the wireless I / F 28. The vibration control unit 110 outputs the notification information, for example, every time the vibration settings are updated. The vibration control unit 110 may output the notification information including information indicating the difference between the vibration settings before and after the update, without including the other parts. The vibration control unit 110 may output the notification information to the input device 30 by including it in the vibration control information, or may output it separately from the vibration control information.
[0026] The wireless I / F 28 uses a predetermined communication method to wirelessly transmit and receive various data to and from the input device 30. The communication method is, for example, a low-power consumption communication mode related to a short-distance wireless communication method defined in IEEE802.15.1. This allows the power consumption of the input device 30 to be reduced.
[0027] Next, a description will be given of an example of a hardware configuration of the input device 30. The input device 30 includes a wireless I / F 32, an MCU 34, a DAC 36, an amplifier 38, a transducer 40, and a battery 42. The wireless I / F 32 wirelessly transmits and receives various data to and from the information processing device 1 using the above communication method.
[0028] The MCU (Micro Computer Unit) 34 controls the functions of the input device 30. The MCU 34 includes a processor, various memories, and an input / output interface. The MCU 34 operates independently of the operating state of the host system 10. The processor of the MCU 34 executes a predetermined program to perform the functions of the MCU 34. The memory includes a volatile memory such as a RAM 34s and a non-volatile memory such as a ROM. The RAM 34s is used as a working area for the processor. When the MCU 34 is started up, various digital vibration signals and other setting information previously stored in the non-volatile memory are read out and saved in the RAM 34s.
[0029] The RAM 34s may store a vibration signal for each vibration type. The RAM 34s may store vibration type information indicating the sampling frequency and the location of the vibration signal for each vibration type. The vibration type information forms part of the setting information. The reference frequency corresponds to the rated value of the sampling frequency of the RAM 34s and the DAC 36. The reference frequency may be a sampling frequency that can sufficiently express audible sounds that can be heard by users of all ages, for example, 44 kHz to 48 kHz.
[0030] Vibration control information is input to the MCU 34 from the host system 10 via the wireless I / F 32. Notification information is also input to the MCU 34 from the host system 10 either included in the vibration control information or separately from the vibration control information. When a vibration type is specified by the notification information, the MCU 34 refers to vibration type information stored in advance in the RAM 34s to identify the sampling frequency and the location of the vibration signal corresponding to the specified vibration type. When the vibration control information includes a contact notification indicating contact with the touch sensor 22, the MCU 34 reads out the identified vibration signal and outputs the vibration signal read out at the identified sampling frequency to the DAC 36.
[0031] The setting information stored in the RAM 34s may include frequency setting information. The frequency setting information is information that indicates a sampling frequency for each age of the user. A specific example of the frequency setting information will be described later. When the notification information input from the host system 10 includes age information, the MCU 34 identifies an age group including the age of the user indicated in the age information. The MCU 34 refers to the frequency setting information and identifies an age-specific sampling frequency corresponding to the identified age group. The MCU 34 reads out the vibration signal identified by the above method, and outputs the vibration signal read out at the identified age-specific sampling frequency to the DAC 36.
[0032] A digital signal is transmitted to the wireless I / F 32, the MCU 34, and the DAC 36 according to a predetermined transmission method (for example, the I2C (Inter-Integrated Circuit) standard). Data is transmitted intermittently between the wireless I / F 32 and the MCU 34, so the power consumption required for data transmission is relatively small. A digital vibration signal is continuously transmitted between the MCU 34 and the DAC 36, so the power consumption is large. A digital signal may be expressed as a time series of at least two states: a high voltage (H: High) that is significantly higher than a reference potential, and a low voltage (L: Low) that is not significantly different from the reference potential. For example, a signal line used for data transmission based on the I2C standard transmits a digital signal by applying a power supply voltage supplied from a battery 42 via a pull-up resistor, and changing the potential of the signal line between a high voltage and a low voltage. Therefore, the higher the sampling frequency of the digital vibration signal, the more frequently the potential of the signal line switches, so that the power loss in the process tends to be large. In other words, the power consumption can be reduced by lowering the sampling frequency of the digital vibration signal.
[0033] The digital-to-analog converter (DAC) 36 converts the digital vibration signal input from the MCU 34 into an analog vibration signal. The DAC 36 outputs the converted analog vibration signal to an amplifier 38. The amplifier 38 adjusts the amplitude of the analog vibration signal input from the DAC 36, and outputs the amplitude-adjusted analog vibration signal to the vibrator 40. The amplifier 38 may be configured as a drive circuit for driving the vibrator 40. The amplifier 38 may be configured as a circuit element integrated with the DAC 36. The oscillator 40 is an actuator that generates vibrations in accordance with the analog vibration signal input from the amplifier 38. The oscillator 40 includes, for example, a piezoelectric element. The battery 42 is charged in advance and supplies power required for the operation of each part of the input device 30, specifically, the wireless I / F 32, the MCU 34, the DAC 36, and the amplifier 38.
[0034] Next, a hardware configuration example of the information processing device 1 according to this embodiment will be described. Fig. 3 is a block diagram showing a hardware configuration example of the information processing device 1 according to this embodiment. The information processing device 1 includes a processor 11, a main memory 12, a flash memory 13, a touch screen 20, an audio system 24, a camera 26, and a wireless I / F 28.
[0035] The processor 11 controls the overall functions of the information processing device 1. For example, one or more CPUs (Central Processing Units) are used as the processor 11. The processor 11 executes a predetermined program, cooperates with the main memory 12 and other hardware, and is used to realize the functions of the host system 10, that is, the functions of the display processing unit 102, the device setting unit 104, and the vibration control unit 110. It plays a major role.
[0036] The main memory 12 is a writable memory used as a working area for the processor 11, i.e., an area for reading executable programs and various setting data, and an area for writing processing data acquired by executing programs. The main memory 12 is configured to include, for example, a plurality of DRAM (Dynamic Random Access Memory) chips. The executable programs include an OS, various device drivers for controlling peripheral devices, various services / utilities, applications, and the like.
[0037] The flash memory 13 stores in advance an OS, various device drivers, various services / utilities, applications, and various data. The display 21 displays various display screens based on display data output from the processor 11. The display 21 may be, for example, any of a liquid crystal display, an organic electroluminescence display, and the like.
[0038] The touch sensor 22 detects an object (mainly the input device 30 in this application) that has contacted the display screen and the contact position. The touch sensor 22 outputs input data indicating the contact position where the contact has been detected to the host system 10. The touch sensor 22 is, for example, a capacitance pressure sensor. The touch sensor 22 detects the contact pressure of the object that has contacted the display screen. The touch sensor 22 may include information on the detected contact pressure in the input data and output the input data to the host system 10. The touch sensor 22 may detect the inclination of the contacted object, that is, the pen angle. When the touch sensor 22 is a three-axis pressure sensor, the vibration control unit 110 (FIG. 2) can specify the pen angle using the direction cosines for the pressure in each axial direction. The touch sensor 22 may include information on the specified pen angle in the input data and output the input data to the host system 10.
[0039] The audio system 24 performs processes such as processing, input, output, recording, playback, encoding, and decoding of audio signals. The audio system 24 includes, for example, an audio IC (Integrated Circuit). The audio system 24 is connected to one or both of a microphone (not shown) and a speaker (not shown) by wire or wirelessly.
[0040] Camera 26 captures images of various objects located within a predetermined field of view, and outputs image data indicating the captured images to processor 11. Camera 26 may be, for example, any of a CCD (Charge-Coupled Device) camera, a CMOS (Complementary Metal-Oxide-Semiconductor) camera, etc.
[0041] Next, a specific example of vibration type information according to the present embodiment will be described. FIG. 4 illustrates writing implement type information according to the present embodiment. The illustrated writing implement type information is an example of vibration type information. In the example of FIG. 4, the writing implement type information includes a set of writing implement type, sampling frequency, and vibration signal file name for each vibration type. The writing implement type indicates a vibration type. More specifically, ballpoint pen, eraser, pencil, and marker are specified as vibration types. This is based on the fact that the vibration generated in the writing implement due to friction between the actual writing implement and a display medium such as paper by the writing action, and the frequency characteristic (spectrum) of the sound generated by the vibration differ depending on the writing implement type. Note that "no sound" is not strictly a writing implement type, but is included as a part of the vibration type. "No sound" corresponds to a vibration type that does not include a significant sound component and is mainly intended for tactile presentation.
[0042] The sampling frequency may be equal to or lower than the reference frequency and may be a frequency capable of expressing the main component of the vibration signal. The vibration includes a vibration component that is perceived by the user as a touch and a sound component that is perceived as a sound. In general, the ratio of the vibration component and the sound component included in the vibration varies depending on the type of writing implement. In the example of FIG. 4, the sampling frequency is set to be higher for a type of vibration with a higher ratio of the sound component included in the vibration signal related to that vibration type. For example, the sampling frequency for a pencil or a marker, which mainly includes sound components at a relatively high frequency in the vibration signal, is 40 kHz. However, this frequency is lower than 48 kHz, which is set as the reference frequency. The sampling frequency for a ballpoint pen or an eraser, which mainly includes vibration components and has few sound components in the vibration signal, is 500 Hz. Note that "no sound" is set to an even lower sampling frequency of 400 Hz because the vibration signal does not include a sound component. This setting is based on the fact that the human sense of touch can mainly sense vibrations at frequencies lower than 200 Hz, but cannot sense vibrations at higher frequencies.
[0043] Next, an example of vibration control according to this embodiment will be described below. Fig. 5 is a flowchart showing an example of vibration control according to this embodiment. (Step S102) Vibration control information is input to the MCU 34 of the input device 30 from the host system 10 via the wireless I / F 32. (Step S104) The MCU 34 judges whether or not the vibration control information includes notification information indicating the type of writing implement. If it is judged that it is included (step S104 YES), the MCU 34 proceeds to the process of step S106. If it is judged that it is not included (step S104 NO), the MCU 34 proceeds to the process of step S108.
[0044] (Step S106) The MCU 34 refers to preset writing implement type information and identifies the sampling frequency and vibration signal corresponding to the writing implement type designated by the notification information. (Step S108) The MCU 34 waits for vibration control information including a contact notification indicating a contact with the touch sensor 22. The MCU 34 determines whether or not a contact notification is input, and proceeds to processing of step S110 when a contact notification is input (step S108 YES). When a contact notification is not input (step S108 NO), the MCU 34 returns to processing of step S102.
[0045] (Step S110) The MCU 34 reads the identified vibration signal from the RAM 34s, and outputs it to the DAC 36 at the identified sampling frequency. (Step S112) The DAC converts the digital vibration signal input from the MCU 34 into an analog vibration signal, and outputs the converted analog vibration signal to the transducer 40 via the amplifier 38. The transducer 40 is driven based on the analog vibration signal input from the amplifier 38.
[0046] In addition, when information on the type of writing implement is not acquired, the MCU 34 may use a vibration signal and a sampling frequency associated with a preset default writing implement type (for example, "no sound") to output the vibration signal to the DAC 36.
[0047] Next, a specific example of the frequency setting information according to the present embodiment will be described. FIG. 6 illustrates an example of the frequency setting information according to the present embodiment. The illustrated frequency setting information includes a set of the maximum audible frequency and the age-specific sampling frequency for each age group. The age-specific sampling frequency is set to a frequency that can fully express the audio components below the maximum audible frequency that can be heard as audio by a standard user of the target age group, and is as low as possible compared to the reference frequency. The age-specific sampling frequency may be set to a frequency slightly higher than twice the maximum audible frequency, for example, 2.2 to 2.6 times, according to the sampling theorem. In the example of FIG. 6, the maximum audible frequency of a user in his / her 40s is set to 14 kHz, and the age-specific sampling frequency is set to 30 kHz.
[0048] In addition, the sampling frequency of the vibration signal for some vibration types may be higher than the age-specific sampling frequency. Among the writing implement types illustrated in FIG. 4, the sampling frequency of the vibration signal for the pencil and the marker is 40 kHz, which is higher than any of the age-specific sampling frequencies 17 kHz to 37 kHz illustrated in FIG. 6. If the MCU 34 reads out the pencil vibration signal sampled at 40 kHz from the RAM 34s and outputs it to the DAC 36 at an age-specific sampling frequency corresponding to the user's age (for example, 30 kHz for a 45-year-old user), the vibration waveform generated by the vibrator 40 expands and contracts in the time direction as a whole in inverse proportion to the age-specific sampling frequency. In response to this, the frequency characteristic of the vibration waveform expands and contracts in the frequency direction as a whole in proportion to the age-specific sampling frequency. Therefore, there is a possibility that the user may feel uncomfortable.
[0049] In the process of step S106 (FIG. 5), the MCU 34 may specify a frequency that is equal to or lower than the age-specific sampling frequency corresponding to the user's age as the sampling frequency corresponding to the vibration type instructed by the notification information. In that case, in the process of step S110, the MCU 34 reads out a vibration signal corresponding to the vibration type, and outputs the vibration signal read out at the sampling frequency corresponding to the vibration type to the DAC 36.
[0050] On the other hand, in the process of step S106, a sampling frequency corresponding to the vibration type indicated by the notification information may be specified as a frequency higher than the age-specific sampling frequency corresponding to the user's age. In that case, in the process of step S110, the MCU 34 reads out a vibration signal corresponding to the vibration type, and converts (downsamples) the sampling frequency of the read vibration signal from the sampling frequency corresponding to the vibration type to the age-specific sampling frequency using a known frequency conversion method so that the vibration waveform is changed as little as possible. The MCU 34 outputs the vibration signal obtained by the frequency conversion to the DAC 36 according to the age-specific sampling frequency.
[0051] In addition, for a vibration type whose basic sampling frequency for expressing a vibration waveform (for example, the sampling frequency for each writing implement type shown in FIG. 4) includes a range of age-specific sampling frequencies (for example, the age-specific sampling frequencies exemplified in FIG. 6) or is higher than the range of the age-specific sampling frequencies, a vibration signal obtained by sampling a common vibration waveform for the vibration type at a plurality of sampling frequencies may be stored in advance in the RAM 34s. The plurality of sampling frequencies are set in advance so as to be distributed including the range of the age-specific sampling frequencies. In the example of the writing implement type information in FIG. 7, vibration signals sampled at seven sampling frequencies are stored in the RAM 34s for each of the pencil and the marker. The seven sampling frequencies are set to be equal to the age-specific sampling frequencies exemplified in FIG. 6. These plurality of sampling frequencies do not necessarily need to be equal to some or all of the candidates for the age-specific sampling frequencies, and may be sufficient as long as they cover the range of the age-specific sampling frequencies.
[0052] Therefore, in the processing of step S106 (FIG. 5), MCU34 identifies one sampling frequency that is lower than the age-specific sampling frequency corresponding to the user's age from among the multiple sampling frequencies corresponding to the writing instrument type indicated in the notification information (if there are two or more sampling frequencies that are lower than the age-specific sampling frequency corresponding to the user's age, for example, the sampling frequency that is closest to the age-specific sampling frequency among them). Then, in the process of step S110, the MCU reads out the vibration signal corresponding to the identified sampling frequency from among the identified writing implement types, and outputs the vibration signal read out at that sampling frequency to the DAC . In the example of Fig. 6, the age-specific sampling frequency for a 45-year-old user is 30 kHz. In the example of Fig. 7, when a marker is notified as the writing implement type, the MCU 34 determines the sampling frequency corresponding to the vibration signal of the marker to be 30 kHz, reads the vibration signal stored in the data file "prm_htp_05_30" from the RAM 34s at that sampling frequency, and outputs it to the DAC 36.
[0053] Next, an example of the sampling frequency setting process according to the present embodiment will be described. Fig. 8 is a flowchart showing an example of the sampling frequency setting process according to the present embodiment. However, in Fig. 8, the process of setting the sampling frequency according to the vibration type and the process of driving the vibrator according to the contact notification are omitted.
[0054] (Step S202) The device setting unit 104 of the host system 10 identifies the age of the user based on a preset user profile, and notifies the vibration control unit 110 of the identified age information by including it in the vibration settings. (Step S204) The vibration control unit 110 includes the age information notified from the device setting unit 104 in the notification information, and outputs the notification information to the input device 30 using the wireless I / F . (Step S206) Notification information including age information is input to the MCU 34 of the input device 30 from the host system 10 using the wireless I / F 32, and the MCU 34 identifies the age of the user indicated in the age information. The MCU 34 refers to frequency setting information previously stored in the RAM 34s and identifies an age-specific sampling frequency corresponding to an age group including the identified age. The age-specific sampling frequency identified as above is used to output the read vibration signal to the DAC 36 or to identify the vibration signal to be read.
[0055] It should be noted that the frequency setting information illustrated in Fig. 8 does not necessarily have to include information on the highest audible frequency. The frequency setting information does not necessarily have to be configured as a data table as long as it is possible to provide an age-specific sampling frequency for each age or age group. The frequency setting information may be defined as a function for calculating an age-specific sampling frequency as a function value using age as an input value.
[0056] The process of Fig. 8 is an example in which the device setting unit 104 of the host system 10 determines the user's age using a user profile, but is not limited to this. The device setting unit 104 may obtain image data showing an image (face image) representing the user's head as shown in Fig. 8, and perform a known image recognition process on the obtained image data to estimate the user's age. Fig. 9 is a flowchart showing another example of the sampling frequency setting process according to this embodiment.
[0057] (Step S302) The device setting unit 104 causes the camera to capture a face image of the user based on input data from the touch sensor 22. The device setting unit 104 acquires image data indicating the captured face image from the camera . (Step S304) The device setting unit 104 performs image recognition processing on the acquired image data to estimate the user's age. The device setting unit 104 includes age information indicating the estimated age in the vibration settings and notifies the vibration control unit 110. Then, the process proceeds to steps S306 and S308. The processes of steps S306 and S308 are similar to steps S204 and S206, and therefore the explanations thereof are incorporated herein.
[0058] There may be cases where the age determined based on the input data from the touch sensor 22, such as a user profile, and the like, differs from the age determined based on the image data. In such cases, the device setting unit 104 may adopt one of them, for example, the age determined based on the input data or the lower of the two, and discard the other. Furthermore, the MCU 34 may determine a gain based on the contact pressure, pen angle, or movement speed of the input device 30, and notify the amplifier 38 of the gain. The amplifier 38 adjusts the amplitude of the analog vibration signal input from the DAC 36 by using the gain notified by the MCU 34, instead of a preset gain. For example, the MCU 34 determines the gain so that the greater the contact pressure, pen angle, or movement speed, the greater the gain. The contact pressure and pen angle may be notified by vibration control information carried by a vibration control signal input from the host system 10. The movement speed is derived as the time derivative of the contact position notified by the vibration control information.
[0059] 8 and 9 illustrate a case where the device setting unit 104 of the host system 10 determines the age of the user, and the MCU 34 of the input device 30 determines the age-specific sampling frequency corresponding to the user's age, but the present invention is not limited to this. The device setting unit 104 may determine the age-specific sampling frequency corresponding to the user's age by referring to frequency setting information previously set in the device setting unit 104. In this case, the device setting unit 104 may notify the vibration control unit 110 of the vibration setting indicating the age-specific sampling frequency, and output the vibration setting to the input device 30 as notification information. The MCU 34 of the input device 30 specifies the age-specific sampling frequency indicated in the notification information input from the host system 10, and uses it to output the vibration signal to the DAC 36. Here, the setting of frequency setting information in the RAM 34s and the process of specifying the age-specific sampling frequency based on the user's age by the MCU 34 may be omitted.
[0060] In addition, there may be cases where the sampling frequency specified by referring to the vibration type information is different from the age-specific sampling frequency specified by referring to the frequency setting information. In such a case, the MCU 34 may adopt the lower sampling frequency for outputting the vibration signal and discard the other sampling frequency.
[0061] In the above description, the information processing device 1 is mainly a tablet terminal device, but is not limited to this. The information processing device 1 may be any other type of information communication device that allows information input using the input device 30, such as a personal computer. Furthermore, one or both of the display 21 and the touch sensor 22 may be separate from the information processing device 1 as long as they can be connected to other members of the information processing device 1 by wire or wirelessly.
[0062] As described above, the input device 30 according to this embodiment includes a converter (e.g., DAC 36) that converts a digital vibration signal into an analog vibration signal, a vibrator 40 that vibrates based on the analog vibration signal, and a controller (e.g., MCU 34) that outputs a digital vibration signal to the converter in response to contact with a contact detection unit (e.g., touch sensor 22). The controller can control the sampling frequency of the digital vibration signal to a frequency lower than a predetermined reference frequency. The information processing system S1 according to this embodiment also includes an input device 30 and a host system 10. According to this configuration, the sampling frequency of the digital vibration signal transmitted from the controller to the converter can be controlled to a frequency lower than the reference frequency. Since the sampling frequency of the digital vibration signal is lower than the frequency fixed to the reference frequency, the power consumption related to the transmission of the digital vibration signal can be reduced. Therefore, the availability of the input device 30 can be improved by using a battery with a small capacity.
[0063] The input device 30 may also include a storage medium (e.g., RAM 34s) that stores digital vibration signals of a plurality of vibration types and has a sampling frequency set for each vibration type. The controller may output the digital vibration signal of a vibration type designated by notification information from the host system 10 to the converter at a sampling frequency corresponding to the vibration type. According to this configuration, the digital vibration signal of the vibration type notified from the host system 10 is output to the converter at a sampling frequency corresponding to the vibration type. By setting the lowest possible sampling frequency for each vibration type within a range in which the characteristics of the vibration type are effectively exhibited, it is possible to reduce power consumption while providing the user with an effective feeling of use.
[0064] In addition, a higher sampling frequency may be set for the digital vibration signal of a vibration type having a larger amount of audio components. Generally, the ratio of audio components varies depending on the vibration type, and the audible frequency at which audio is perceived is higher than the frequency at which tactile sensation is perceived. Since the vibration signal of a vibration type with more audio components is provided at a higher sampling frequency, the impression given to the user by the audio components generated by the vibration of the input device 30 is not impaired. By setting the sampling frequency of the digital vibration signal low while maintaining the sound quality, it is possible to reduce power consumption.
[0065] The controller may also set a sampling frequency corresponding to the age of the user based on notification information from the host system 10 . With this configuration, the sampling frequency is set based on the age of the user. Sound components of audible frequencies that can be perceived according to the age of the user are presented by vibration of the input device 30, so that the power consumption of the input device 30 can be reduced without impairing the impression given to the user.
[0066] The host system 10 may obtain age information indicating the user's age from preset user setting information (eg, a user profile), and output the obtained age information to the input device 30 by including it in the notification information. With this configuration, age information is acquired based on preset user setting information and notified to the input device 30. Therefore, a sampling frequency according to the user's age is set in the input device 30 by utilizing the user setting information without any special operation.
[0067] The host system 10 may estimate the age of the user based on the face image of the user, and output the notification information to the input device 30 including age information indicating the estimated age. With this configuration, age information is acquired from the user's face image and notified to the input device 30. Therefore, a sampling frequency according to the age estimated based on the user's face image can be set in the input device 30 without any special operation.
[0068] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above embodiment, and the present invention also includes designs that do not deviate from the gist of the present invention. The configurations described in the above embodiment can be combined in any combination. [Explanation of symbols]
[0069] S1...information processing system, 1...information processing device, 10...host system, 11...processor, 12...main memory, 13...flash memory, 20...touch screen, 21...display, 22...touch sensor, 24...audio system, 26...camera, 28...wireless I / F, 30...input device, 32...wireless I / F, 34...MCU, 36...DAC, 38...amplifier, 40...vibrator, 42...battery, 102...display processing unit, 104...device setting unit, 110...vibration control unit
Claims
1. a converter for converting a digital vibration signal into an analog vibration signal; a vibrator that vibrates based on the analog vibration signal; a controller that outputs the digital vibration signal to the converter in response to a touch on the touch detection unit, The controller: The sampling frequency of the digital vibration signal can be controlled to a frequency lower than a predetermined reference frequency. Input devices.
2. A storage medium is provided which stores digital vibration signals of a plurality of vibration types and has a sampling frequency set for each of the vibration types; The controller: A digital vibration signal of a vibration type designated by notification information from a host system is output to the converter at a sampling frequency corresponding to the vibration type. The input device of claim 1 .
3. The higher the sampling frequency, the more audio components in the digital vibration signal.
3. An input device according to claim 2.
4. The controller: The sampling frequency is set according to the age of the user based on notification information from the host system. The input device of claim 1 .
5. the host system; and an input device according to claim 4. Information processing system.
6. The host system includes: Age information indicating the age is obtained from preset user setting information, and the age information is included in the notification information and output to the input device.
6. The information processing system according to claim 5.
7. The host system includes: An age of the user is estimated based on a face image of the user, and age information indicating the age is included in the notification information and output to the input device.
6. The information processing system according to claim 5.
Citation Information
Patent Citations
Coordinate indicator and coordinate input device using the same
JP1992064119A
Voice extension device, voice contraction device, voice extension method, voice contraction method and program
JP2008046160A
Tactile presentation apparatus and tactile presentation system
JP2021062412A
Apparatus and method for generating sinusoidal waves, and system for driving piezo actuator using the same
US20150171883A1
Decoding device, decoding method, and program
WO2020031483A1