Electronic device

Abstract

This electronic device (1) comprises: a touch panel display (2); a loudspeaker (3); and a piezoelectric actuator (4). The loudspeaker (3) outputs a sound based on a first audio signal corresponding to a sound range equal to or higher than a predetermined frequency. The piezoelectric actuator (4), which is provided to the touch panel display (2), deforms in response to a second audio signal corresponding to a sound range lower than the predetermined frequency and / or a control signal that is for haptic feedback and that is based on a predetermined vibration pattern, and vibrates the touch panel display (2).

Description

[Technical field]

[0001] The present disclosure relates to electronic devices. [Background technology]

[0002] In recent years, while the main body of a portable electronic device such as a smartphone is becoming thinner, there is a trend to enlarge the display area and expand the display area, and high-density mounting is required. For example, Patent Document 1 proposes a technology for outputting sound using a diaphragm.

[0003] Some electronic devices such as smartphones are equipped with a vibration device that vibrates the electronic device in a planar direction. The vibration generated by the vibration device is used for notifying an event such as an incoming call, or for providing feedback in response to a user's touch operation. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2009-219068 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, due to the requirement for high density mounting in conventional electronic devices, it is difficult to secure sufficient space for the speakers mounted in the electronic devices, which results in a problem of poor volume in certain sound ranges, especially in the low range.

[0006] To address this issue, it may be possible to try to output a specific range of sound at a desired volume by using a diaphragm as described in Patent Document 1. However, the technology described in Patent Document 1 has the problem that the vibration of the diaphragm is localized, making it difficult to ensure sufficient vibration strength for a vibration device.

[0007] Therefore, the present disclosure proposes an electronic device that can achieve a desired volume in a specific sound range and ensure a desired vibration strength while meeting the demand for high-density packaging. [Means for solving the problem]

[0008] In order to solve the above problems, an electronic device according to an embodiment of the present disclosure includes a touch panel display, a speaker, a piezoelectric actuator, and a signal control unit. The speaker outputs a sound based on a first audio signal corresponding to a range of sounds equal to or higher than a predetermined frequency. The piezoelectric actuator is provided on the touch panel display and deforms in response to a second audio signal corresponding to a range of sounds lower than the predetermined frequency and a control signal based on a predetermined vibration pattern, thereby vibrating the touch panel display. [Brief description of the drawings]

[0009] [Figure 1] 1 is a plan view illustrating an appearance of an electronic device according to an embodiment of the present disclosure. [Diagram 2] 1 is a plan view showing a positional relationship between a display and a piezoelectric actuator included in an electronic device according to an embodiment of the present disclosure. [Diagram 3] FIG. 1 is a diagram illustrating an example of information processing according to an embodiment of the present disclosure. [Figure 4] FIG. 2 is an enlarged view showing an example of frequency characteristics of an output sound according to an embodiment of the present disclosure. [Diagram 5] FIG. 2 is an enlarged view showing an example of frequency characteristics of an output sound according to an embodiment of the present disclosure. [Figure 6] FIG. 2 is a diagram illustrating an example of signal control according to an embodiment of the present disclosure. [Figure 7] FIG. 2 is a diagram illustrating an example of signal control according to an embodiment of the present disclosure. [Figure 8] FIG. 2 is a block diagram showing an example of a functional configuration of an electronic device according to an embodiment of the present disclosure. [Figure 9] 10 is a flowchart illustrating an example of a processing procedure performed by the electronic device according to an embodiment of the present disclosure. [Figure 10]FIG. 11 is a diagram showing an example of frequency characteristics of sound reproduced by an electronic device according to a comparative example. [Figure 11] 1 is a diagram illustrating an example of frequency characteristics of sound reproduced by an electronic device according to an embodiment of the present disclosure. [Figure 12] 1 is a diagram for explaining frequency characteristics of sound reproduced by an electronic device according to an embodiment of the present disclosure. [Figure 13] FIG. 2 is a block diagram illustrating an example of a hardware configuration of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. The embodiments of the present disclosure can be applied to all electronic devices that have speakers, have an audio playback function, and require high density mounting due to their thinning and miniaturization, such as smartphones, tablets, and notebook personal computers.

[0011] In the following embodiments, the same parts may be designated by the same numbers or symbols to avoid repetitive explanations. In addition, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by designating different numbers or symbols after the same number or symbol.

[0012] The present disclosure will be described in the following order. 1. Overview of Electronic Device According to an Embodiment of the Present Disclosure 2. Example of information processing of electronic device according to embodiment of the present disclosure 3. Configuration example of electronic device according to embodiment of the present disclosure 4. Example of processing procedure of electronic device according to embodiment of the present disclosure 5.Other 5-1.An example of the frequency characteristics of a playback signal 5-2. Hardware configuration example 6. Conclusion

[0013] <<1. Overview of Electronic Device According to an Embodiment of the Present Disclosure>> Hereinafter, an overview of an electronic device according to an embodiment of the present disclosure will be described. Fig. 1 is a plan view showing the appearance of an electronic device according to an embodiment of the present disclosure. Fig. 2 is a plan view showing the positional relationship between a display and a piezoelectric actuator included in the electronic device according to an embodiment of the present disclosure.

[0014] 1, an electronic device 1 (a smartphone, as an example) according to an embodiment of the present disclosure has a substantially rectangular housing 1H. Also, as shown in FIGS. 1 and 2, the electronic device 1 has a touch panel display 2, speakers 3 (3a, 3b), and a piezoelectric actuator 4.

[0015] The electronic device 1 has a touch panel display 2 on the front face of a housing 1H. The touch panel display 2 has a touch panel 2a and a display 2b.

[0016] The touch panel 2a detects contact with a finger, a pen, a stylus pen, or the like on the touch panel 2a. The display 2b displays characters, images, symbols, figures, and the like. The display 2b has a surface SF 1 And Surface SF 1 The back surface SF facing 2 The surface SF of the display 2b 1 corresponds to the display surface side of the display 2b, and is exposed, for example, toward the outside of the housing 1H. 2 is housed inside the housing 1H without being exposed to the outside of the housing 1H. The display 2b functions as a vibrating body that vibrates when excited.

[0017] The speaker 3 is, for example, a stereo speaker provided in the housing 1H, and outputs sounds based on audio signals from various sound sources. Sounds based on first audio signals corresponding to mid-range and treble ranges extracted from the audio signals from various sound sources are output. Examples of mid-range and treble range sounds include sounds in the range of 800 Hz (Hertz) or higher.

[0018] The piezo actuator 4 is provided on the display 2b, which is a vibrating body, and deforms in response to a second audio signal corresponding to a low-pitched range and a control signal for haptic feedback based on a predetermined vibration pattern, thereby vibrating the display 2b. For example, the piezo actuator 4 is arranged so as to deform in the front-rear direction of the housing 1H. The piezo actuator 4 causes the display 2b, which is a vibrating body, to function as an acoustic device that outputs low-pitched sounds, and as a vibration device (Haptics device) that uses vibration to feed back tactile stimuli (such as a striking sensation) in response to a user's operation. An example of a low-pitched sound is a sound in a range of less than 800 Hz (Hertz).

[0019] 2, the piezoelectric actuator 4 is provided by adhesion or the like at a position where the vibration of the display 2b is greatest (for example, near the center of the display 2b). This allows the vibration generated by the deformation of the piezoelectric actuator 4 to be efficiently propagated to the display 2b.

[0020] <<2. Example of Information Processing of Electronic Device According to Embodiment of the Present Disclosure>> An example of information processing of the electronic device according to the embodiment of the present disclosure will be described below. Fig. 3 is a diagram showing an example of information processing according to the embodiment of the present disclosure. Figs. 4 and 5 are enlarged views showing an example of frequency characteristics of an output sound according to the embodiment of the present disclosure. Figs. 6 and 7 are diagrams showing an example of signal control according to the embodiment of the present disclosure.

[0021] In electronic devices requiring high density mounting, the size of the speaker must be reduced, making it difficult to obtain a desired volume for a certain range of sound (especially the low range). Meanwhile, the display area of ​​the display of electronic devices tends to expand. In view of this, the electronic device 1 according to the embodiment of the present disclosure assigns the output of mid- and high-range sounds above a certain frequency to the speaker 3, and assigns the output of low-range sounds below the certain frequency to the display 2b functioning as an audio device. This makes it possible to obtain a desired volume for a certain range of sound, i.e., the low range, for which it was previously difficult to obtain a predetermined volume in electronic devices requiring high density mounting.

[0022] 3, the electronic device 1 extracts a first audio signal corresponding to a mid-range and a high-range (hereinafter, referred to as "mid-range and high-range") above a predetermined frequency from audio signals based on various sound sources such as media audio, sound effect signals, and incoming call and notification sounds (P3-1). An example of a mid-range and a high-range above a predetermined frequency is a range of 800 Hz (Hertz) or more.

[0023] The media sound is the sound of multimedia content such as music and video. The sound effects are system sounds that are played in conjunction with the operation of the user of the electronic device 1. The incoming call / notification sound is a sound that notifies the user of events that occur in the electronic device 1, such as incoming calls or emails, or push notifications from applications.

[0024] When extracting a first audio signal, the electronic device 1 according to the embodiment of the present disclosure cuts out a part of the range of sounds that the speaker 3 can reproduce as audible sounds (a range of sounds below 800 Hz). This adjusts the range of sounds to be allocated to the speaker 3 toward the higher range side to make the most of the performance of the speaker 3 as much as possible. Note that the part of the range of sounds that is cut out from the range that can be reproduced by the speaker 3 is supplemented by the output from the display 2b, which will be described later.

[0025] Curve F shown in FIG. 3 and FIG. 14 illustrates an example of the frequency characteristic of the first audio signal (a mid- to high-frequency sound output from the speaker 3). As shown in FIG. 4, the frequency components included in the first audio signal include a maximum amplitude “Y 1 Most of the peak frequencies are at frequency "X 11 ”~Frequency “X 12 Of the audio signals based on various sound sources such as media audio, sound effect signals, and incoming call / notification sounds, for example, audio signals of 800 Hz or higher are output from the speaker 3.

[0026] The extracted first audio signal undergoes a predetermined conversion by the conversion unit 31 and a predetermined amplification by the amplification unit 32, and is then input to the speaker 3. The speaker 3 outputs sounds based on the first audio signal corresponding to the mid- to high-frequency range.

[0027] Furthermore, the electronic device 1 extracts (P3-2) a second audio signal corresponding to a low frequency range below a predetermined frequency from audio signals based on various sound sources such as media audio, sound effect signals, and incoming call / notification sounds. An example of a low frequency range below a predetermined frequency is a range from a certain lower limit frequency to below 800 Hz.

[0028] The electronic device 1 is a device that emits a low-frequency sound at the lower limit of the bass range (frequency “X” in FIG. 5). 21 As the "lower limit of the bass range," a frequency that cannot be heard as sound unless the user places his / her head close to the display 2b is adopted among audible sounds. The frequency that defines the lower limit of the bass range can be adopted from the range of 100 to 200 Hz, for example. Note that vibrations in this frequency band can be recognized by the sense of touch.

[0029] Curve F shown in FIG. 3 and FIG. 2 3 illustrates an example of the frequency characteristic of the second audio signal (low-pitched sound). More specifically, it illustrates the characteristic of the output signal when the second audio signal is output from the amplifier 34. The low-pitched sound output based on the second audio signal is reproduced by vibration of the display 2b.

[0030] As shown in FIG. 5, the frequency components included in the second audio signal have the maximum amplitude “Y 2 Most of the peak frequencies are at frequency "X 21 ”~Frequency “X 22 ". Note that this frequency "X 21 ”~Frequency “X 22 The range of "X" is the mid-to-high frequency range mentioned above. 11 ”~Frequency “X 12 This makes it possible to prevent loss of frequency components in the reproduced sound.

[0031] The extracted second audio signal undergoes a predetermined conversion by the conversion unit 33 and a predetermined amplification by the amplification unit 34, and is then input to the piezo actuator 4. The piezo actuator 4 deforms in response to the second audio signal corresponding to the low-frequency range, and vibrates the display 2b. The display 2b vibrates in response to the deformation of the piezo actuator 4, and outputs a sound based on the second audio signal corresponding to the low-frequency range sound.

[0032] Moreover, the electronic device 1 according to the embodiment of the present disclosure focuses on the tendency for the display area of ​​the display 2b to expand, and applies the display 2b as a vibration device (haptic device). This makes a vibrator or the like that has been conventionally used as a vibration device unnecessary, and meets the demand for high-density mounting. Furthermore, as the display area of ​​the display 2b expands, the electronic device 1 can increase the amplitude of vibration compared to when a conventional display is used as a vibration device, and can ensure the desired vibration strength.

[0033] As shown in Fig. 3, the electronic device 1 generates a tone based on a predetermined vibration pattern according to an incoming call / notification vibration command (P3-3). Specifically, the electronic device 1 determines a vibration pattern for the display 2b by referring to the first tone data, and inputs a control signal for haptic feedback based on the determined vibration pattern to the piezo actuator 4. The piezo actuator 4 deforms in response to the input control signal for haptic feedback, and vibrates the display 2b. The display 2b vibrates according to the vibration pattern, and reproduces a tone corresponding to the vibration pattern.

[0034] The electronic device 1 also generates a tone based on a predetermined vibration pattern in accordance with the touch feedback command (P3-4). This causes the display 2b to generate a vibration to provide a tactile stimulus (such as a touch sensation) as feedback to the user's operation. The specific processing is the same as that for generating a tone based on an incoming call / notification vibration command.

[0035] Curve F shown in FIG. 3 and FIG. 3 Curve F exemplifies the frequency characteristics of a composite signal obtained by mixing the second audio signal with a control signal for haptic feedback that drives the piezo actuator 4. More specifically, it shows the characteristics of an output signal when a composite signal obtained by mixing the second audio signal with a control signal for haptic feedback is output from the amplifier 34. 3 As shown in FIG. 1, the frequency characteristic of the synthetic signal has a different characteristic from the frequency characteristic of the second audio signal.

[0036] Specifically, the synthesized signal has a maximum amplitude “Y 3 In the electronic device 1, the peak frequency of the synthetic signal is at the lower limit of the frequency band including the frequency component of the second audio signal (frequency “X 21 The frequency band for adjusting the peak frequency of the synthesized signal (frequency "X" 31 ”~Frequency “X21 For example, a range of 100 to 200 Hz is adopted as the frequency range of the second audio signal (the "frequency range"). Vibrations of 100 to 200 Hz are difficult to hear as sound, but can be recognized by touch. In other words, the peak frequency of the synthetic signal is adjusted to be in a frequency band that is difficult to hear as sound, but easy to recognize by touch. In the electronic device 1, for example, if 150 Hz is adopted as the lower limit of the frequency band that includes the frequency components of the second audio signal (low-pitched sound), the peak frequency of the synthetic signal is adjusted to be in the range of 100 to less than 150 Hz.

[0037] In addition, the vibration reproduced by the display 2b based on the composite signal is more sensitive to the frequency "X" than the vibration reproduced by the display 2b based on the second audio signal. 31 ”~Frequency “X 32 " range has a smaller amplitude. That is, the bass sound when reproduced by display 2b based on the synthesized signal is smaller than the bass sound when reproduced by display 2b based on the second audio signal.

[0038] In addition, when the electronic device 1 inputs the above-mentioned composite signal to the piezoelectric actuator 4, it performs signal control to modulate the second audio signal so that the vibration of the display 2b based on the control signal for haptic feedback is prioritized over the vibration of the display 2b based on the second audio signal (P3-5).

[0039] The signal control for modulating the second audio signal is performed by at least one of suppressing the output level of the second audio signal and limiting the band of the second audio signal, as described below.

[0040] When suppressing the output level of the second audio signal, the electronic device 1 suppresses the output level of the second audio signal so that the amplitude of the second audio signal is smaller than the amplitude of the control signal for haptic feedback. 1 As shown in FIG. 1, the electronic device 1 detects a curve F corresponding to the second audio signal. 2 The maximum amplitude of "Y2 ” is the curve F corresponding to the control signal for haptic feedback. 3 The maximum amplitude of "Y 3 " The output level of the second audio signal is suppressed so as to be smaller than ".

[0041] When limiting the band of the second audio signal, the electronic device 1 limits the band of the second audio signal so as to attenuate the low-frequency side of the frequency components included in the second audio signal. 2 As shown in FIG. 1, the electronic device 1 receives the lower limit frequency “X 21 " to the higher frequency side, the frequency band of the second audio signal is shifted to the frequency "X 23 ”~Frequency “X 24 6 or 7. The electronic device 1 may perform both the suppression of the output level of the second audio signal shown in FIG. 6 and the band limitation of the second audio signal shown in FIG.

[0042] As described above, the electronic device 1 according to the embodiment of the present disclosure allocates the output of low-frequency sounds to the display 2b that functions as an audio device. This makes it possible to increase the volume of a specific range of sounds, i.e., the low-frequency range, which is difficult to achieve at a certain volume in electronic devices that require high-density packaging, and to obtain a desired volume.

[0043] In addition, the electronic device 1 according to the embodiment of the present disclosure utilizes the display 2b, which has a tendency to expand in display area, as a vibration device (haptic device). This makes existing vibration devices such as vibrators unnecessary, and ensures the desired vibration strength while meeting the demand for high-density mounting.

[0044] In this way, the electronic device 1 according to the embodiment of the present disclosure can achieve a desired volume in a specific sound range and ensure a desired vibration strength while meeting the demand for high density mounting.

[0045] Furthermore, when the electronic device 1 according to the embodiment of the present disclosure inputs a composite signal obtained by mixing the second audio signal and the control signal for haptic feedback to the piezo actuator 4, the electronic device 1 modulates the second audio signal so that the vibration of the display 2b based on the control signal for haptic feedback is prioritized over the vibration of the display 2b based on the second audio signal. This makes it possible to prevent the output of tactile feedback to the user due to vibration from being buried in the output of low-frequency sounds, and achieves the objective of allowing the user to clearly perceive the vibration of the display 2b and strongly feel the vibration effect of the haptic feedback.

[0046] <<3. Configuration Examples of Electronic Devices According to Embodiments of the Present Disclosure>> A configuration example of the electronic device according to the embodiment of the present disclosure will be described below. Fig. 8 is a block diagram showing an example of the functional configuration of the electronic device according to the embodiment of the present disclosure.

[0047] 8, the electronic device 1 includes a touch panel display 2, a speaker 3, a piezoelectric actuator 4, a storage unit 10, a control unit 20, a conversion unit 31, an amplification unit 32, a conversion unit 33, and an amplification unit 34. With these units, the electronic device 1 realizes or executes the functions and actions of the electronic device 1 described below.

[0048] The touch panel display 2 has a touch panel 2a and a display 2b, and functions as an operation device that accepts operations by a user and a display device that displays various information and the like.

[0049] The touch panel 2a can detect the position where a finger, a pen, a stylus pen, or the like touches the touch panel 2a. When the touch panel 2a detects a touch on the touch panel 2a, it notifies the control unit 20 of the detected position of the touch. The detection method of the touch panel 2a may be any method such as a capacitance method, a resistive film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, or a load detection method.

[0050] The display 2b includes an organic or inorganic EL panel (Electro-Luminescence panel) or the like, and displays characters, images, symbols, figures, various information, and the like. The display 2b may be implemented with a display device other than an EL panel as long as it is vibrable. 2 A piezoelectric actuator 4 is provided on the display 2b (see FIG. 2, etc.) by means of adhesion or the like. The display 2b functions as a vibrating body that vibrates when excited by the piezoelectric actuator 4.

[0051] The speaker 3 includes a first speaker 3a and a second speaker 3b, and outputs sounds based on a first audio signal in the mid-range and treble range extracted from audio signals of various sound sources.

[0052] The piezo actuator 4 deforms in response to a second audio signal corresponding to a low-frequency range and a predetermined control signal for haptic feedback, and vibrates the display 2b. The piezo actuator 4 includes a piezoelectric element. The piezoelectric element included in the piezo actuator 4 is continuously deformed (expands and contracts) in a planar direction by a predetermined signal (such as an alternating signal) over time. The continuous deformation of the piezoelectric element is propagated to the display 2b, thereby vibrating the display 2b. The piezo actuator 4 causes the display 2b, which is a vibrating body, to function as an acoustic device (woofer) that outputs low-frequency sounds. The piezo actuator 4 also causes the display 2b, which is a vibrating body, to function as a vibration device (haptic device) that feeds back tactile stimuli (such as a touch) in response to a user's operation by vibration.

[0053] The piezoelectric actuator 4 is attached to the rear surface SF of the display 2b by means of a bonding method or the like. 2 The piezoelectric actuator 4 is provided at a position where the vibration of the display 2b is the largest, for example, on the rear surface SF of the display 2b. 2 When the display 2b is made to function as an acoustic device (woofer), the piezoelectric actuator 4 may be installed taking into consideration the positional relationship with the speaker 3.

[0054] The storage unit 10 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 10 functions as a storage means of the control unit 20.

[0055] As shown in FIG. 8, the storage unit 10 has a first tone data storage unit 11, a second tone data storage unit 12, and a signal control data storage unit 13.

[0056] The first tone data storage unit 11 stores data of a vibration pattern preset to reproduce vibration based on an incoming call / notification vibration command. The data of the vibration pattern stored in the first tone data storage unit 11 is used in a process of generating a control signal for haptic feedback corresponding to the vibration pattern in the first generating unit 23 described later. The vibration pattern for reproducing vibration based on an incoming call / notification vibration command is pre-adjusted to have a peak frequency between 100 and 200 Hz. The vibration pattern stored in the first tone data storage unit 11 has a different vibration pattern from the second tone data storage unit 12 described later.

[0057] The second tone data storage unit 12 stores data of a vibration pattern preset to reproduce a vibration based on a touch feedback command. The data of the vibration pattern stored in the second tone data storage unit 12 is used in a process of generating a control signal for haptic feedback corresponding to the vibration pattern in the second generating unit 24 described later. The vibration pattern for reproducing the vibration based on the touch feedback command is pre-adjusted so that the frequency has a peak frequency between 100 and 200 Hz. The vibration pattern stored in the second tone data storage unit 12 has a vibration pattern different from that of the first tone data storage unit 11 described above.

[0058] The signal control data storage unit 13 stores signal control data for modulating the second audio signal input to the piezo actuator 4. The signal control data stored in the signal control data storage unit 13 is, for example, an output level suppression threshold for suppressing the output level of the second audio signal, or a band limiting threshold for limiting the frequency band of the second audio signal. The signal control data stored in the signal control data storage unit 13 is used for signal control processing by a signal control unit 25 described later.

[0059] Mixing part M 1 and mixing section M 2 are provided as separate input systems. 1 The mixer M appropriately mixes audio signals based on various sound sources such as media audio, sound effect signals, and incoming / notification sounds, and sends the mixed audio signals to the first signal processor 21. 2 The mixer M appropriately mixes audio signals based on various sound sources such as media audio, sound effect signals, and incoming / notification sounds, and sends the mixed audio signals to the second signal processor 22. 3 The second audio signal input from the second signal processing unit 22 and the control signal for haptic feedback input from the first generating unit 23 or the second generating unit 24 are appropriately mixed together and sent to the converting unit 33 .

[0060] 8, the control unit 20 has a first signal processing unit 21, a second signal processing unit 22, a first generating unit 23, a second generating unit 24, and a signal control unit 25. The control unit 20 realizes or executes the functions and actions of the electronic device 1 described below by using these units.

[0061] Each block constituting the control unit 20 (first signal processing unit 21 to signal control unit 25) is a functional block indicating a function of the electronic device 1. These functional blocks may be software blocks or hardware blocks. For example, each of the above-mentioned functional blocks may be a software module realized by software (including a microprogram), or may be a circuit block on a semiconductor chip (die). Of course, each functional block may be a processor or an integrated circuit. The functional blocks may be configured in any manner. The electronic device 1 may be configured by functional units different from the above-mentioned functional blocks.

[0062] The first signal processing unit 21 includes a mixing unit M 1 The first signal processing unit 21 extracts a first audio signal corresponding to a mid- to high-pitched range above a predetermined frequency from an input audio signal input from the first signal processing unit 21. For example, the first signal processing unit 21 cuts low frequency components from the input audio signal by filtering using a high-pass filter or the like. As a result, the first signal processing unit 21 extracts a first audio signal corresponding to a mid- to high-pitched range from the input audio signal. The first signal processing unit 21 sends the extracted first audio signal to the conversion unit 31. An example of the mid- to high-pitched range is a range of 800 Hz (Hertz) or higher.

[0063] Conventionally, among the audio signals output from a speaker, low-frequency audio signals that cannot be adequately reproduced by the speaker and are lost as heat loss are cut. On the other hand, in the electronic device 1 according to the embodiment of the present disclosure, not only the portion of the audio signal input to the speaker 3 that becomes heat loss but also a part of the reproducible range is cut, and the low-frequency output is allocated to the display 2b to supplement it. This makes it possible to fully utilize the performance of the speaker 3, which excels in reproducing mid- and high-frequency sounds, and improves the volume and sound quality reproduced by the electronic device 1.

[0064] The second signal processing unit 22 is a mixing unit M 2The second signal processing unit 22 extracts a second audio signal corresponding to a low-pitched range from an input audio signal input from the input terminal 32. For example, the second signal processing unit 22 cuts high-frequency components from the input audio signal by filtering using a low-pass filter or the like. As a result, the second signal processing unit 22 extracts a second audio signal corresponding to a low-pitched range from the input audio signal. The second signal processing unit 22 sends the extracted second audio signal to the conversion unit 33. An example of the low-pitched range is a range of 200 Hz or more and less than 800 Hz. The lower limit of the low-pitched range can be arbitrarily determined between 100 and 200 Hz.

[0065] Furthermore, when the second signal processing unit 22 acquires a modulation command for the second audio signal from the signal control unit 25, the second signal processing unit 22 modulates the second audio signal based on the modulation command, and then transmits the modulated audio signal to the conversion unit 33. When the second signal processing unit 22 acquires a suppression degree of the output level of the second audio signal as a modulation command, the second signal processing unit 22 suppresses the output level of the second audio signal based on this degree, for example, so that the amplitude of the second audio signal is smaller than the amplitude of the PCM audio signal. When the second signal processing unit 22 acquires a limitation degree of the band limit of the second audio signal as a modulation command, the second signal processing unit 22 limits the band of the second audio signal based on this degree, for example, so that the low frequency side of the frequency components included in the second audio signal is attenuated. The second signal processing unit 22 limits a part of the band including the frequency components of the second audio signal, for example, by filtering using a band pass filter or the like.

[0066] The first generating unit 23 generates a PCM (Pulse Code Modulation) audio signal (an example of a control signal for haptic feedback) for generating a tone based on an incoming call / notification vibration command on the display 2b based on the vibration pattern data stored in the first tone data storage unit 11. The first generating unit 23 mixes the generated PCM audio signal into a mixer M. 3 The first generating unit 23 also outputs the generated PCM audio signal to the mixer M. 3 , the PCM audio signal is also sent to the signal control unit 25.

[0067] The second generating unit 24 generates a PCM audio signal (an example of a control signal for haptic feedback) for generating a tone based on a touch feedback command on the display 2b based on the vibration pattern data stored in the second tone data storage unit 12. The second generating unit 24 mixes the generated PCM audio signal into a mixing unit M. 3 Send to.

[0068] When the signal control unit 25 mixes the second audio signal and the PCM audio signal and inputs them to the piezoelectric actuator 4, it modulates the second audio signal so that the vibration of the display 2b corresponding to the PCM audio signal is given priority over the vibration of the display 2b corresponding to the second audio signal.

[0069] Specifically, when the signal control unit 25 acquires a PCM audio signal from the first generating unit 23 or the second generating unit 24, the signal control unit 25 refers to a signal control threshold stored in the signal control data storage unit 13 and determines the degree of suppression of the output level of the second audio signal. For example, it is desirable to set the degree of suppression of the second audio signal so that at least the amplitude of the second audio signal is smaller than the amplitude of the PCM audio signal. The signal control unit 25 sends a modulation command indicating the determined degree of suppression of the second audio signal to the second signal processing unit 22.

[0070] Furthermore, the signal control unit 25 may limit the frequency band of the second audio signal so that the vibration of the display 2b in response to the PCM audio signal is prioritized over the vibration of the display 2b in response to the second audio signal. For example, the signal control unit 25 determines the degree of limitation of the frequency band of the second audio signal so as to attenuate at least a part of the frequency components included in the second audio signal. The signal control unit 25 sends a modulation command indicating the determined degree of band limitation to the second signal processing unit 22. Note that the signal control unit 25 may simultaneously suppress the output level of the second audio signal and limit the band.

[0071] The signal control unit 25 may control the PCM audio signal (an example of a control signal for haptic feedback) to have a higher priority than the second audio signal by a method other than suppressing the output level of the second audio signal or limiting the band of the second audio signal. Specifically, the electronic device 1 makes the playback time of the control signal for haptic feedback longer than the playback time of the second audio signal. This makes it possible to achieve the objective of making the user feel the vibration effect of the haptic feedback more strongly.

[0072] The range and volume of sounds that can be reproduced by the electronic device 1 vary depending on the area and rigidity of the display 2b. In general, the larger the area and the lower the rigidity of the display 2b, the larger the amplitude caused by the deformation of the installed piezo actuator 4, and the wider the bass range and the louder the volume that can be reproduced by the electronic device 1. For this reason, the electronic device 1 may arbitrarily change the range of the bass range and the range of vibration reproduced by the display 2b depending on the area and rigidity of the display 2b.

[0073] The conversion unit 31 converts the first audio signal acquired from the first signal processing unit 21 and sends it to the amplification unit 32. The amplification unit 32 amplifies the first audio signal acquired from the conversion unit 31 and sends it to the speaker 3. The conversion unit 31 can be realized by a DAC (Digital Analogue Converter) or the like, and the amplification unit 32 can be realized by an amplifier or the like.

[0074] The conversion unit 33 is a mixing unit M 3 The conversion unit 33 converts the signal acquired from the amplifier 34 and sends it to the amplifier 34. The amplifier 34 amplifies the signal acquired from the conversion unit 33 and sends it to the piezo actuator 4. The signal sent from the amplifier 34 to the piezo actuator 4 is assumed to be the second audio signal, the PCM audio signal, or a composite signal in which the second audio signal and the PCM audio signal are mixed. The conversion unit 33 can be realized by a DAC (Digital Analogue Converter) or the like, and the amplifier 34 can be realized by an amplifier or the like.

[0075] <<4. Example of Processing Procedure of Electronic Device According to Embodiment of the Present Disclosure>> Hereinafter, a processing procedure of the electronic device 1 according to an embodiment of the present disclosure will be described. Fig. 9 is a flowchart showing an example of a processing procedure by the electronic device according to an embodiment of the present disclosure. The processing procedure shown in Fig. 9 is repeatedly executed while the electronic device 1 is in operation.

[0076] As shown in FIG. 9, the signal control unit 25 acquires a PCM audio signal from the first generating unit 23 or the second generating unit 24 (step S101).

[0077] The signal control unit 25 refers to the signal control data stored in the signal control data storage unit 13 and determines the degree of suppression of the output level of the second audio signal (step S102).

[0078] The signal control section 25 sends a modulation command indicating the determined degree of suppression to the second signal processing section 22 (step S103), and the process returns to the processing procedure of step S101.

[0079] 9, when the second audio signal and the PCM audio signal are mixed and input to the piezo actuator 4, the signal control unit 25 can modulate the second audio signal so that the vibration of the display 2b corresponding to the PCM audio signal takes precedence over the vibration of the display 2b corresponding to the second audio signal. This allows the user to clearly perceive the vibration of the display 2b corresponding to the PCM audio signal, thereby achieving the objective of making the user strongly feel the vibration effect of the haptic feedback.

[0080] <<5.Other>> <5-1. An example of frequency characteristics of a reproduction signal according to the present disclosure> Hereinafter, a comparison result between the sound reproduced by the electronic device 1 according to the embodiment of the present disclosure and the sound reproduced by a conventional electronic device according to a comparative example will be described. FIG. 10 is a diagram showing an example of the frequency characteristics of the sound reproduced by the electronic device according to the comparative example. FIG. 11 is a diagram showing an example of the frequency characteristics of the sound reproduced by the electronic device according to the embodiment of the present disclosure. FIG. 12 is a diagram for explaining the frequency characteristics of the sound reproduced by the electronic device according to the embodiment of the present disclosure.

[0081] As shown in Fig. 10, the sound reproduced by the electronic device according to the comparative example has a weak output (low volume) in the bass range below 800 Hz (Hertz). On the other hand, as shown in Fig. 11, the sound reproduced by the electronic device 1 according to the embodiment of the present disclosure has a stronger output (higher volume) in the bass range below 800 Hz (Hertz) than the electronic device according to the comparative example. That is, as shown in Fig. 12, the sound reproduced by the electronic device 1 according to the embodiment of the present disclosure can increase the volume of each frequency component below 800 Hz (Hertz) by about 12.5 to 25 dB (decibels) compared to the electronic device according to the comparative example.

[0082] The piezo actuator 4 of the electronic device 1 of the present disclosure can also cause the display 2b to function as an acoustic device that outputs mid- and high-range sounds. However, the mid- and high-range sounds can be obtained at a sufficient volume by the speaker 3 to which the output of the corresponding sounds is assigned. Therefore, the piezo actuator 4 causes the display 2b to function only as an acoustic device that outputs low-range sounds. In this way, the electronic device 1 according to the embodiment of the present disclosure can raise the volume of a certain range of sounds, for example, a low range of sounds below 800 Hz (Hertz), which was difficult to obtain at a certain volume in conventional electronic devices that require high-density mounting, and can realize powerful sound reproduction.

[0083] 8 and 9, when the electronic device 1 mixes a second audio signal corresponding to a low-pitched range with a PCM audio signal (an example of a control signal for haptic feedback) based on a predetermined vibration pattern and inputs the resulting mixture to the piezo actuator 4, the electronic device 1 executes signal control to modulate the second audio signal so that the vibration of the display 2b corresponding to the PCM audio signal takes precedence over the vibration of the display 2b corresponding to the second audio signal. This allows the user to clearly perceive the vibration of the display 2b corresponding to the PCM audio signal.

[0084] <5-2. Hardware configuration example> Hereinafter, a hardware configuration example of the electronic device 1 according to the embodiment of the present disclosure will be described with reference to Fig. 13. Fig. 13 is a block diagram showing a hardware configuration example of the electronic device according to the embodiment of the present disclosure. Information processing by the electronic device 1 according to the embodiment of the present disclosure can be realized by cooperation between software that provides a function for realizing information processing by the electronic device 1 and hardware described below.

[0085] The electronic device 1 includes a central processing unit (CPU) 201, a read only memory (ROM) 203, and a random access memory (RAM) 205. The electronic device 1 also includes an input device 207, an output device 209, a vibration device 211, a storage device 213, and a communication device 215.

[0086] The CPU 201 functions as an arithmetic processing device and a control device, and controls the overall operation of the electronic device 1 in accordance with various programs. Note that the CPU 201 is an example of a control device mounted on the electronic device 1, and may be another processor such as an MPU (Micro Processing Unit).

[0087] ROM 203 stores programs and calculation parameters used by CPU 201. RAM 205 temporarily stores programs used in execution by CPU 201 and parameters that change appropriately during execution. These are connected to each other by a host bus consisting of a CPU bus and the like. CPU 201, ROM 203 and RAM 205 can realize the functions of each part (first signal processing part 21 to signal control part 25) of control part 20 described with reference to FIG. 8 and the like.

[0088] The input device 207 is composed of input means such as a button, a camera, a microphone, a sensor, a switch, and a lever for the user to input information, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 201. For example, the touch panel 2a shown in FIG.

[0089] The output device 209 can be realized by, for example, a display device such as a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), or an organic EL display, or an audio output device such as a speaker, a headphone, etc. For example, the display 2b shown in FIG.

[0090] The vibration device 211 is a device that generates vibrations in accordance with a control signal for haptic feedback from the CPU 201. For example, the piezo actuator 4 shown in FIG.

[0091] The storage device 213 is a device for storing data. The storage device 213 may include a storage medium, a recording device for recording data in the storage medium, a reading device for reading data from the storage medium, and a deleting device for deleting data recorded in the storage medium. The storage device 213 is configured, for example, with a hard disk drive (HDD) or a solid storage drive (SSD), or a memory having an equivalent function. The storage device 213 drives the storage and stores the programs executed by the CPU 201 and various data. For example, the function of the storage unit 10 shown in FIG. 8 is realized by the storage device 213.

[0092] The communication device 215 is, for example, a communication interface configured with a communication device for connecting to a network. Such a communication interface is, for example, a short-range wireless communication interface such as Bluetooth (registered trademark) or ZigBee (registered trademark), a wireless LAN (Local Area Network), Wi-Fi, or a mobile communication network. Mobile communication networks include LTE (Long Term Evolution), 4G, 5G, and the like. The communication device 215 may also be a wired communication device that performs wired communication.

[0093] <<6. Conclusion>> The electronic device 1 according to the embodiment of the present disclosure includes a display 2b (an example of a vibrating body), a speaker 3, a piezo actuator 4, and a signal control unit 25. The speaker 3 outputs sound based on a first audio signal corresponding to a mid-range and a high-range. The piezo actuator 4 is provided on the display 2b, and deforms in response to a second audio signal corresponding to a low-range or a PCM audio signal based on a predetermined vibration pattern (an example of a control signal for haptic feedback), thereby vibrating the display 2b.

[0094] In this way, by being provided with the above-mentioned configuration, the electronic device 1 can allocate the output of low-frequency sounds to the display 2b functioning as an audio device. This makes it possible to increase the volume of a specific range of sounds, i.e., the low-frequency range, which has been difficult to achieve in electronic devices that require high-density packaging, and to obtain a desired volume. Furthermore, the electronic device 1 causes the display 2b, which has a tendency to expand in display area, to function as a vibration device (haptic device). This makes existing vibration devices such as vibrators unnecessary, and makes it possible to ensure the desired vibration strength while meeting the demand for high-density packaging.

[0095] Furthermore, when the second audio signal and the PCM audio signal are mixed and input to the piezo actuator 4, the electronic device 1 further includes a signal control unit 25 that modulates the second audio signal so that the vibration of the display 2b corresponding to the PCM audio signal takes precedence over the vibration of the display 2b corresponding to the second audio signal. This makes it possible to prevent the output of tactile feedback to the user due to vibration from being buried in the output of low-frequency sounds when the display 2b functions as an acoustic device and a vibration device (haptic device), and allows the user to clearly perceive the vibration of the display 2b, thereby making it possible for the user to strongly feel the vibration effect of the haptic feedback.

[0096] Furthermore, the signal control unit 25 suppresses the output level of the second audio signal so that the amplitude of the second audio signal is smaller than the amplitude of the PCM audio signal. This makes it possible to increase the difference between the vibration corresponding to the low-frequency sound and the vibration corresponding to the feedback to the user, etc., and allows the user to clearly perceive the tactile feedback to the user, etc., and as a result, it becomes possible for the user to strongly feel the vibration effect of the haptic feedback.

[0097] Furthermore, the signal control unit 25 limits the frequency band of the second audio signal so as to attenuate at least a part of the frequency components contained in the second audio signal. This makes it possible to increase the difference between the vibration corresponding to the low-frequency sound and the vibration corresponding to the feedback to the user, etc., and allows the user to clearly perceive the tactile feedback to the user, etc., and as a result, the user can strongly feel the vibration effect of the haptic feedback.

[0098] Furthermore, the signal control unit 25 suppresses the output level of the second audio signal so that the amplitude of the second audio signal is smaller than the amplitude of the PCM audio signal, and limits the band of the second audio signal so as to attenuate the low frequency side of the second audio signal. This makes it possible to increase the difference between the vibration corresponding to the low frequency sound and the vibration corresponding to the feedback to the user, etc., and allows the user to more clearly perceive the tactile feedback to the user.

[0099] Furthermore, the signal control unit 25 makes the playback time of the PCM audio signal longer than the playback time of the second audio signal, thereby making it possible for the user to feel the vibration effect of the haptic feedback more strongly.

[0100] In addition, in the electronic device 1, the display 2b functions as a vibrating body, and the piezoelectric actuator 4 vibrates the surface SF of the display 2b. 1 Opposing back surface SF 2 This allows the display 2b to function as a vibration device without impeding its function as a display device.

[0101] Furthermore, the piezoelectric actuator 4 is provided at a position where the vibration of the display 2b is greatest, thereby making it possible to increase the vibration efficiency of the display 2b.

[0102] The piezoelectric actuator 4 is connected to the rear surface SF of the display 2b. 2 This allows the vibrations generated by the piezo actuator 4 to be efficiently transmitted to the display 2b.

[0103] The piezoelectric actuator 4 may also be provided in the touch panel 2a. For example, when the touch panel 2a is superimposed on the display 2b, the piezoelectric actuator 4 may be provided in the touch panel 2a instead of the display 2b. This makes it easier for the user to feel the user feedback than if the piezoelectric actuator 4 were provided in the display 2b.

[0104] Although the embodiments of the present disclosure have been described above, the technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present disclosure. In addition, components of different embodiments and modifications may be appropriately combined.

[0105] For example, in the above embodiment, the piezo actuator 4 may be divided into a plurality of parts as long as it can cause the display 2b to function as an acoustic device and can also be applied as a vibration device (haptic device).

[0106] For example, in the above embodiment, the electronic device 1 may have the piezoelectric actuator 4 on the touch panel 2a instead of the display 2b. When the touch panel 2a is superimposed on the display 2b, it is more beneficial to provide the piezoelectric actuator 4 on the touch panel 2a rather than on the display 2b in order to make it easier for the user to perceive tactile feedback, etc. When the piezoelectric actuator 4 is provided on the touch panel 2a, it is desirable to provide the piezoelectric actuator 4 at a position where the vibration of the touch panel 2a is greatest.

[0107] In addition, the effects described in this specification are merely explanatory or exemplary and are not limiting. In other words, the technology of the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.

[0108] Note that the technology of the present disclosure can also be configured as follows, as it falls within the technical scope of the present disclosure. (1) A touch panel display, a speaker that outputs a sound based on a first audio signal corresponding to a range of sounds equal to or higher than a predetermined frequency; a piezoelectric actuator provided in the touch panel display, the piezoelectric actuator deforming in response to a second audio signal corresponding to a sound range below the predetermined frequency and a control signal for haptic feedback based on a predetermined vibration pattern, and vibrating the touch panel display; An electronic device comprising: (2) a signal control unit that modulates the second audio signal so that, when a composite signal obtained by mixing the second audio signal and the control signal is input to the piezoelectric actuator, a vibration of the touch panel display based on the control signal has priority over a vibration of the touch panel display based on the second audio signal. The electronic device according to (1) further comprising: (3) The signal control unit is The output level of the second audio signal is suppressed so that the amplitude of the second audio signal is smaller than the amplitude of the control signal. The electronic device described in (2) above. (4) The signal control unit is The band of the second audio signal is limited so as to attenuate a low frequency side of the frequency components included in the second audio signal. The electronic device described in (2) above. (5) The signal control unit is An output level of the second audio signal is suppressed so that the amplitude of the second audio signal is smaller than the amplitude of the control signal, and a band of the second audio signal is limited so that a low frequency side of the second audio signal is attenuated. The electronic device described in (2) above. (6) The signal control unit is A reproduction time of the control signal is made longer than a reproduction time of the second audio signal. The electronic device described in (2) above. (7) The piezoelectric actuator is The touch panel display is provided on a back surface opposite to a display surface of the display. The electronic device described in (1). (8) The piezoelectric actuator is The display is placed at a position where the vibration is greatest. The electronic device according to (7) above. (9) The piezoelectric actuator is Located near the center of the back surface of the display The electronic device according to (7) above. [Explanation of symbols]

[0109] 1 Electronic equipment 2 Touch panel display 2a Touch Panel 2b Display 3 Speakers 4 Piezo Actuator 10 Storage section 11 First tone data storage unit 12 Second tone data storage section 13 Signal control data storage section 20 Control section 21 First signal processing section 22 Second signal processing section 23 First Generation Section 24 Second Generation Section 25 Signal control section

Claims

1. A touch panel display, a speaker that outputs a sound based on a first audio signal corresponding to a range of sounds equal to or higher than a predetermined frequency; a piezo actuator provided on the touch panel display, the piezo actuator deforming in response to at least one of a second audio signal corresponding to a sound range below the predetermined frequency and a control signal for haptic feedback based on a predetermined vibration pattern, and vibrating the touch panel display; a signal control unit that modulates the second audio signal so that, when a composite signal obtained by mixing the second audio signal and the control signal is input to the piezoelectric actuator, a vibration of the touch panel display based on the control signal has priority over a vibration of the touch panel display based on the second audio signal; Equipped with The signal control unit is A reproduction time of the control signal is made longer than a reproduction time of the second audio signal. electronic equipment.

2. The signal control unit is The output level of the second audio signal is suppressed so that the amplitude of the second audio signal is smaller than the amplitude of the control signal.

2. The electronic device according to claim 1.

3. The signal control unit is The band of the second audio signal is limited so as to attenuate a low frequency side of the frequency components included in the second audio signal.

2. The electronic device according to claim 1.

4. The signal control unit is An output level of the second audio signal is suppressed so that the amplitude of the second audio signal is smaller than the amplitude of the control signal, and a band of the second audio signal is limited so that a low frequency side of the second audio signal is attenuated.

2. The electronic device according to claim 1.

5. The piezoelectric actuator is The touch panel display is provided on a back surface opposite to a display surface of the display.

2. The electronic device according to claim 1.

6. The piezoelectric actuator is The display is placed at a position where the vibration is greatest.

6. The electronic device according to claim 5.

7. The piezoelectric actuator is Located near the center of the back surface of the display 6. The electronic device according to claim 5.

Images