Display control device, display control method, and audio playback device

Abstract

The present invention provides a display control device that renders visible the effect of a noise cancellation function.　The display control device comprises a display control unit for displaying, on a display unit, first sound pressure information that corresponds to an ambient sound pressure, which is the sound pressure of ambient sound acquired during wearing of an electronic device, and second sound pressure information that corresponds to sound pressure inside the electronic device during wearing of the electronic device.

Description

Display control device, display control method, and sound reproduction device

[0001] The present disclosure relates to a display control device, a display control method, and an audio playback device.

[0002] Portable sound reproduction devices such as headphones often have a so-called noise cancellation function that cancels noise by signal processing (see, for example, Patent Document 1). Furthermore, Patent Document 2 listed below describes headphones that enable hearing evaluation by acoustic testing.

[0003] Japanese Patent Application Laid-Open No. 2008-122729 Japanese Patent Application Laid-Open No. 2017-535802

[0004] However, the techniques described in Patent Documents 1 and 2 above are unable to visualize, for example, changes in sound pressure due to the noise cancellation function.

[0005] An object of the present disclosure is to provide a display control device and a display control method that can visualize changes in sound pressure due to, for example, a noise cancellation function, etc. Another object is to provide an audio playback device that can detect changes in sound pressure due to a noise cancellation function, etc.

[0006] The present disclosure relates to, for example, a display control device having a display control unit that displays, on a display unit, first sound pressure information corresponding to environmental sound pressure, which is the sound pressure of environmental sound acquired when an electronic device is worn, and second sound pressure information corresponding to the sound pressure inside the electronic device when the electronic device is worn.

[0007] The present disclosure relates to a display control method in which, for example, a display control unit controls a display unit to display first sound pressure information corresponding to environmental sound pressure, which is the sound pressure of environmental sound acquired when the electronic device is worn, and second sound pressure information corresponding to the sound pressure inside the electronic device when the electronic device is worn.

[0008] The present disclosure relates to a sound reproducing device having, for example, a sound collection unit that acquires environmental sound pressure, which is the sound pressure of environmental sound; a sound pressure acquisition unit that acquires pre-auricular sound pressure, which is the sound pressure near the ear; and a communication unit that transmits a history of the environmental sound pressure and the pre-auricular sound pressure to an external device.

[0009] 1 is a diagram for explaining an example of the external configuration of headphones according to an embodiment. FIG. 1 is a diagram for explaining an example of the external configuration of headphones according to an embodiment. FIG. 2 is a diagram for explaining a schematic example of the internal configuration of headphones according to an embodiment. FIG. 3 is a diagram for explaining an example of a noise cancellation function of headphones according to an embodiment. FIG. 4 is a diagram for explaining an example of a measurement pattern of ambient sound pressure and in front-ear sound pressure according to a mode. FIG. 5 is a block diagram for explaining an example of the electrical configuration of headphones according to a first embodiment. FIG. 6 is a diagram for explaining an example of a correction method for sound pressure, etc. FIG. 7 is a block diagram for explaining an example of the internal configuration of a smartphone according to an embodiment. FIG. 8 is a diagram for explaining an example of a display displayed on a display of a smartphone according to an embodiment. FIG. 9 is a diagram for explaining another example of a display displayed on a display of a smartphone according to an embodiment. FIG. 10 is a diagram for explaining another example of a display displayed on a display of a smartphone according to an embodiment. FIG. 11 is a flowchart showing the flow of processing performed in headphones according to the first embodiment. FIG. 12 is a flowchart showing the flow of processing performed in the smartphone according to the first embodiment. FIG. 13 is a block diagram for explaining an example of the electrical configuration of headphones according to a second embodiment. FIG. 14 is a diagram for explaining an example of the characteristics of a filter used when the mode set in the headphones according to the second embodiment is a noise cancellation on mode. FIG. 15 is a diagram for explaining an example of the characteristics of a filter used when the mode set in the headphones according to the second embodiment is an ambient sound capture mode. FIG. 10 is a diagram for explaining an example of the characteristics of a filter used when the mode set in the headphones according to the second embodiment is a noise cancellation off mode. FIG. 11 is a diagram for explaining another example of a measurement pattern of environmental sound pressure and in front of the ear sound pressure according to the mode. FIG. 12 is a diagram for explaining an example of display content related to safe listening displayed on the display. FIG. 13 is a diagram for explaining another example of a measurement pattern of environmental sound pressure and in front of the ear sound pressure according to the mode. FIG. 14 is a diagram for explaining another example of display content related to safe listening displayed on the display. FIG. 15 is a diagram for explaining another example of display content related to safe listening displayed on the display.

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The description will be made in the following order: <First embodiment> <Second embodiment> <Third embodiment> <Modification> The embodiments described below are preferred specific examples of the present disclosure, and the contents of the present disclosure are not limited to these embodiments.

[0011] First Embodiment [Configuration Example of Headphones] In this embodiment, headphones (headphones 1) will be described as an example of a sound reproduction device. The headphones 1 are also an example of an electronic device. However, the sound reproduction device and electronic device according to the present disclosure are not limited to headphones, and can also be applied to other portable sound reproduction devices, such as earphones, neck speakers (speakers worn on the user's shoulder), hearing aids, digital earplugs (earplugs that perform electrical processing), etc.

[0012] (External Configuration Example) Figures 1 and 2 are diagrams for explaining an external configuration example of headphones 1 according to an embodiment. Note that for convenience of explanation, some components are omitted in Figures 1 and 2. Figures 1 and 2 only show the configuration of the L (Left) channel side, but the R (Right) channel side is configured in approximately the same way. However, the configuration of the L channel side and the configuration of the R channel side may be different.

[0013] 1 and 2, headphones 1 generally include, for example, a headband 2, a housing 3, and ear pads 4. An oval hole 5 is formed in a position located outside the headband 2 and at the top of the housing 3.

[0014] The headband 2 is curved to fit the wearer's (user's) head and, when worn, contacts the top of the wearer's head, supporting the entire headphones 1. The headband 2 is made of synthetic resin such as plastic, metal, etc., and has a predetermined rigidity and elasticity, making it flexible. This allows the housing 3 and ear pads 4 to be pressed toward the wearer's temporal region when worn, thereby maintaining the headphones 1 in a worn state.

[0015] The inner surface of the headband 2 may be provided with rubber or other cushioning material in the portion that contacts the top of the wearer's head. A hinge may also be provided so that the headphones 1 can be folded in the middle when carried around. The headband 2 may also be provided with a slider (not shown). By adjusting the position of the slider by sliding it along a guide member (not shown), the housing 3 and ear pads 4 can be aligned to face the wearer's ears. This allows the wearer to obtain a comfortable fit that suits their physical characteristics and preferences. Meanwhile, when the headphones 1 are not in use, the slider can be retracted to save storage space.

[0016] The housing 3 has an internal storage space for storing a driver unit (not shown) that converts electrical signals into sound waves and outputs them. The housing 3 is made of, for example, a synthetic resin such as plastic. The housing 3 has holes 5 formed therein that communicate with the inside and outside of the housing 3. The positions and number of the holes 5 are not particularly limited, but for example, the holes 5 are provided on the left side of the housing 3 when the headphones 1 are worn, so that they open upward.

[0017] The ear pads 4 are provided on the surface of the housing 3 that faces the wearer's temporal region. The ear pads 4 are interposed between the housing 3 and the wearer's temporal region, and function as a buffer between the housing 3 and the wearer's temporal region. In other words, the ear pads 4 prevent the housing 3, which is made of a hard material that is difficult to deform, from coming into direct contact with the wearer's ears and temporal region when the headphones 1 are worn, thereby causing discomfort or pain to the wearer.

[0018] Depending on the material, the ear pads 4 can also suppress sound leakage, improving sound quality by improving the reproduction of low-frequency sounds. They also prevent the sound output from the driver unit from leaking outside. Furthermore, the ear pads 4 also block external noise, making it easier to hear the sound from the driver unit.

[0019] A first microphone 6, an example of a sound collection unit, is provided at the back side of the hole 5 (inside the housing 3). The first microphone 6 detects and acquires environmental sound pressure, which is the sound pressure of environmental sound when the headphones 1 are used, specifically, when the headphones 1 are worn on the user's ears. The environmental sound pressure specifically corresponds to the sound pressure of environmental sound outside the housing 3 and ear pads 4. Environmental sound may include human voices, the sounds of cars and trains, construction noise, various announcements, and the like. Note that some headphones 1 have a microphone for acquiring environmental sound in order to perform feedforward noise cancellation processing. Such a microphone may be used as the first microphone 6. The first microphone 6 may also be a dedicated microphone for acquiring environmental sound pressure, which is the sound pressure of environmental sound. Note that the first microphone 6 may be provided on the right side of the housing 3.

[0020] (Internal Configuration Example) A schematic internal configuration example of the headphones 1 will be described with reference to Fig. 3. Fig. 3 shows the headphones 1 worn by a user. To make the internal configuration example of the headphones 1 clearer, some parts may be shown in a see-through or simplified form.

[0021] When the headphones 1 are worn on a user's ears, the housing 3 and ear pads 4 are positioned to surround the user's ears EA. A driver unit 7 is provided in a predetermined location on the housing 3 (for example, a location that substantially faces the ear canal EB when the headphones 1 are worn). A second microphone 8 is also provided in the housing 3, for example, near the driver unit 7. The second microphone 8 detects and acquires the sound pressure inside the headphones 1 (for example, the inside separated from the outside by the housing 3 and ear pads 4) when the headphones 1 are worn. This sound pressure is also appropriately referred to as pre-auricular sound pressure, as it is sound pressure near the ears. In this embodiment, the second microphone 8 functions as a sound pressure acquisition unit that acquires pre-auricular sound pressure.

[0022] Note that some headphones 1 may have a microphone that acquires sound pressure within the headphones 1 in order to perform feedback noise cancellation processing. Such a microphone may be used as the second microphone 8. The second microphone 8 may be a dedicated microphone for acquiring in-ear sound pressure.

[0023] (Operation Example) An operation example of the headphones 1 will be described. An audio signal is supplied to the headphones 1, and audio corresponding to the audio signal is reproduced from the driver unit 7 in the headphones 1. The audio reproduced from the driver unit 7 reaches the eardrum EC via the ear canal EB and is heard by the user. The reproduced audio may be any audio, such as music, a human voice, natural sounds, or a combination of these. The audio signal may be supplied to the headphones 1 wirelessly or via a wired connection. Reproduction processing of the audio signal is performed by a DSP (Digital Signal Processor) or the like (not shown).

[0024] [Noise Cancellation Function] Next, an example of the noise cancellation function of the headphones 1 will be described with reference to Fig. 4A to Fig. 4C. Fig. 4A shows the waveform of a noise component. In Fig. 4A, the horizontal axis represents frequency, and the vertical axis represents sound pressure (dB). The noise component is detected by a feedforward noise cancellation microphone or a feedback noise cancellation microphone. Depending on the method, it is possible to accurately detect only the noise component by performing known signal processing.

[0025] A sound of opposite phase to the detected noise component is generated. Fig. 4B shows the waveform of such a sound. The signal of the opposite phase sound is generated, for example, by the DSP described above. By reproducing the opposite phase sound and combining it with the sound of the noise component, it is possible to cancel out the noise component, as shown in Fig. 4C.

[0026] [Regarding Modes That Can Be Set on the Headphones] Next, a description will be given of modes that can be set on the headphones 1. Modes can be changed or set using, for example, an operation input unit (not shown) provided on the housing 3 of the headphones 1.

[0027] One mode that can be set for the headphones 1 is a "noise cancellation on mode" that turns on the noise cancellation function described above. Another mode that can be set for the headphones 1 is a "noise cancellation off mode" that turns off the noise cancellation function described above. Another mode that can be set for the headphones 1 is an "ambient sound capture mode" that captures external sounds (e.g., the above-mentioned environmental sounds) from the headphones 1. The "ambient sound capture mode" can be further adjusted between levels 1 and 20. For example, the higher the level value, the greater the amount of external sounds captured. Furthermore, a "voice focus mode" can be additionally set for the "ambient sound capture mode." When the "voice focus mode" is set, it is possible to capture only human voices while suppressing noise.

[0028] The above-mentioned modes may be set automatically instead of manually. For example, an acceleration sensor or the like may be used to identify the user's activity state (e.g., walking, running, etc.), and the most suitable mode for the activity state may be automatically selected. Furthermore, the mode set for locations frequently visited by the user may be learned, and when a location sensor or the like detects that the user has visited the location, the mode corresponding to the location may be automatically set.

[0029] 5, when the "noise cancellation on mode" is set for the headphones 1, even if the environmental sound pressure acquired by the first microphone 6 exceeds the threshold, the in-ear sound pressure acquired by the second microphone 8 is likely to be below the threshold due to the noise cancellation function. The threshold is set to a value (e.g., 75 dB) that may adversely affect hearing.

[0030] [Example of Electrical Configuration of Headphones] Next, an example of the electrical configuration of the headphones 1 will be described with reference to the block diagram of Fig. 6. Note that Fig. 6 illustrates only the components closely related to the present disclosure among the example of the electrical configuration of the headphones 1. The headphones 1 may have components other than those shown in Fig. 6.

[0031] In addition to the first microphone 6 and second microphone 8 described above, the headphones 1 have, for example, a first buffer 11, a first microphone gain 12, a second buffer 13, a second microphone gain 14, a sound pressure calculation unit 15, a sound pressure accumulation unit 16, a threshold determination unit 17, a memory 18, a communication unit 19, and an antenna 20.

[0032] The first buffer 11 is connected to the first microphone 6. An environmental sound signal SA corresponding to the environmental sound acquired by the first microphone 6 is input to the first buffer 11. The first buffer 11 outputs the environmental sound signal SA to the first microphone gain 12 after delaying it by a predetermined timing.

[0033] The first microphone gain 12 amplifies the environmental sound signal SA supplied from the first buffer 11 by a predetermined amplification factor. The environmental sound signal SA amplified by the first microphone gain 12 is converted from an analog signal to a digital signal by an AD (Analog to Digital) converter (not shown), and then supplied to the sound pressure calculation unit 15.

[0034] The second buffer 13 is connected to the second microphone 8. The second buffer 13 receives an audio signal SB near the ear acquired by the second microphone 8. The second buffer 13 outputs the audio signal SB near the ear to the second microphone gain 14 after delaying the audio signal SB by a predetermined timing.

[0035] The second microphone gain 14 amplifies, by a predetermined gain, the near-ear sound signal SB supplied from the second buffer 13. The near-ear sound signal SB amplified by the second microphone gain 14 is converted from an analog signal to a digital signal by an AD converter (not shown), and then supplied to the sound pressure calculation unit 15.

[0036] The sound pressure calculation unit 15 calculates the sound pressure (unit: dB (decibels)) of each of the environmental sound signal SA and the near-ear sound signal SB. The sound pressure calculation unit 15 calculates, for example, the average value of the sound pressure over a predetermined period of time (for example, one second). The sound pressure calculation unit 15 supplies the sound pressure of the environmental sound signal SA to the sound pressure accumulation unit 16 as environmental sound pressure. The sound pressure calculation unit 15 also supplies the sound pressure of the near-ear sound signal SB to the sound pressure accumulation unit 16 as pre-auricular sound pressure.

[0037] The sound pressure integrating unit 16 writes the sound pressure value of the environmental sound pressure, the integration results of the sound pressure values, etc., together with time information (time stamps) into the memory 18 as a log. That is, the memory 18 stores the time-series changes in the environmental sound pressure as a log. The sound pressure integrating unit 16 reads the log from the memory 18 and performs appropriate calculations to determine the minimum, maximum, average, etc. of the environmental sound pressure in units of one day, one week, one month, etc. The sound pressure integrating unit 16 also writes the sound pressure value of the in-ear sound pressure, the integration results of the sound pressure values, etc., together with time information into the memory 18 as a log. That is, the memory 18 stores the time-series changes in the in-ear sound pressure as a log. The sound pressure integrating unit 16 reads the log from the memory 18 and performs appropriate calculations to determine the minimum, maximum, average, etc. of the in-ear sound pressure in units of one day, one week, one month, etc.

[0038] The sound pressure integrating unit 16 may integrate the dose of acoustic energy by using the sound pressure calculated by the sound pressure calculating unit 15 and time information. The dose integration of acoustic energy can be calculated, for example, by the following formula (1). Formula (1) In the formula (1), t is time, p Ａ is the sound pressure calculated by the sound pressure calculation unit 15 (however, the sound pressure may be a corrected sound pressure).

[0039] The environmental sound pressure supplied from the sound pressure calculation unit 15 is also supplied to the threshold determination unit 17. The threshold determination unit 17 determines whether the environmental sound pressure exceeds the above-mentioned threshold (e.g., 75 dB). For example, if the average value of the environmental sound pressure over one second exceeds the threshold, the threshold determination unit 17 supplies a flag indicating that the threshold has been exceeded to the sound pressure integration unit 16. The sound pressure integration unit 16 writes information indicating that the environmental sound pressure has exceeded the threshold together with time information as a log in the memory 18. That is, the memory 18 stores a log of the time during which the environmental sound pressure exceeded the threshold. The sound pressure integration unit 16 reads the log from the memory 18 and performs appropriate calculations to determine the cumulative time during which the environmental sound pressure exceeded and / or did not exceed the threshold in units of one day, one week, one month, etc.

[0040] The in-ear sound pressure supplied from the sound pressure calculation unit 15 is also supplied to the threshold determination unit 17. The threshold determination unit 17 determines whether the in-ear sound pressure exceeds the above-mentioned threshold (e.g., 75 dB). For example, if the average value of the in-ear sound pressure over one second exceeds the threshold, the threshold determination unit 17 supplies a flag indicating that the threshold has been exceeded to the sound pressure integration unit 16. The sound pressure integration unit 16 writes information indicating that the in-ear sound pressure has exceeded the threshold together with time information as a log in the memory 18. That is, the memory 18 stores a log of the time during which the in-ear sound pressure exceeded the threshold. The sound pressure integration unit 16 reads the log from the memory 18 and performs appropriate calculations to determine the cumulative time during which the in-ear sound pressure exceeded and / or did not exceed the threshold in units of one day, one week, one month, etc.

[0041] Examples of the memory 18 include a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, etc. The memory 18 stores a history (for example, the log described above) relating to the environmental sound pressure and the in-ear sound pressure.

[0042] The communication unit 19 communicates with an external device based on a communication standard such as LTE (Long Term Evolution), 4G (Generation), or 5G. The communication unit 19 also performs close proximity wireless communication with an external device based on a communication standard such as a wireless local area network (LAN) or Bluetooth (registered trademark). The communication unit 19 may also perform wired communication via a cable. The communication unit 19 performs modulation / demodulation processing and error correction processing according to the communication standard. Data is transmitted to the external device via the antenna 20, and data from the external device is received by the antenna 20. In this embodiment, the headphones 1 perform close proximity wireless communication with the smartphone 100. A log is read from the memory 18 in response to a request from the smartphone 100, and the read log is transmitted to the smartphone 100 via the communication unit 19 and the antenna 20. All of the logs stored in the memory 18 may be transmitted from the headphones 1 to the smartphone 100, or only the log corresponding to the content requested by the smartphone 100 may be transmitted.

[0043] Note that various correction processes may be performed in the processing of the sound pressure calculation unit 15 described above. For example, as an example of a first correction process, a process may be performed to correct the frequency characteristics of each of the first microphone 6 and the second microphone 8 and the HRTF (Head Related Transfer Function) according to the microphone position. Fig. 7A shows an example of a filter used in the first correction process. In Fig. 7A, the horizontal axis represents frequency, and the vertical axis represents sound pressure (dB). (The same applies to Figs. 7B and 7C.)

[0044] As an example of the second correction process, correction may be performed taking into account characteristics (so-called A-weighting) designed to approximate human auditory characteristics (pure tone loudness characteristics). Fig. 7B shows an example of a filter for performing correction taking into account A-weighting. Note that for A-weighting, the IEC 61672 standard specifies weighting values ​​for each frequency.

[0045] Furthermore, as an example of the third correction process, diffuse sound field correction may be performed. In the diffuse sound field correction, a process is performed to correct the frequency characteristics so as to conform to the standard in the diffuse sound field. FIG. 7C shows an example of a filter for performing the diffuse sound field correction. Of the above correction processes, any one of the correction processes may be performed, or multiple correction processes may be performed. Furthermore, a correction process different from the first to third correction processes may be performed.

[0046] Correction processing may be performed in the processing of the sound pressure integration unit 16. Examples of such correction processing include correction processing according to the sensitivity and gain of each of the first microphone 6 and the second microphone 8. Specifically, a conversion coefficient is set according to the sensitivity and gain of each of the first microphone 6 and the second microphone 8. The correction processing is performed by performing an operation (e.g., multiplication) on the integration result of the environmental sound pressure by the sound pressure integration unit 16 using a conversion coefficient corresponding to the first microphone 6, and performing an operation on the integration result of the in-ear sound pressure by the sound pressure integration unit 16 using a conversion coefficient corresponding to the second microphone 8.

[0047] [Smartphone] (Configuration Example of Smartphone) Next, a configuration example of the smartphone 100 according to the embodiment will be described. FIG. 8 is a block diagram for explaining an internal configuration example of the smartphone 100.

[0048] The smartphone 100 has, for example, an external configuration example similar to that of a known smartphone. Specifically, the smartphone 100 has an external appearance in which a display 102 is provided on one side of a housing (see FIG. 6 ). In this embodiment, the display 102 is configured as a touch panel.

[0049] As shown in FIG. 8 , in addition to a display 102, the smartphone 100 includes, for example, a control unit 101, an input unit 103, a wireless communication unit 104, an antenna 105 connected to the wireless communication unit 104, a short-range wireless communication unit 106, an antenna 107 connected to the short-range wireless communication unit 106, a position sensor unit 108, an antenna 109 connected to the position sensor unit 108, a memory unit 110, a vibrator 111, a motion sensor 112, an audio processing unit 113, a microphone 114, and a speaker 115.

[0050] The control unit 101 is configured, for example, by a CPU (Central Processing Unit) and performs overall control of each unit of the smartphone 100. The control unit 101 also has a display control unit 101A. The display control unit 101A controls the display 102 to display predetermined display content (details will be described later) on the display 102. The control unit 101 also has, for example, a timer (not shown).

[0051] The input unit 103 is a general term for components of the smartphone 100 that accept operational input. Examples of the input unit 103 include a touch panel, buttons, and dials. The input unit 103 may be configured to accept voice input for speech recognition, or may be configured to accept gesture input from a camera or the like.

[0052] The wireless communication unit 104 communicates with devices other than the smartphone 100 based on a communication standard such as LTE, 4G, or 5G. The wireless communication unit 104 performs modulation / demodulation processing and error correction processing corresponding to the communication standard. Data is transmitted to the external device described above via the antenna 105, and the antenna 105 receives data from the external device.

[0053] The short-range wireless communication unit 106 performs short-range wireless communication with, for example, the headphones 1. Data is transmitted to the headphones 1 via an antenna 107, and the antenna 107 receives data from the headphones 1.

[0054] The short-range wireless communication unit 106 may be configured to perform wireless communication with a device other than the smartphone 100. In the above example, the wireless communication unit 104 and the short-range wireless communication unit 106 are described as being separate components, but they may be configured as a single communication unit having the functions of both, and the communication unit may communicate with the headphones 1.

[0055] The position sensor unit 108 is a positioning unit that measures the current position using, for example, a system called GNSS (Global Navigation Satellite System). Data obtained by the wireless communication unit 104, short-range wireless communication unit 106, and position sensor unit 108 is supplied to the control unit 101. The control unit 101 then executes control based on the supplied data.

[0056] The memory unit 110 is a general term for a ROM (Read Only Memory) in which the programs executed by the control unit 101 are stored, a RAM (Random Access Memory) used as work memory when the control unit 101 executes the programs, and a non-volatile memory for storing data.

[0057] The vibrator 111 is, for example, a member that vibrates the entire smartphone 100. The vibrations caused by the vibrator 111 notify the user of an incoming call, an incoming email, or the like.

[0058] The motion sensor 112 detects, for example, the movement of the smartphone 100. The motion sensor 112 may be an acceleration sensor, a gyro sensor, an electronic compass, a barometric pressure sensor, or the like. The smartphone 100 may also have a built-in sensor other than the motion sensor 112. For example, the smartphone 100 may have a built-in biosensor that detects biological information such as blood pressure, pulse, sweat glands, and body temperature of a patient wearing the smartphone 100.

[0059] A microphone 114 and a speaker 115 are connected to the voice processing unit 113, and the voice processing unit 113 processes calls with a party connected by wireless communication via the wireless communication unit 104. The voice processing unit 113 can also perform processing for voice input operations.

[0060] Although not shown, power is supplied to each part of the smartphone 100 from a battery such as a lithium ion secondary battery.

[0061] (Display Example) Next, a description will be given of a display example displayed on the display 102 of the smartphone 100. For example, when a predetermined application is started using the input unit 103, the content shown in Fig. 9 is displayed on the display 102. The display content shown in Fig. 9 is a display example that visualizes the effect on hearing caused by using the headphones 1.

[0062] An example of the display content will be described. A smartphone function display 31 is displayed at the top of the display 102. The smartphone function display 31 includes information such as the time, signal strength, and remaining battery power. Each display element is displayed using letters, numbers, marks, etc.

[0063] A text display 32 is displayed below the smartphone function display 31. The text display 32 is, for example, a string of characters that reads "Hearing effects of using headphones." The text display 32 indicates to the user that the content displayed on the display 102 is a visualized display of the hearing effects of using the headphones 1.

[0064] A period setting display 33 is displayed below the character display 32. A period display 34 is displayed below the period setting display 33. The period setting display 33 includes the characters "week," "month," and "year," for example. The user can select one of the periods by touching the display 102. The selected period is highlighted by a bold frame or the like. The example shown in FIG. 9 is an example in which "week" is selected from the period setting display 33.

[0065] The period display 34 indicates a specific period. In the example shown in FIG. 9 , the period display 34 displays "December 17th to 23rd, 2023." That is, when "week" is selected in the period setting display 33, the period display 34 displays a specific "week" period. By default, for example, one week from Sunday to Saturday, including the current date, is displayed. Triangle marks are displayed on both sides of the period display 34. For example, a left-pointing triangle mark 34A is displayed on the left side of the period display 34, and a right-pointing triangle mark 34B is displayed on the right side of the period display 34. For example, by touching the triangle mark 34A, the user can move the period in the period display 34 forward by one week. Furthermore, by touching the triangle mark 34B, the user can move the period in the period display 34 backward by one week.

[0066] An auditory impact display 35 is displayed below the period display 34. The example shown in Fig. 9 is an example of the auditory impact display 35 when "week" is selected in the period setting display 33. The auditory impact display 35 is displayed in a graph format, for example, with the horizontal axis representing each day of the week from Sunday to Saturday and the vertical axis representing sound pressure (dB). The auditory impact display 35 is displayed for each day of the week and includes an environmental sound pressure display 35A including a vertically extending bar and a sound pressure range display located above the bar, and a headphone mark 35B displayed superimposed on the bar included in the environmental sound pressure display 35A.

[0067] The ambient sound pressure display 35A shows the minimum and maximum ambient sound pressure values ​​measured on that day using bars and numbers. For example, the bars and numbers indicate that the minimum ambient sound pressure value measured by the first microphone 6 when the headphones 1 were in use on Sunday, December 17, 2023 was 42 dB and the maximum ambient sound pressure value was 65 dB.

[0068] The headphone mark 35B indicates the average value of the in-ear sound pressure measured on a certain day by the second microphone 8. For example, the headphone mark 35B displayed in the location of Sunday, December 17, 2023, indicates that the average value of the in-ear sound pressure measured by the second microphone 8 when the headphones 1 were used on that date was approximately 47 dB.

[0069] By presenting such display content to the user, the user can recognize that even when the environmental sound pressure is high (when the noise is loud), the sound pressure in front of the ears is reduced, i.e., the noise is effectively suppressed, by using the noise cancellation function of the headphones 1. In this way, the effect of the noise cancellation function of the headphones 1 (changes in sound pressure due to the noise cancellation function) can be visualized.

[0070] The hearing effect indicator 35 is not displayed for Tuesday, Wednesday, and Friday, which indicates that the headphones 1 were not used on Tuesday, Wednesday, and Friday.

[0071] The hearing impact display 35 further includes a text display 35C. The text display 35C includes a first average value display 36A that is the average value of the ambient sound pressure, i.e., the ambient sound pressure measured by the first microphone 6, for one week (December 17 to 23, 2023). In the example shown in Fig. 9, "Average ambient sound pressure: 73 dB (week)" is displayed as the first average value display 36A.

[0072] The text display 35C includes a second average value display 36B that is the average value for one week (December 17th to December 23rd, 2023) of the sound pressure inside the headphones, i.e., the in-ear sound pressure measured by the second microphone 8. In the example shown in Fig. 9, "Average sound pressure inside the headphones: 42 dB (week)" is displayed as the second average value display 36B.

[0073] The text display 35C includes a protection time display 36C, which is the time protected from high sound pressure (sound pressure above a certain threshold) in one week (December 17th to 23rd, 2023). In the example shown in Fig. 9, the protection time display 36C displays "Time protected from high sound pressure (sound pressure above a certain threshold): 5 hours / week."

[0074] The display content shown in Fig. 9 is displayed in accordance with control by the display control unit 101A. The display control unit 101A displays, on the display 102, first sound pressure information corresponding to the environmental sound pressure, which is the sound pressure of the environmental sound acquired when the headphones 1 are worn, and second sound pressure information corresponding to the sound pressure inside the headphones 1 when the headphones 1 are worn. Here, the first sound pressure information corresponding to the environmental sound pressure may be information corresponding to the measured value of the environmental sound pressure (measured value of the first microphone 6) itself, or information corresponding to the result of performing some kind of calculation or processing on the measured value of the environmental sound pressure, such as averaging or weighted averaging over a predetermined period. Furthermore, the second sound pressure information corresponding to the in-ear sound pressure may be information corresponding to the measured value of the in-ear sound pressure (measured value of the second microphone 8) itself, or information corresponding to the result of performing some kind of calculation or processing on the measured value of the in-ear sound pressure, such as averaging or weighted averaging over a predetermined period. Furthermore, the first sound pressure information and the second sound pressure information can be perceived by the user by letters, numbers, sounds, marks, icons, etc.

[0075] 9 , for example, an environmental sound pressure display 35A corresponds to the first sound pressure information, and a headphone mark 35B corresponds to the second sound pressure information. A first average value display 36A may be included in the first sound pressure information. A second average value display 36B may be included in the second sound pressure information. Furthermore, because a protection time display 36C is information obtained by comparing the infront-ear sound pressure with a threshold value, the protection time display 36C may be included in the second sound pressure information.

[0076] In this embodiment, an environmental sound pressure display 35A (specifically, a bar), which is an example of first sound pressure information, and a headphone mark 35B, which is an example of second sound pressure information, are superimposed on each other. This allows the user to intuitively recognize that the noise cancellation function of the headphones 1 has effectively suppressed noise. Although this effect is obtained, the headphone mark 35B may be displayed in other ways, for example, in a location close to the bar. Note that in the case of a noise cancellation function that provides a stronger effect, the headphone mark 35B may be located below the bar. In other words, the hearing effect display 35 may include a display in which the second sound pressure information does not overlap with the first sound pressure information.

[0077] In this embodiment, the second sound pressure information is displayed by a mark corresponding to the headphones 1. This allows the user to intuitively recognize that noise has been suppressed by the headphones 1. Note that the second sound pressure information is displayed by a mark corresponding to the headphones 1, which is an example of an electronic device that can be worn on the ears, but the content of the mark will differ depending on the electronic device. Marks other than those corresponding to the headphones 1 include marks corresponding to earphones, hearing aids, and digital earplugs. The content of the mark may be set by the user.

[0078] In this embodiment, the display can be switched between the first and second sound pressure information for each day, the first and second sound pressure information for each week, and the first and second sound pressure information for each month by performing a predetermined operation such as a touch operation on the period setting display 33. This allows the first and second sound pressure information for a period desired by the user to be displayed on the display 102.

[0079] Next, another example of the display content will be described. FIG. 10 is a diagram illustrating an example of the display on the display 102 when "Month" is selected in the period setting display 33. In this case, as in the display example shown in FIG. 9, the first sound pressure information and the second sound pressure information are displayed on the display 102. Specifically, a smartphone function display 31, a text display 32, a period setting display 33, a period display 34 (December 2023), and an auditory impact display 35 are displayed. The auditory impact display 35 includes an environmental sound pressure display 35A, a headphone mark 35B, and a text display 35C. The text display 35C includes a first average value display 36A, a second average value display 36B, and a protection time display 36C.

[0080] When "Month" is selected in the period setting display 33, the horizontal axis of the graph of the hearing impact display 35 represents each week in "December 2023." For example, "11 / 26" on the horizontal axis represents the week from "11 / 26 to 12 / 2." Strictly speaking, 11 / 26 to 11 / 30 are not included in December, but since this week includes 12 / 1 and 12 / 2, 11 / 26, which is the beginning of the week, is displayed. The maximum and minimum values ​​of the environmental sound pressure for each week are displayed as bars or a range of numbers as the environmental sound pressure display 35A. The average value of the environmental sound pressure for "December 2023" is displayed in text as the first average value display 36A. The average value of the in-ear sound pressure for each week is displayed as a headphone mark 35B. The average value of the in-ear sound pressure for "December 2023" is displayed as the second average value display 36B. The time during which the device is protected from sound pressure above the threshold in "December 2023" is displayed as a protection time display 36C.

[0081] FIG. 11 is a diagram illustrating an example of what is displayed on the display 102 when "year" is selected in the period setting display 33. In this case, as in the display examples shown in FIGS. 9 and 10 , the first sound pressure information and the second sound pressure information are displayed on the display 102. Specifically, a smartphone function display 31, a text display 32, a period setting display 33, a period display 34 (December 2023), and an auditory impact display 35 are displayed. The auditory impact display 35 includes an environmental sound pressure display 35A, a headphone mark 35B, and a text display 35C. The text display 35C includes a first average value display 36A, a second average value display 36B, and a protection time display 36C.

[0082] When "year" is selected in the period setting display 33, the horizontal axis of the graph of the hearing impact display 35 represents each month in "2023." For example, "1" on the horizontal axis represents "January 2023." The maximum and minimum values ​​of the environmental sound pressure for each month are displayed as an environmental sound pressure display 35A using bars or a range of numbers. The average value of the environmental sound pressure for "2023" is displayed in text as a first average value display 36A. The average value of the in front-ear sound pressure for each month is displayed using a headphone mark 35B. The average value of the in front-ear sound pressure for "2023" is displayed as a second average value display 36B. The time during which the person was protected from sound pressure above the threshold in "2023" is displayed as a protection time display 36C.

[0083] (Display Control Process) The following describes the display control process of the smartphone 100 when displaying the display example shown in Fig. 9. Before the display control process is performed, the smartphone 100 communicates with the headphones 1 using the short-range wireless communication unit 106, and acquires the log stored in the memory 18 from the headphones 1. The log acquired from the headphones 1 is stored in the memory unit 110.

[0084] In response to a touch operation on the display 102 (or an operation using the input unit 103), "week" is selected from the period setting display 33. Furthermore, in response to the above operation, "December 17th to 23rd, 2023" is set as the period display 34. The display control unit 101A recognizes the setting content.

[0085] The display control unit 101A reads out information necessary for display from the log acquired from the headphones 1 and stored in the memory unit 110. For example, the display control unit 101A searches for necessary information in the log using time information as a key, and performs calculations as necessary. Specifically, the display control unit 101A reads out the environmental sound pressure for which the time information is "Sunday, December 17th" from the log, and determines the minimum and maximum values ​​of the read environmental sound pressure. The display control unit 101A displays the minimum and maximum values ​​of the environmental sound pressure as a bar and a range of numbers in the Sunday area. The display control unit 101A also reads out the environmental sound pressure for which the time information is "December 17th to 23rd" from the log, and calculates the average value. The display control unit 101A displays the calculated average value as a first average value display 36A.

[0086] The display control unit 101A reads out the in-ear sound pressures for which the time information is "Sunday, December 17th" from the log, and calculates the average value of the read in-ear sound pressures. The display control unit 101A then displays a headphone mark 35B in the location corresponding to the calculated average value for "Sunday, December 17th." The display control unit 101A also reads out the in-ear sound pressures for which the time information is "December 17th to 23rd" from the log, and calculates the average value of the read in-ear sound pressures. The display control unit 101A then displays the calculated average value as a second average value display 36B.

[0087] The log stored in the memory unit 110 also stores the results of the determination made by the threshold determination unit 17 of the headphones 1. The display control unit 101A calculates the results of the determination made by the threshold determination unit 17 for "December 17th to 23rd" from the log, specifically, the total time during that week during which the environmental sound pressure was determined to exceed the threshold and the infront-ear sound pressure was determined to be equal to or less than the threshold. The display control unit 101A displays the total result as a protection time display 36C.

[0088] The above processing is performed in the same way for days other than December 17th. Note that some of the above-described display control processing may be performed by a device other than the display control unit 101A. In this example, the display control unit 101A reads out the log stored in the memory unit 110. However, the smartphone 100 may request information required for display from the headphones 1 each time. For example, the smartphone 100 requests the headphones 1 for the maximum and minimum environmental sound pressure values ​​for "December 17th" required for display. For example, the sound pressure integration unit 16 of the headphones 1 reads out the maximum and minimum environmental sound pressure values ​​for "December 17th" from the log stored in the memory 18 and transmits the read information to the smartphone 100. The display control unit 101A of the smartphone 100 controls the display 102 to display the maximum and minimum environmental sound pressure values ​​for "December 17th" transmitted from the headphones 1 as bars and numerical ranges. Information required for displaying other display elements is also requested from the headphones 1 by the smartphone 100.

[0089] 12 is a flowchart for explaining the flow of processing performed in the headphones 1. Note that the processing described below is performed on each of the environmental sound signal SA and the near-ear sound signal SB.

[0090] In step ST11, sound collection processing is performed by each of the first microphone 6 and the second microphone 8. Then, the processing proceeds to step ST12.

[0091] In step ST12, a sound pressure calculation process is performed by the sound pressure calculation unit 15. Then, the process proceeds to step ST13.

[0092] In step ST13, threshold determination processing is performed by the threshold determination unit 17. The threshold determination unit 17 determines whether or not the sound pressure calculated by the sound pressure calculation unit 15 exceeds a threshold. The threshold determination unit 17 outputs the determination result to the sound pressure integration unit 16. Then, the processing proceeds to step ST14.

[0093] In step ST14, the sound pressure integrating unit 16 calculates the integrated value of the environmental sound pressure, the integrated value of the in front of the ear sound pressure, etc. Then, the process proceeds to step ST15.

[0094] In step ST15, the sound pressure integration unit 16 performs a log recording process. The sound pressure integration unit 16 stores, for example, the sound pressure of the ambient sound pressure and its integrated value, the sound pressure of the forear sound pressure and its integrated value, and the judgment result of the threshold judgment unit 17 as a log in the memory 18. Note that the above-mentioned processes do not necessarily have to be performed in chronological order, and some of the processes may be performed in parallel. In this way, the headphones 1 can detect changes in forear sound pressure relative to the ambient sound pressure.

[0095] 13 is a flowchart for explaining the flow of processing performed by the smartphone 100. In step ST21, a log acquisition process is performed in which the smartphone 100 acquires a log from the headphones 1. Then, the process proceeds to step ST22.

[0096] In step ST22, the display control unit 101A performs a display control process. As a result of the display control process, the auditory effect display 35 and the like (see FIGS. 9, 10, and 11) are displayed on the display 102. The log acquisition process may be performed before the display control process, or may be performed each time the display control process is performed, so that the logs required for display are acquired.

[0097] Second Embodiment Next, a second embodiment will be described. In the description of the second embodiment, the same or similar components as those in the above description will be denoted by the same reference numerals, and duplicated descriptions will be omitted as appropriate. Furthermore, unless otherwise specified, the matters described in the first embodiment can be applied to the second embodiment.

[0098] 14 is a block diagram showing an example of the electrical configuration of headphones (headphones 1A) according to the second embodiment. The headphones 1A do not have a second microphone 8, but have a filter unit 25 (e.g., a digital filter). An environmental sound signal SA, which is the output of the first microphone 6, is branched and supplied to a first buffer 11 and a second buffer 13. The output of the second buffer 13 is AD converted and then filtered by the filter unit 25, generating a near-ear sound signal SB.

[0099] The filter unit 25 has a filter for each mode that can be set in the headphones 1A. Mode information related to the mode set in the headphones 1A is supplied to the filter unit 25. The filter unit 25 selects a filter corresponding to the mode information and performs filtering. That is, this embodiment is an embodiment in which a pre-prepared filter is used to perform filtering on the sound pressure of environmental sound picked up by the first microphone 6, thereby generating and acquiring a pre-auricular sound pressure. In this embodiment, the filter unit 25 functions as a sound pressure acquisition unit. Other processing (for example, display processing in the smartphone 100, etc.) has been explained in the first embodiment, so a duplicate explanation will be omitted.

[0100] Specific examples of filters corresponding to each mode will be described. Fig. 15 shows an example of the characteristics of a filter used when the mode set in the headphones 1A is the "noise cancellation on mode." The horizontal axis in Fig. 15 indicates frequency (Hz), and the vertical axis indicates sound pressure difference (dB). This also applies to Figs. 16 and 17. When the mode set in the headphones 1A is the "noise cancellation on mode," a filter is used that has characteristics such that the sound pressure difference becomes large from a relatively low frequency stage, for example.

[0101] 16 shows an example of the characteristics of a filter used when the mode set for the headphones 1A is the "ambient sound capture mode." When the mode set for the headphones 1A is the "ambient sound capture mode," for example, a filter having a flat characteristic in which the sound pressure difference is constant with respect to frequency is used. As described above, in the "ambient sound capture mode," it may be possible to set a level (for example, 20 levels) related to the amount of ambient sound captured. In this case, a filter with different characteristics may be used depending on the level.

[0102] 17 shows an example of the characteristics of a filter used when the mode set in the headphones 1A is the "noise cancellation off mode." When the mode set in the headphones 1A is the "noise cancellation off mode," for example, a filter having characteristics such that the sound pressure difference increases from a predetermined frequency value is used.

[0103] <Third Embodiment> Next, a third embodiment will be described. In the description of the third embodiment, the same or similar components as those in the above description will be denoted by the same reference numerals, and duplicated descriptions will be omitted as appropriate. Furthermore, unless otherwise specified, the matters described in the first and second embodiments can be applied to the third embodiment.

[0104] While the first and second embodiments described above focus on visualizing the effects obtained by the noise cancellation function, this embodiment visualizes, for example, how hearing is protected by using the headphones 1, and the possibility that exposure to high sound pressure for a long period of time may have a negative effect on hearing.

[0105] In recent years, the widespread use of headphones and the like has made it possible to listen to music and the like at relatively high volumes without being noticed by those around you. This has increased the risk of hearing loss, especially among younger people. Therefore, safe listening, which limits the total exposure amount to factors that may cause hearing loss to a certain level, is required. Factors that may cause hearing loss to the ears include volume, duration, and frequency, and the total exposure amount is determined taking these factors into consideration. In this embodiment, headphones 1, 1A, and a smartphone 100 are used to present information for achieving safe listening to a user.

[0106] In this embodiment, the above-described headphones 1 (or headphones 1A) and smartphone 100 are applied. FIG. 18 is a diagram illustrating a pattern of sound pressure measured by the headphones 1. For example, when the mode set for the headphones 1 is "noise cancellation on mode," the ambient sound pressure may exceed a threshold (e.g., 75 dB). In this case, the pre-auricular sound pressure may fall below the threshold due to the noise cancellation function. The threshold determination unit 17 can determine whether the ambient sound pressure has exceeded the threshold or whether the pre-auricular sound pressure has fallen below the threshold. The result is stored as a log in the memory 18. This also applies when the mode set for the headphones 1 is "noise cancellation off mode." When the mode set for the headphones 1 is "noise cancellation off mode," the pre-auricular sound pressure may fall below the threshold due to the sound-blocking effect of wearing the headphones 1. One possible example of this case is when the user uses the headphones 1 instead of earplugs.

[0107] That is, by using the log stored in memory 18, it is possible to calculate the time during which the in-ear sound pressure becomes equal to or less than the threshold when the environmental sound pressure exceeds the threshold, in other words, the time during which the ears are protected by the noise cancellation function or the sound-blocking effect of using the headphones 1 as earplugs. The display control unit 101A displays the calculation result on the display 102, thereby notifying the user that the ears are protected by the noise cancellation function or the sound-blocking effect of using the headphones 1 as earplugs.

[0108] FIG. 19 shows an example of the display content related to safe listening displayed on the display 102. The hearing impact display 35 displays a bar graph indicating "the amount of time the user was protected from sound pressure above a certain threshold while wearing the headphones." The horizontal axis of the bar graph indicates the day of the week from Sunday to Saturday, and the vertical axis indicates the amount of time the user was protected from sound pressure above a certain threshold while wearing the headphones on each day. Specifically, the amount of time the user experienced when the environmental sound pressure exceeded the threshold and the in-ear sound pressure was below the threshold. This display content allows the user to recognize the ear protection effect achieved by using the headphones 1. The display control process with reference to the log is performed by the display control unit 101A in the same manner as in the first embodiment. Of course, by switching the selection of the period setting display 33, it is also possible to display the amount of time the user experienced when the user was protected from sound pressure above a certain threshold while wearing the headphones by month or year.

[0109] Instead of a bar graph, the "time that the ears were protected from sound pressure above a certain threshold while wearing the headphones" may be displayed in another display mode. Fig. 20 shows an example of another display mode. For example, to the right of a mark resembling headphones 1, a character string stating "For the past week (or month, or year), your ears were protected from sounds above a certain threshold for 40 minutes while wearing the headphones" may be displayed.

[0110] FIG. 21 is a diagram illustrating another pattern of sound pressure measured by the headphones 1. In this pattern, the modes set for the headphones 1 include "noise cancellation on mode," "ambient sound capture mode," and "noise cancellation off mode." The ambient sound pressure may exceed the threshold. In this case, if the ambient sound pressure is particularly high (for example, if the ambient sound is noisy and has a sound pressure of 100 dB or more), the in-ear sound pressure may exceed the threshold even if the noise cancellation function is activated or the headphones 1 are used instead of earplugs. In other words, from the perspective of safe listening, the ears are exposed to dangerous sound pressure.

[0111] By referring to the log stored in the memory 18, it is possible to calculate the time during which the sound pressure in front of the ear exceeds the threshold even when headphones are worn. By displaying this time on the display 102, it is possible to notify the user of the time during which they are exposed to sound pressure that adversely affects their hearing.

[0112] FIG. 22 shows another example of the display content related to safe listening displayed on the display 102. The hearing impact display 35 displays a bar graph indicating "the amount of time the user was exposed to sound pressure above a certain threshold while wearing the headphones." The horizontal axis of the bar graph indicates the day of the week from Sunday to Saturday, and the vertical axis indicates the amount of time the user was exposed to sound pressure above a certain threshold while wearing the headphones on each day. This display content allows the user to recognize the amount of time the user was exposed to sound pressure that could adversely affect the ears, even when using the headphones 1. The display control process with reference to the log is performed by the display control unit 101A in the same manner as in the first embodiment. Of course, by switching the selection of the period setting display 33, it is also possible to display "the amount of time the user was exposed to sound pressure above a certain threshold while wearing the headphones" by month or year.

[0113] Instead of a bar graph, the "time exposed to sound pressure above a certain threshold while wearing headphones" may be displayed in a different display format. FIG. 23 shows an example of another display format. For example, a character string reading "You have been exposed to sound above a certain threshold for a certain period of time. Please be careful!!" may be displayed to the right of a warning-like mark. The "certain period of time" in this character string may be replaced with "a certain period of time or more," or a specific time period (e.g., 30 minutes). In this manner, according to this embodiment, the exposure time to sound pressure above a certain threshold can be presented to the user. Note that a calculation taking into account the volume and frequency may be performed to determine the total exposure amount over a certain period of time. The total exposure amount may then be presented to the user. The total exposure amount may be, for example, the dose of acoustic energy described above.

[0114] <Modifications> Although the embodiments of the present disclosure have been specifically described above, the contents of the present disclosure are not limited to the above-described embodiments, and various modifications based on the technical ideas of the present disclosure are possible.

[0115] In the above-described embodiment, the correction process according to the sensitivity and gain of each of the first microphone 6 and the second microphone 8 may be performed by the sound pressure calculation unit 15 instead of the sound pressure integration unit 16 .

[0116] The threshold value for sound pressure may not be a fixed value but may be dynamically changed according to past logs. For example, if the log shows that the user has been exposed to sound pressures above a certain threshold for a long period of time in the past, the threshold value may be set to a value smaller than the previous threshold value.

[0117] The logs related to the ambient sound pressure and the in-ear sound pressure are stored in the memory of the headphones, but may be stored in a cloud server. The smartphone may then acquire the logs from the cloud server. Furthermore, the processes described in the above-described embodiment and modified examples may be performed using a predetermined learning model.

[0118] The configurations, methods, steps, shapes, materials, and values ​​described in the above-described embodiments are merely examples, and different configurations, methods, steps, shapes, materials, and values ​​may be used as needed. The above-described embodiments and modifications can be combined as appropriate.

[0119] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0120] The present disclosure may also adopt the following configurations. (1) A display control device including a display control unit that displays, on a display unit, first sound pressure information corresponding to environmental sound pressure, which is the sound pressure of environmental sound acquired when an electronic device is worn, and second sound pressure information corresponding to the sound pressure inside the electronic device when the electronic device is worn. (2) The display control device according to (1), in which the display control unit displays the first sound pressure information and the second sound pressure information in a superimposed manner. (3) The display control device according to (1) or (2), in which the display control unit displays the second sound pressure information using a mark corresponding to the electronic device. (4) The display control device according to any of (1) to (3), in which the display control unit switches the display between the first sound pressure information and the second sound pressure information on a daily basis, the first sound pressure information and the second sound pressure information on a weekly basis, and the first sound pressure information and the second sound pressure information on a monthly basis in response to a predetermined operation. (5) The display control device according to (3), in which the mark is a mark corresponding to an ear-wearable electronic device. (6) The display control device according to (5), wherein the mark corresponds to any one of headphones, earphones, hearing aids, and digital earplugs. (7) The display control device according to any one of (1) to (6), wherein the electronic device is a device that can be worn on an ear, and the second sound pressure information is information corresponding to pre-auricular sound pressure, which is sound pressure near the ear. (8) The display control device according to any one of (1) to (7), comprising a communication unit that acquires the first sound pressure information and the second sound pressure information from the electronic device. (9) The display control device according to any one of (1) to (8), comprising the display unit. (10) A display control method, wherein a display control unit controls a display unit to display first sound pressure information corresponding to environmental sound pressure, which is the sound pressure of environmental sound acquired when the electronic device is worn, and second sound pressure information corresponding to the sound pressure inside the electronic device when the electronic device is worn. (11) A sound reproducing device having a sound collection unit that acquires environmental sound pressure, which is the sound pressure of environmental sound; a sound pressure acquisition unit that acquires pre-auricular sound pressure, which is the sound pressure near the ear; and a communication unit that transmits history related to the environmental sound pressure and the pre-auricular sound pressure to an external device.(12) The sound reproducing device according to (11), wherein the sound pressure acquisition unit is a filter unit that acquires the in-ear sound pressure by applying a filter according to a mode to the environmental sound pressure. (13) The sound reproducing device according to (12), wherein the modes include a mode in which a noise cancellation function is turned on and a mode in which the noise cancellation function is turned off. (14) The sound reproducing device according to any of (11) to (13), which is any of headphones, earphones, hearing aids, and digital earplugs.

[0121] DESCRIPTION OF SYMBOLS 1, 1A... Headphones 6... First microphone 8... Second microphone 19... Communication unit 25... Filter unit 35... Hearing effect display 35A... Environmental sound pressure display 35B... Headphone mark 100... Smartphone 101A... Display control unit 106... Near field wireless communication unit

Claims

1. A display control device having a display control unit that displays on a display unit first sound pressure information corresponding to the environmental sound pressure, which is the sound pressure of the environmental sound acquired when the electronic device is worn, and second sound pressure information corresponding to the sound pressure inside the electronic device when the electronic device is worn.

2. The display control device according to claim 1, wherein the display control unit displays the first sound pressure information and the second sound pressure information in a superimposed manner.

3. The display control device according to claim 1, wherein the display control unit displays the second sound pressure information by a mark corresponding to the electronic device.

4. The display control device according to claim 1, wherein the display control unit switches the display of the first sound pressure information and the second sound pressure information daily, the first sound pressure information and the second sound pressure information weekly, and the first sound pressure information and the second sound pressure information monthly in response to a predetermined operation.

5. The display control device according to claim 3, wherein the mark corresponds to an electronic device that can be worn on the ear.

6. The display control device according to claim 5, wherein the mark corresponds to any one of headphones, earphones, hearing aids, and digital earplugs.

7. The display control device according to claim 1, wherein the electronic device is an ear-mountable device, and the second sound pressure information is information corresponding to a pre-auricular sound pressure, which is a sound pressure near the ear.

8. The display control device according to claim 1, further comprising a communication unit that acquires the first sound pressure information and the second sound pressure information from the electronic device.

9. The display control device according to claim 1, comprising the display unit.

10. A display control method in which a display control unit controls the display unit to display first sound pressure information corresponding to the environmental sound pressure, which is the sound pressure of the environmental sound acquired when the electronic device is worn, and second sound pressure information corresponding to the sound pressure inside the electronic device when the electronic device is worn.

11. A sound reproduction device having a sound collection unit that acquires environmental sound pressure, which is the sound pressure of environmental sounds; a sound pressure acquisition unit that acquires pre-auricular sound pressure, which is the sound pressure near the ear; and a communication unit that transmits history related to the environmental sound pressure and the pre-auricular sound pressure to an external device.

12. The sound reproducing device according to claim 11, wherein the sound pressure acquisition unit is a filter unit that acquires the in-ear sound pressure by applying a filter according to a mode to the environmental sound pressure.

13. The sound reproducing device according to claim 12, wherein the modes include a mode in which a noise canceling function is turned on and a mode in which the noise canceling function is turned off.

14. The sound reproducing device according to claim 11, which is one of headphones, earphones, hearing aids, and digital earplugs.

Images