Electronic device and method for reducing power consumption in wireless environment, and computer-readable storage medium
By selectively transmitting posture sensing data only when significant changes occur, the system addresses power consumption issues in wearable devices, ensuring efficient power usage without compromising spatial sound quality.
Patent Information
- Application Number
- PCT/KR2025/001060
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-03-20
- Filing Date
- 2025-01-20
- Publication Date
- 2025-09-25
AI Technical Summary
Existing wireless communication technologies, such as Bluetooth, face challenges in efficiently managing power consumption when adjusting spatial sound effects in wearable devices due to frequent changes in posture, leading to increased power usage.
Implementing a system in wearable devices that selectively transmits posture sensing data only when significant changes occur, thereby reducing unnecessary power consumption while maintaining the quality of spatial sound effects.
Reduces power consumption by minimizing unnecessary data transmission related to subtle posture changes, while maintaining the quality of spatial sound effects in wearable devices.
Smart Images

Figure KR2025001060_25092025_PF_FP_ABST
Abstract
Description
Electronic devices, methods, and computer-readable storage media for reducing power consumption in wireless environments
[0001] The present disclosure relates to electronic devices, methods, and computer-readable storage media for reducing power consumption in a wireless environment.
[0002] Bluetooth® (or legacy Bluetooth® (or classic Bluetooth)) is a short-range wireless technology standard used for exchanging data between electronic devices. Bluetooth can be provided on the ISM (industrial, scientific, and medical) radio band. For example, Bluetooth can be used to exchange text information, voice information, and / or audio information through wireless communication between electronic devices.
[0003] The above information may be provided as background art to aid in understanding the present disclosure.
[0004] No claim or determination is made as to whether any of the above is applicable as prior art to the present disclosure.
[0005] A wearable device is described. The wearable device may include a memory storing instructions and including one or more storage media. The wearable device may include at least one sensor configured to obtain sensing values according to a change in a posture of the wearable device. The wearable device may include a speaker. The wearable device may include communication circuitry. The wearable device may include at least one processor including a processing circuit. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to output audio through the speaker using data received from an external electronic device through the communication circuitry. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to obtain a first sensing value through the at least one sensor while the audio is output through the speaker using the data. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data about the first sensing value to the external electronic device via the communication circuit to apply a spatial sound effect corresponding to the first posture of the wearable device to the audio. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to obtain a second sensing value via the at least one sensor after transmitting the data about the first sensing value.The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data about the second sensed value to the external electronic device via the communication circuitry to apply a spatial sound effect to the audio corresponding to a second posture of the wearable device changed from the first posture of the wearable device based on the second sensed value being outside a reference range with respect to the first sensed value. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to refrain from transmitting data about the second sensed value to the external electronic device via the communication circuitry based on the second sensed value being within the reference range with respect to the first sensed value.
[0006] A method is described. The method may be performed by a wearable device including at least one sensor configured to obtain sensing values according to a change in a posture of the wearable device. The method may include an operation of outputting audio through the speaker using data received from an external electronic device through the communication circuit. The method may include an operation of obtaining a first sensing value through the at least one sensor while the audio is output through the speaker using the data. The method may include an operation of transmitting data for the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to the first posture of the wearable device to the audio. The method may include an operation of obtaining a second sensing value through the at least one sensor after transmitting the data for the first sensing value. The method may include an operation of transmitting data for the second sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a second posture of the wearable device changed from the first posture of the wearable device to the audio based on the second sensing value being outside a reference range with respect to the first sensing value. The method may include an operation of refraining from transmitting the data for the second sensing value to the external electronic device through the communication circuit based on the second sensing value being within the reference range with respect to the first sensing value.
[0007] A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by a wearable device including at least one sensor configured to obtain sensed values according to a change in a posture of the wearable device, cause the wearable device to output audio through the speaker using data received from an external electronic device through the communication circuit. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to obtain a first sensed value through the at least one sensor while the audio is output through the speaker using the data. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data regarding the first sensing value to the external electronic device via the communication circuit to apply a spatial sound effect corresponding to a first posture of the wearable device to the audio. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to obtain a second sensing value via the at least one sensor after transmitting the data regarding the first sensing value. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data about the second sensing value to the external electronic device through the communication circuit to apply a spatial sound effect to the audio corresponding to a second posture of the wearable device changed from the first posture of the wearable device based on the second sensing value being outside a reference range with respect to the first sensing value.The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to refrain from transmitting data for the second sensing value to the external electronic device via the communication circuit based on the second sensing value being within the reference range with respect to the first sensing value.
[0008] Figure 1 illustrates an example of applying spatial sound effects to audio of a wearable device.
[0009] Figure 2 illustrates an example of applying spatial sound effects to audio corresponding to a changed posture of a wearable device.
[0010] Figure 3a is a simplified block diagram of an exemplary wearable device.
[0011] Figure 3b is a simplified block diagram of an exemplary external electronic device.
[0012] Figure 4 illustrates exemplary operations for adjusting spatial sound effects.
[0013] Figure 5 illustrates exemplary operations depending on whether the second sensing value is within a reference range with respect to the first sensing value.
[0014] Figure 6 illustrates a chart representing a first sensing value and a second sensing value.
[0015] FIG. 7 illustrates exemplary operations for adjusting a spatial sound effect upon obtaining a second sensing value that is outside a reference range with respect to a first sensing value.
[0016] Figure 8 illustrates exemplary operations depending on whether the fourth sensing value is within a reference range with respect to the third sensing value most recently acquired before the reference time elapses.
[0017] Figure 9 illustrates a chart representing the second sensing value and the third sensing value before the reference time elapses, and the fourth sensing value after the reference time elapses.
[0018] Figure 10 illustrates exemplary operations depending on whether the fourth sensing value is within a reference range with respect to the third sensing value most recently acquired before the reference time elapses before another reference time elapses.
[0019] Figure 11 illustrates a chart representing a second sensing value, a third sensing value, and a fourth sensing value before the elapse of another reference time and a sensing value after the elapse of another reference time.
[0020] FIG. 12 is a block diagram of an electronic device within a network environment according to various embodiments.
[0021] Figure 13 is a block diagram of an audio module according to various embodiments.
[0022] Figure 1 illustrates an example of applying spatial sound effects to audio of a wearable device.
[0023] Referring to FIG. 1, the first wearable device (101-1) and the second wearable device (101-2) may be a pair. As a non-limiting example, the first wearable device (101-1) may be worn on the right ear of the user (103), and the second wearable device (101-2) may be worn on the left ear of the user (103).
[0024] For example, there may be a state (100) in which a user (103) wears a first wearable device (101-1) on the right ear and a second wearable device (101-2) on the left ear.
[0025] For example, the first wearable device (101-1) and the second wearable device (101-1) may include a communication circuit. For example, the communication circuit may be used to receive data for outputting audio from an external electronic device (104).
[0026] For example, the external electronic device (104) may include a communication circuit. For example, the communication circuit may be used to transmit data for outputting audio to the first wearable device (101-1). For example, the communication circuit may be used to transmit data for outputting audio to the second wearable device (101-2).
[0027] For example, a first wearable device (101-1) can receive first data (105) for outputting audio from an external electronic device (104) through a communication circuit. For example, a second wearable device (101-2) can receive second data (106) for outputting audio from an external electronic device (104) through a communication circuit.
[0028] For example, the first wearable device (101-1) and the second wearable device (101-2) may include speakers. For example, the speakers may be used to output audio. For example, the first wearable device (101-1) may output the audio through the speakers using the first data (105). For example, the second wearable device (101-2) may output the audio through the speakers using the second data (106).
[0029] For example, the first data (105) may be different from the second data (106). For example, audio output from the first wearable device (101-1) using the first data (105) may be different from audio output from the second wearable device (101-2) using the second data (106). For example, a spatial sound effect may be provided based on the difference between audio output from the first wearable device (101-1) and audio output from the second wearable device (101-2) using the second data (106). For example, audio with a spatial sound effect applied may be provided by the first wearable device (101-1) that outputs audio using the first data (105) and the second wearable device (101-2) that outputs audio using the second data (106).
[0030] A user (103) in a state (100) of listening to audio with spatial sound effects applied may feel that he or she is located in a virtual space (107) where he or she can hear audio output from a sound source (108).
[0031] For example, a spatial sound effect may reflect the relative positional relationship between a sound source (108) and a user (103) within a virtual space (107) in the audio. For example, audio (109) provided within the virtual space (107) may be output in a direction from the sound source (108) to the user (103). As a non-limiting example, the direction of the sound source (108) toward the user (103) within the virtual space (107) may be the direction of the external electronic device (104) with respect to the user (103) in the state (100). For example, within the virtual space (107), the distance between the sound source (108) and the right ear of the user (103) may be different from the distance between the sound source (108) and the left ear of the user (103). For example, due to the difference in distance, audio (110) transmitted to the right ear of the user (103) may be different from audio (111) transmitted to the left ear of the user (103).
[0032] As a non-limiting example, the difference between audio (110) and audio (111) may be a difference in the volume of the audio. As a non-limiting example, in state (100), the volume of the audio output from the first wearable device (101-1) may be different from the volume of the audio output from the second wearable device (101-2). As a non-limiting example, the difference between the volume of the audio output from the first wearable device (101-1) and the volume of the audio output from the second wearable device (101-2) may be caused by a difference between the first data (105) and the second data (106). As a non-limiting example, the user (103) may perceive the difference between the size of the audio volume output from the first wearable device (101-1) and the size of the audio volume output from the second wearable device (101-2) as the difference between the size of the audio volume (110) transmitted to the user's (103) right ear and the size of the audio volume (111) transmitted to the user's (103) left ear in the virtual space (107).
[0033] For example, the first wearable device (101-1) and the second wearable device (101-2) can output audio with an effect that makes the user (103) hear the audio in a virtual space (107) by utilizing the difference between the audio output from the first wearable device (101-1) and the audio output from the second wearable device (101-2).
[0034] For example, the posture of the first wearable device (101-1) and the second wearable device (101-2) may change depending on the rotation of the user's (103) head. For example, the posture of the wearable device may be referred to as the orientation of the wearable device. For example, the first wearable device (101-1) and the second wearable device (101-2) may output audio to which a spatial sound effect corresponding to the changed posture of the first wearable device (101-1) and the second wearable device (101-2) is applied. The spatial sound effect corresponding to the changed posture of the first wearable device (101-1) and the second wearable device (101-2) is exemplified in the description of FIG. 2.
[0035] Figure 2 illustrates an example of applying spatial sound effects to audio corresponding to a changed posture of a wearable device.
[0036] Referring to FIG. 2, the state (100) can be changed to the state (200) according to the rotation (201) of the head of the user (103). The state (200) can be described as a state in which the postures of the first wearable device (101-1) and the second wearable device (101-2) are changed according to the rotation (201) of the head of the user (103).
[0037] For example, each of the first wearable device (101-1) and the second wearable device (101-2) or one of the first wearable device (101-1) and the second wearable device (101-2) may include at least one sensor. For example, the at least one sensor may be used to obtain a sensing value according to a change in the posture of the first wearable device (101-1) and / or may be used to obtain a sensing value according to a change in the posture of the second wearable device (101-2).
[0038] For example, the postures of the first wearable device (101-1) and the second wearable device (101-2) may change depending on the rotation (201) of the head of the user (103). For example, the first wearable device (101-1) may obtain a sensing value (203) according to the change in the posture of the first wearable device (101-1) through at least one sensor. For example, the second wearable device (101-2) may obtain a sensing value (204) according to the change in the posture of the second wearable device (101-2) through at least one sensor.
[0039] For example, the sensing value (203) of the first wearable device (101-1) in the state (200) may be different from the sensing value (not shown) of the first wearable device (101-1) in the state (100). For example, the sensing value (204) of the second wearable device (101-2) in the state (200) may be different from the sensing value of the second wearable device (101-2) in the state (200).
[0040] For example, each of the first wearable device (101-1) and the second wearable device (101-2) may include a communication circuit. For example, the communication circuit may be used to transmit data regarding a sensing value to an external electronic device (104). For example, the communication circuit of each of the first wearable device (101-1) and the second wearable device (101-2) may be used to receive data for outputting audio from the external electronic device (104).
[0041] For example, the external electronic device (104) may include a communication circuit. For example, the communication circuit may be used to receive data regarding sensing values from the first wearable device (101-1) and the second wearable device (101-2). For example, the communication circuit may be used to transmit data for outputting audio to each of the first wearable device (101-1) and the second wearable device (101-2).
[0042] For example, the first wearable device (101-1) can transmit a sensing value (203) in a state (200) according to a change in the posture of the first wearable device (101-1) to an external electronic device (104) through a communication circuit. For example, the second wearable device (101-2) can transmit a sensing value (204) in a state (200) according to a change in the posture of the second wearable device (101-2) to an external electronic device (104) through a communication circuit.
[0043] For example, the external electronic device (104) may transmit data (205) for applying a spatial sound effect corresponding to the posture of the first wearable device (101-1) in the state (200) to the audio to the first wearable device (101-1) through the communication circuit in response to the received sensing value (203). For example, the external electronic device (104) may transmit data (206) for applying a spatial sound effect corresponding to the posture of the second wearable device (101-2) in the state (200) to the audio to the second wearable device (101-2) through the communication circuit in response to the received sensing value (204).
[0044] For example, the first wearable device (101-1) can output audio with spatial sound effects applied using data (205). For example, the second wearable device (101-2) can output audio with spatial sound effects applied using data (206).
[0045] For example, a user (103) in a state (200) of listening to audio with spatial sound effects applied may feel that he or she is located in a virtual space (207) where he or she can hear audio output from a sound source (108).
[0046] For example, audio (209) provided within a virtual space (207) may be output in a direction from a sound source (108) to a user (103). As a non-limiting example, the direction of the sound source (108) to the user (103) within the virtual space (207) may be the direction of the external electronic device (104) with respect to the user (103) in the state (200). For example, the distance between the sound source (108) and the right ear of the user (103) within the virtual space (207) may be different from the distance between the sound source (108) and the left ear of the user (103). For example, due to the distance difference within the virtual space (207), audio (210) transmitted from the sound source (108) to the right ear of the user (103) may be different from audio (211) transmitted from the sound source (108) to the left ear of the user (103).
[0047] As a non-limiting example, the distance between the sound source (108) and the right ear of the user (103) within the virtual space (207) may be longer than the distance between the sound source (108) and the right ear of the user (103) within the virtual space (107). As a non-limiting example, audio (210) transmitted from the sound source (108) to the right ear of the user (103) within the virtual space (207) may be different from audio (110) transmitted from the sound source (108) to the right ear of the user (103) within the virtual space (107).
[0048] As a non-limiting example, the distance between the sound source (108) and the left ear of the user (103) within the virtual space (207) may be shorter than the distance between the sound source (108) and the left ear of the user (103) within the virtual space (107). As a non-limiting example, audio (211) transmitted from the sound source (108) to the left ear of the user (103) within the virtual space (207) may be different from audio (111) transmitted from the sound source (108) to the left ear of the user (103) within the virtual space (107). For example, the first wearable device (101-1) and the second wearable device (101-2) may output audio with a spatial sound effect applied through the difference between the audio output from the first wearable device (101-1) and the audio output from the second wearable device (101-2). As a non-limiting example, content provided by audio output from a first wearable device (101-1) may be substantially the same as (or correspond to) content provided by audio output from a second wearable device (101-2), but properties of audio output from the first wearable device (101-1) may be at least partially different from properties of audio output from the second wearable device (101-2).
[0049] As a non-limiting example, the properties of audio output from the first wearable device (101-1) in state (100) may be at least partially different from the properties of audio output from the first wearable device (101-1) in state (200). As a non-limiting example, the properties of audio output from the second wearable device (101-2) in state (100) may be at least partially different from the properties of audio output from the second wearable device (101-2) in state (200).
[0050] As a non-limiting example, at a reference point included within the total playback time interval of the audio, an attribute of the audio output from the first wearable device (101-1) may be a first attribute. As a non-limiting example, at the reference point, depending on a change in the posture of the first wearable device (101-1), an attribute of the audio output from the first wearable device (101-1) may be a second attribute that is at least partially different from the first attribute. As a non-limiting example, at the reference point included within the total playback time interval of the audio, an attribute of the audio output from the second wearable device (101-2) may be a third attribute. As a non-limiting example, at the reference point, depending on a change in the posture of the second wearable device (101-2), an attribute of the audio output from the second wearable device (101-2) may be a fourth attribute that is at least partially different from the third attribute.
[0051] For example, according to a change from state (100) to state (200), the first wearable device (101-1) can output changed audio. For example, according to a change from state (100) to state (200), the second wearable device (101-2) can output changed audio. For example, the first wearable device (101-1) and the second wearable device (101-2) can output changed audio, thereby outputting audio to which a changed spatial sound effect is applied.
[0052] For example, the postures of the first wearable device (101-1) and the second wearable device (101-2) can be changed according to relatively fine head rotation (201) of the user (103).
[0053] For example, the first wearable device (101-1) and the second wearable device (101-2) can obtain sensing values that change according to relatively fine head rotation (201) of the user (103). For example, the power consumed by the first wearable device (101-1) and the second wearable device (101-2) that transmit all sensing values that change according to relatively fine head rotation (201) of the user (103) to the external electronic device (104) may be relatively large. For example, the external electronic device (104) may consume relatively much power by transmitting audio with spatial sound effects applied to the first wearable device (101-1) and the second wearable device (101-2) based on receiving all sensing values changed according to relatively subtle head rotations (201) of the user (103) from the first wearable device (101-1) and the second wearable device (101-2).
[0054] For example, the first wearable device (101-1) and the second wearable device (101-2) can reduce the power consumed to provide a spatial sound effect by refraining from transmitting (or skipping, or delaying, or bypassing, or not transmitting) the sensing value changed according to the relatively fine rotation (201) of the user's (103) head to the external electronic device (104). For example, the external electronic device (104) can reduce the power consumed to provide a spatial sound effect by refraining from receiving (or skipping, or delaying, or bypassing, or not receiving) the sensing value changed according to the relatively fine rotation (201) of the user's (103) head from the first wearable device (101-1) and the second wearable device (101-2).
[0055] For example, the difference between the postures of the first wearable device (101-1) and the second wearable device (101-2) according to the relatively fine rotation (201) of the user's (103) head and the postures of the first wearable device (101-1) and the second wearable device (101-2) before the relatively fine rotation (201) of the user's (103) head may not be relatively large. For example, the difference between the sensing value of the first wearable device (101-1) acquired after the relatively fine rotation (201) of the head and the sensing value of the first wearable device (101-1) acquired before the relatively fine rotation (201) of the head may not be relatively large. For example, the difference between the sensing value of the second wearable device (101-2) acquired after a relatively fine rotation of the head (201) and the sensing value of the second wearable device (101-2) acquired before the relatively fine rotation of the head (201) may not be relatively large. For example, the difference between the audio to which a spatial sound effect corresponding to the posture of the first wearable device (101-1) is applied after a relatively fine rotation of the head (201) and the audio to which a spatial sound effect corresponding to the posture of the first wearable device (101-1) is applied before the relatively fine rotation of the head (201) may not be relatively large. For example, the difference between the audio to which a spatial sound effect corresponding to the posture of the second wearable device (101-2) is applied after a relatively fine rotation of the head (201) and the audio to which a spatial sound effect corresponding to the posture of the second wearable device (101-2) is applied before the relatively fine rotation of the head (201) may not be relatively large.
[0056] For example, even if the first wearable device (101-1) and the second wearable device (101-2) refrain from transmitting (or skip, or delay, or bypass, or not perform transmission) the sensing value changed according to the minute head rotation (201) of the user (103) to the external electronic device (104), the quality of the spatial sound effect applied to the audio can be maintained. For example, even if the external electronic device (104) refrain from receiving (or skip, or delay, or bypass, or not perform reception) the sensing value changed according to the minute head rotation (201) of the user (103) from the first wearable device (101-1) and the second wearable device (101-2), the quality of the spatial sound effect applied to the audio can be maintained.
[0057] For example, the above-exemplified operations and other operations related to the above-exemplified operations may be executed within the first wearable device (101-1), the second wearable device (101-2), and the external electronic device (104) exemplified below. The first wearable device (101-1), the second wearable device (101-2), and the external electronic device (104) are exemplified within the descriptions of FIGS. 3A and 3B .
[0058] Figure 3a is a simplified block diagram of an exemplary wearable device.
[0059] The wearable device (101) described below may represent a first wearable device (101-1), a second wearable device (101-2), a device that operates as a primary device among the first wearable device (101-1) and the second wearable device (101-2), or may represent both the first wearable device (101-1) and the second wearable device (101-2).
[0060] Referring to FIG. 3A, the wearable device (101) may be described as earbuds worn on a user's ears. The wearable device (101) may include a first wearable device (101-1) and a second wearable device (101-2). The wearable device (101) may include at least a portion of the electronic device (1202) of FIG. 12, or may correspond to at least a portion of the electronic device (1202) of FIG. 12. The wearable device (101) may include at least one processor (300), a memory (310), at least one sensor (320), a communication circuit (330), and a speaker (340).
[0061] For example, at least one processor (300) may be configured to control a memory (310), at least one sensor (320), a communication circuit (330), and a speaker (340). At least one processor (300) may be configured to execute instructions stored in the memory (310) to cause the wearable device (101) to perform at least some of the operations exemplified in the descriptions of FIGS. 1 and 2. At least one processor (300) may be configured to execute instructions stored in the memory (310) to cause the wearable device (101) to perform at least some of the operations exemplified in the descriptions of FIGS. 4 to 11.
[0062] The memory (310) can store various data used by at least one component (e.g., at least one processor (300) or at least one sensor (320)) of the wearable device (101). For example, the data can include input data or output data for software and commands related thereto. The memory (310) can include volatile memory or non-volatile memory.
[0063] At least one sensor (320) can detect an external environmental condition (e.g., a user condition) of the wearable device (101) and generate an electrical signal or data value corresponding to the detected condition. For example, the at least one sensor (320) can include a gesture sensor, a gyro sensor, or an acceleration sensor. For example, the at least one sensor (320) can be used to obtain a sensing value regarding the posture of the wearable device (101).
[0064] The communication circuit (330) may support legacy Bluetooth and / or BLE (Bluetooth low energy). For example, the communication circuit (330) may be used for communication with an external electronic device (104). For example, the communication circuit (330) may be used to receive data used for outputting audio from the external electronic device (104). For example, the communication circuit (330) may be used to transmit data regarding a sensing value to the external electronic device (104).
[0065] The speaker (340) may be configured to output audio. For example, the speaker (340) may output audio provided from an external electronic device (104). For example, the speaker (340) may be used for the spatial sound effect.
[0066] The wearable device (101) exemplified in the description of FIG. 3A can execute at least some of the operations exemplified in the description of FIGS. 4 to 11. For example, the operations exemplified in the description of FIGS. 4 to 11 can be caused by (or within) the wearable device (101) under the control of at least one processor (300). For example, the external electronic device (104) can include components for executing at least some of the operations related to the operations caused by the wearable device (101). The components are exemplified in the description of FIG. 3B.
[0067] Figure 3b is a simplified block diagram of an exemplary external electronic device.
[0068] Referring to FIG. 3B, the external electronic device (104) may be a device available for providing a sound source. For example, the external electronic device (104) may be described as a smartphone or tablet including circuits for providing a sound source. For example, the external electronic device (104) may include at least a portion of the electronic device (1201) of FIG. 12 or may correspond to at least a portion of the electronic device (1201) of FIG. 12. The external electronic device (104) may include at least one processor (350), memory (360), communication circuit (370), and display (380).
[0069] The processor (350) may include at least a portion of the processor (1220) of FIG. 12 or may correspond to at least a portion of the processor (1220) of FIG. 12. At least one processor (350) may be configured to control the communication circuit (370). At least one processor (350) may be configured to execute instructions stored in the memory (360) to cause the external electronic device (104) to perform at least a portion of the operations illustrated in the descriptions of FIGS. 1 and 2. For example, at least one processor (350) may control the communication circuit (370) by executing the instructions stored in the memory (360).
[0070] The memory (360) may be configured to store the instructions. For example, the instructions may be included in one or more programs. For example, the memory (360) may include non-volatile memory. For example, the memory (360) may include at least a portion of the memory (1230) of FIG. 12 (e.g., non-volatile memory (1234)) or may correspond to at least a portion of the memory (1230) of FIG. 12.
[0071] The communication circuit (370) may support legacy Bluetooth and / or BLE (Bluetooth low energy). For example, the communication circuit (370) may be used for communication with the wearable device (101). For example, the communication circuit (370) may be used to transmit data used for audio output to the wearable device (101). For example, the communication circuit (330) may be used to receive data regarding sensing values from the wearable device (101).
[0072] The display (380) may be configured to display visual information, visual data, images, and / or user interfaces. As a non-limiting example, the display (380) may be configured to receive input (e.g., touch input). For example, the display (380) may be used for spatial sound effects.
[0073] The external electronic device (104) illustrated in the description of FIG. 3b may execute at least some of the operations illustrated in the description of FIGS. 4 to 11. For example, the operations illustrated in the description of FIGS. 4 to 11 may be caused by (or within) the external electronic device (104) under the control of at least one processor (350).
[0074] Figure 4 illustrates exemplary operations for adjusting spatial sound effects.
[0075] Referring to FIG. 4, in operation 400, the external electronic device (104) (or at least one processor (350) of the external electronic device (104)) can transmit data for outputting audio to the wearable device (101) via the communication circuit (370). The wearable device (101) (or at least one processor (300) of the wearable device (101)) can receive data for outputting audio from the external electronic device (104) via the communication circuit (330).
[0076] In operation 410, at least one processor (300) may output audio using the received data. Operations described below (e.g., operations 420 to 440) may be executed while the audio is being output.
[0077] In operation 420, at least one processor (300) may obtain a sensing value through at least one sensor (320). For example, the sensing value may be a value regarding the posture of the wearable device (101). For example, the sensing value may change as the posture of the wearable device (101) changes. For example, the posture of the wearable device (101) may change according to the rotation of the user's head. For example, at least one processor (300) may obtain a sensing value through at least one sensor (320) to adjust the volume of audio output through the speaker (340) according to the change in the posture of the wearable device (101).
[0078] In operation 430, at least one processor (300) may transmit data on the acquired sensing value to an external electronic device (104) via a communication circuit (330). For example, at least one processor (300) may transmit data on the acquired sensing value to the external electronic device (104) on a first channel.
[0079] For example, at least one processor (350) of the external electronic device (104) may receive the data from the wearable device (101). For example, at least one processor (350) of the external electronic device (104) may obtain data for outputting audio to which a spatial sound effect is applied according to the sensed value, using data on the received sensed value. For example, the data for outputting audio to which a spatial sound effect is applied according to the sensed value may be data for outputting audio to which a spatial sound effect is applied corresponding to the posture of the wearable device (101) at the time when the wearable device (101) obtains the sensed value. In operation 440, at least one processor (350) of the external electronic device (104) may transmit data for outputting audio to which a spatial sound effect is applied according to the sensed value to the wearable device (101). For example, the data may be transmitted through the communication circuit (370). For example, the data may be transmitted on a second channel that is different from the first channel.
[0080] At least one processor (300) of the wearable device (101) may receive data for outputting audio to which a spatial sound effect is applied according to the sensing value from an external electronic device (104) via a communication circuit (330). For example, the data may be received on a second channel different from the first channel.
[0081] For example, at least one processor (300) can output audio with spatial sound effects applied using the received data.
[0082] For example, a first channel may have a first frequency band. For example, a second channel may have a second frequency band that is different from the first frequency band. For example, because the first channel has a different frequency band from the second channel, the first channel can be distinguished from the second channel.
[0083] For example, at least one processor (300) can output audio with spatial sound effects applied using the data.
[0084] For example, at least one processor (300) may receive data for outputting audio with spatial sound effects applied according to the sensing value from an external electronic device (104) via a communication circuit (330) and then obtain another sensing value. Obtaining the other sensing value is exemplified in the description of FIG. 5.
[0085] Figure 5 illustrates exemplary operations depending on whether the second sensing value is within a reference range with respect to the first sensing value.
[0086] Referring to FIG. 5, in operation 500, at least one processor (300) of the wearable device (101) may obtain a first sensing value. For example, the posture of the wearable device (101) at the time when at least one processor (300) obtains the first sensing value may be the first posture.
[0087] For example, at least one processor (300) may acquire a second sensing value after acquiring a first sensing value. For example, the posture of the wearable device (101) at the time of acquiring the second sensing value may be different from the first posture.
[0088] In operation 510, at least one processor (300) may identify, based on obtaining the second sensing value, whether the second sensing value is within a reference range with respect to the first sensing value.
[0089] For example, the reference range may be a reference ratio range for the first sensed value. For example, the fact that the second sensed value is within the reference range for the first sensed value may be explained as a relatively small difference between the first sensed value and the second sensed value. For example, the fact that the second sensed value is outside the reference range for the first sensed value may be explained as a relatively large difference between the second sensed value and the first sensed value.
[0090] For example, the reference range may be predetermined. For example, the reference range may be set by an external electronic device (104). For example, the reference range may be set by a user. For example, the reference range may be set by user input on the display of the external electronic device (104).
[0091] For example, at least one processor (300) may determine whether to transmit data regarding a second sensing value to an external electronic device (104) based on whether the second sensing value is within a reference range relative to the first sensing value. Whether the second sensing value is within a reference range relative to the first sensing value is exemplified in the description of FIG. 6.
[0092] Figure 6 illustrates a chart representing a first sensing value and a second sensing value.
[0093] Referring to FIG. 6, the chart (600) and the chart (660) represent changes in the magnitude of the sensing value over time. The vertical axis (610) in the chart (600) and the chart (660) represents the magnitude of the sensing value, and the horizontal axis (620) in the chart (600) and the chart (660) represents time.
[0094] For example, the sensing values can be expressed as arrows in the chart (600) and chart (660).
[0095] For example, at least one processor (300) of the wearable device (101) may obtain a first sensing value (630). For example, a reference range (640) may be set based on the first sensing value. For example, the reference range (640) may be a range from a value smaller than the reference ratio with respect to the first sensing value to a value larger than the reference ratio with respect to the first sensing value. For example, the reference ratio may be predetermined. For example, the reference ratio may be set by a user.
[0096] For example, in the chart (600), at least one processor (300) may acquire a first sensing value (630) and then acquire a second sensing value (650) within a reference range (640) with respect to the first sensing value (630). For example, the posture of the wearable device (101) at the time when at least one processor (300) acquires the second sensing value (650) within the reference range (640) with respect to the first sensing value (630) may be the second posture.
[0097] For example, the second sensing value (650) may be greater than a value that is smaller by a reference ratio with respect to the first sensing value (630), and may be less than a value that is larger by a reference ratio with respect to the first sensing value. For example, the second sensing value (650) that is within a reference range (640) with respect to the first sensing value (630) may be described as having a relatively small difference with respect to the first sensing value (630). For example, the second posture may be described as having a relatively small difference with respect to the first posture.
[0098] For example, at least one processor (300) may execute operation 520 of FIG. 5 based on obtaining a second sensing value (650) within a reference range (640) with respect to a first sensing value (630).
[0099] For example, in the chart (660), at least one processor (300) can obtain a first sensing value (630). For example, a reference range (640) can be set based on the first sensing value.
[0100] For example, at least one processor (300) may acquire a second sensed value (670-1) or a second sensed value (670-2) that is outside a reference range after acquiring a first sensed value (630). For example, the second sensed value (670-1) may be smaller than a value that is smaller by a reference ratio with respect to the first sensed value. For example, the second sensed value (670-2) may be larger than a value that is larger by a reference ratio with respect to the first sensed value (630). For example, the second sensed value (670-1) and the second sensed value (670-2) that are outside a reference range (640) with respect to the first sensed value (630) may be described as having a relatively large difference with respect to the first sensed value (630). For example, the posture of the wearable device (101) at the time of acquiring the second sensing value (670-1) or the second sensing value (670-2) can be explained as having a relatively large difference with respect to the first posture.
[0101] For example, at least one processor (300) may execute operation 530 of FIG. 5 based on obtaining a second sensing value (670-1) or a second sensing value (670-2) that is outside a reference range (640) with respect to the first sensing value (630).
[0102] Referring back to FIG. 5, at operation 520, at least one processor (300) of the wearable device (101) may refrain from transmitting (or skip, delay, bypass, or not perform transmission) data regarding a second sensing value to an external electronic device (104). For example, the second sensing value may be a sensing value within a reference range with respect to the first sensing value.
[0103] For example, at least one processor (300) may bypass transmitting data for a second sensing value within a reference range with respect to the first sensing value to the external electronic device (104).
[0104] For example, the power consumed by a wearable device (101) in which at least one processor (300) transmits all data for a second sensing value within a reference range with respect to a first sensing value to an external electronic device (104) may be relatively high. For example, the power consumed by a wearable device (101) in which at least one processor (300) receives all data for outputting audio to which a spatial sound effect corresponding to a second posture of the wearable device (101) is applied may be relatively high.
[0105] For example, at least one processor (300) can reduce power consumed to provide a spatial sound effect by refraining from transmitting (or skipping, or delaying, or bypassing, or not transmitting) data for a second sensing value that is within a reference range with respect to the first sensing value.
[0106] For example, the power consumed by the external electronic device (104) may be relatively high when at least one processor (350) of the external electronic device (104) receives all data from the wearable device (101) for a second sensing value that is within a reference range with respect to the first sensing value. For example, the power consumed by the external electronic device (104) may be relatively high when the external electronic device (104) transmits all data for outputting audio to which a spatial sound effect corresponding to the second posture is applied to the wearable device (101).
[0107] For example, at least one processor (350) can reduce power consumed to provide a spatial sound effect by refraining from receiving (or skipping, or delaying, or bypassing, or not performing reception) data for a second sensing value that is within a reference range with respect to the first sensing value.
[0108] For example, the difference between the second sensed value within the reference range and the first sensed value may not be relatively large for the first sensed value. For example, the difference between the second posture and the first posture may not be relatively large. For example, the difference between audio with spatial sound effects corresponding to the second posture and audio with spatial sound effects corresponding to the first posture may not be relatively large.
[0109] For example, even if at least one processor (300) refrain from transmitting (or skips, or delays, or bypasses, or does not transmit) data for a second sensing value within a reference range with respect to a first sensing value to an external electronic device (104), the quality of the spatial sound effect applied to the audio can be maintained.
[0110] In operation 530, at least one processor (300) may transmit data regarding a second sensing value to an external electronic device (104). For example, the second sensing value may be a sensing value outside a reference range with respect to the first sensing value. For example, at the time when the at least one processor (300) obtains the second sensing value outside the reference range with respect to the first sensing value, the posture of the wearable device (101) may be a third posture. For example, the at least one processor (300) may transmit a signal to the external electronic device (104) for adjusting the volume of audio according to the third posture of the wearable device (101).
[0111] For example, the difference between the second sensing value outside the reference range and the first sensing value may be relatively large for the first sensing value. For example, the difference between the third posture and the first posture may be relatively large. For example, the difference between audio with spatial sound effects corresponding to the third posture and audio with spatial sound effects corresponding to the first posture may be relatively large.
[0112] For example, at least one processor (350) of the external electronic device (104) may receive a second sensing value outside the reference range with respect to the first sensing value from the wearable device (101). For example, at least one processor (350) may transmit data for applying a spatial sound effect corresponding to a third posture to audio to the wearable device (101). For example, at least one processor (300) of the wearable device (101) may use the received data to output audio to which a spatial sound effect corresponding to a third posture changed from the first posture is applied through a speaker.
[0113] For example, at least one processor (300) may need to transmit data about the acquired sensing value from the time of transmitting data about the second sensing value to the reference time after acquiring a second sensing value outside the reference range for the first sensing value to the external electronic device (104). Transmitting data about the acquired sensing value after acquiring a second sensing value outside the reference range for the first sensing value is exemplified in the description in FIG. 7.
[0114] FIG. 7 illustrates exemplary operations for adjusting a spatial sound effect upon obtaining a second sensing value that is outside a reference range with respect to a first sensing value.
[0115] Referring to FIG. 7, in operation 700, at least one processor (300) of the wearable device (101) may obtain a second sensing value outside a reference range with respect to a first sensing value through at least one sensor (320). For example, a difference between the second sensing value outside the reference range with respect to the first sensing value and the first sensing value may be relatively large. For example, the posture of the wearable device (101) at the time when the at least one processor (300) obtains the second sensing value outside the reference range with respect to the first sensing value may be a third posture. For example, the second sensing value outside the reference range with respect to the first sensing value may be a sensing value obtained as the posture of the wearable device (101) changes from the first posture to the third posture. For example, a difference between the third posture of the wearable device (101) and the wearable device (101) may be relatively large. For example, the posture of the wearable device (101) can be changed according to the rotation of the user's head.
[0116] In operation 710, at least one processor (300) of the wearable device (101) may transmit data on the acquired second sensing value to an external electronic device (104) via a communication circuit (330). For example, at least one processor (300) may transmit data on the acquired second sensing value to the external electronic device (104) on a first channel.
[0117] For example, at least one processor (350) of the external electronic device (104) can receive data on the second sensing value from the wearable device (101) via the communication circuit (370). For example, at least one processor (350) can receive data on the second sensing value from the wearable device (101) on the first channel.
[0118] For example, at least one processor (350) of the external electronic device (104) may obtain data for outputting audio to which a spatial sound effect is applied according to the second sensing value, using data regarding the received second sensing value. For example, the data for outputting audio to which a spatial sound effect is applied according to the second sensing value may be data for outputting audio to which a spatial sound effect corresponding to a third posture of the wearable device (101) is applied.
[0119] In operation 720, at least one processor (350) of the external electronic device (104) may transmit data for outputting audio to which a spatial sound effect is applied according to the second sensing value to the wearable device (101) through the communication circuit (370). For example, at least one processor (350) may transmit data for outputting audio to which a spatial sound effect corresponding to a third posture of the wearable device (101) is applied to the wearable device (101) through the communication circuit (370).
[0120] For example, at least one processor (350) may transmit data for outputting audio to which a spatial sound effect is applied according to the second sensing value to the wearable device (101) on a second channel different from the first channel.
[0121] For example, at least one processor (300) of the wearable device (101) may receive data for outputting audio to which a spatial sound effect is applied according to the second sensing value from an external electronic device (104) through a communication circuit (330). For example, at least one processor (300) may receive data for outputting audio to which a spatial sound effect corresponding to a third posture of the wearable device (101) is applied from an external electronic device (104) through a communication circuit (330).
[0122] For example, at least one processor (300) may receive data for outputting audio with spatial sound effects applied according to the second sensing value from an external electronic device (104) on a second channel different from the first channel.
[0123] For example, at least one processor (300) can output audio with spatial sound effects applied using the received data.
[0124] In operation 730, at least one processor (300) of the wearable device (101) may set a reference time from a time point at which data for a second sensing value outside a reference range with respect to a first sensing value is transmitted to an external electronic device (104). For example, at least one processor (300) may obtain third sensing values before the reference time elapses from the time point.
[0125] Obtaining the third sensing values before the reference time elapses is exemplified in the description of Fig. 9.
[0126] Figure 9 illustrates a chart representing the second sensing value and the third sensing value before the reference time elapses, and the fourth sensing value after the reference time elapses.
[0127] Referring to FIG. 9, charts (900) and (970) represent changes in the magnitude of sensing values over time. The vertical axis (610) in charts (900) and (970) represents the magnitude of sensing values, and the horizontal axis (620) in charts (900) and (970) represents time.
[0128] For example, the sensing values can be expressed as arrows in the chart (900) and chart (970).
[0129] For example, at least one processor (300) of the wearable device (101) may obtain a second sensing value (670) outside a reference range with respect to the first sensing value. For example, the reference range (910) may be set based on the second sensing value (670). For example, the reference range (910) may be a range from a value that is smaller by a reference ratio with respect to the second sensing value (670) to a value that is larger by the reference ratio with respect to the second sensing value (670). For example, the reference ratio may be a predetermined value. For example, the reference ratio may be set by a user.
[0130] For example, at least one processor (300) may set a reference time (920) from the point in time (915) after acquiring the second sensing value (670). For example, at least one processor (300) may obtain third sensing values (930) before the reference time (920) elapses from the point in time (915) after acquiring the second sensing value (670).
[0131] For example, some of the third sensing values (930) may be within the reference range (910) with respect to the second sensing value (670). For example, some of the third sensing values (930) may be greater than a value that is less than a reference ratio with respect to the second sensing value (670) and less than a value that is greater than a reference ratio with respect to the second sensing value (670).
[0132] For example, some of the third sensing values (930) may be outside the reference range (910) with respect to the second sensing value (670). For example, some of the third sensing values (930) may be smaller than a value that is smaller by a reference ratio value with respect to the second sensing value (670). For example, some of the third sensing values (930) may be larger than a value that is larger by a reference ratio value with respect to the second sensing value (670).
[0133] For example, all of the third sensing values (930) may be within the reference range (910) with respect to the second sensing value (670). For example, all of the third sensing values (930) may be greater than a value that is less than a reference ratio with respect to the second sensing value (670), and less than a value that is greater than a reference ratio with respect to the second sensing value (670).
[0134] For example, all of the third sensing values (930) may be outside the reference range (910) with respect to the second sensing value (670). For example, all of the third sensing values (930) may be less than a value that is less than a reference ratio value with respect to the second sensing value (670). For example, all of the third sensing values (930) may be greater than a value that is greater than a reference ratio value with respect to the second sensing value (670).
[0135] Referring again to FIG. 7, at operation 740, at least one processor (300) of the wearable device (101) may transmit data regarding the third sensing values to an external electronic device (104).
[0136] For example, at least one processor (350) of the external electronic device (104) can receive data on third sensing values from the wearable device (101).
[0137] For example, when at least one processor (300) of the wearable device (101) acquires a second sensing value outside the reference range with respect to the first sensing value, the posture of the wearable device (101) may be changed from the first posture to a third posture. For example, the difference between the third posture of the wearable device (101) and the first posture of the wearable device (101) may be relatively large. For example, as the difference between the changed postures of the wearable device (101) is relatively large, the posture of the wearable device (101) may be continuously changed until a reference time elapses from the time when the posture of the wearable device (101) is changed. For example, since the difference between the changed postures of the wearable device (101) is relatively large, there may be continuous head rotation of the user wearing the wearable device (101) until a reference time elapses from the time when the posture of the wearable device (101) changes.
[0138] For example, at least one processor (300) needs to output audio to which a spatial sound effect is applied according to third sensing values acquired before a reference time elapses from the time point when the posture of the wearable device (101) changes from the first posture to the third posture. For example, at least one processor (300) needs to output audio to which a spatial sound effect is applied corresponding to postures of the wearable device (101) before a reference time elapses from the time point when the posture of the wearable device (101) changes from the first posture to the third posture.
[0139] For example, at least one processor (300) of the wearable device (101) can transmit data about the third sensing values to the external electronic device (104) independently of whether the third sensing values are outside a reference range with respect to the second sensing values. For example, at least one processor (300) can transmit data about the third sensing values to the external electronic device (104) on the first channel.
[0140] For example, at least one processor (350) of the external electronic device (104) can receive data about the third sensing values from the wearable device (101) independently of whether the third sensing values are outside a reference range with respect to the second sensing values. For example, at least one processor (350) can receive data about the third sensing values from the wearable device (101) on the first channel.
[0141] In operation 750, at least one processor (350) of the external electronic device (104) may transmit data for outputting audio to which a spatial sound effect is applied according to third sensing values to the wearable device (101). For example, the at least one processor (350) may transmit data for outputting audio to which a spatial sound effect is applied according to the third sensing values to the wearable device (104) on a second channel different from the first channel.
[0142] For example, at least one processor (300) may receive data for outputting audio to which a spatial sound effect is applied according to third sensing values from an external electronic device (104). For example, at least one processor (300) may receive data for outputting audio to which a spatial sound effect is applied according to third sensing values from an external electronic device (104) on a second channel different from the first channel.
[0143] For example, at least one processor (300) can output audio with spatial sound effects applied using the received data.
[0144] In operation 760, at least one processor (300) can obtain a fourth sensing value after a reference time has elapsed from the above point in time.
[0145] Whether or not data for the fourth sensing value is transmitted to an external electronic device is exemplified within the description of FIG. 8.
[0146] Figure 8 illustrates exemplary operations depending on whether the fourth sensing value is within a reference range with respect to the third sensing value most recently acquired before the reference time elapses.
[0147] Referring to FIG. 8, in operation 800, at least one processor (300) of the wearable device (101) can obtain a fourth sensing value after a reference time has elapsed from the above point in time.
[0148] In operation 810, at least one processor (300) can identify whether the fourth sensing value is within a reference range with respect to the third sensing value most recently acquired before the reference time elapses from the point in time. For example, the third sensing value most recently acquired before the reference time elapses from the point in time may be the fifth sensing value. For example, the posture of the wearable device (101) at the time when the at least one processor (300) acquires the fifth sensing value may be the fourth posture.
[0149] For example, the reference range may be a certain percentage range for the fifth sensed value. For example, the difference between the fifth sensed value and the fourth sensed value that is within the reference range for the fifth sensed value may not be relatively large. For example, the difference between the fifth sensed value and the fourth sensed value that is outside the reference range for the fifth sensed value may be relatively large.
[0150] For example, at least one processor (300) may determine whether to transmit data regarding the fourth sensing value to the external electronic device (104) based on whether the fourth sensing value is within a reference range relative to the fifth sensing value. Whether the fourth sensing value is within a reference range relative to the fifth sensing value is exemplified in the description of FIG. 9.
[0151] Referring back to FIG. 9, in the chart (900), at least one processor (300) of the wearable device (101) may acquire a fifth sensing value (940) before a reference time (920) elapses from the point in time (915). For example, the fifth sensing value (940) may be the most recently acquired sensing value among the third sensing values (930). For example, a reference range (950) may be set based on the fifth sensing value (940). For example, the reference range (950) may be a range from a value that is smaller by a reference ratio with respect to the fifth sensing value (940) to a value that is larger by a reference ratio with respect to the fifth sensing value (940).
[0152] For example, at least one processor (300) may acquire a fourth sensing value (960) within a reference range (950) for the fifth sensing value (940) after acquiring the fifth sensing value (940). For example, the posture of the wearable device (101) at the time when at least one processor (300) acquires the fourth sensing value (960) within a reference range (950) for the fifth sensing value (940) may be the fifth posture.
[0153] For example, the fourth sensing value (960) may be greater than a value that is smaller than the fifth sensing value (940) by a reference ratio, and may be less than a value that is larger than the fifth sensing value (940) by a reference ratio. For example, the difference between the fourth sensing value (960) and the fifth sensing value (940) within the reference range (950) for the fifth sensing value (940) may not be relatively large. For example, the difference between the fifth posture of the wearable device (101) and the fourth posture of the wearable device (101) may not be relatively large.
[0154] For example, at least one processor (300) may execute operation 820 of FIG. 8 based on obtaining a fourth sensing value (960) within a reference range (950) for a fifth sensing value (940).
[0155] For example, in the chart (970), at least one processor (300) of the wearable device (101) can obtain the fifth sensing value (940) before the reference time (920) elapses from the point in time (915). For example, the fifth sensing value (940) may be the most recently obtained sensing value among the third sensing values (930). For example, the reference range (950) may be set based on the fifth sensing value (940).
[0156] For example, at least one processor (300) may acquire a fourth sensing value (980-1) or a fourth sensing value (980-2) outside the reference range (950) after acquiring the fifth sensing value (940). For example, the fourth sensing value (980-1) may be smaller than a value that is smaller by a reference ratio with respect to the fifth sensing value (940). For example, the fourth sensing value (980-2) may be larger than a value that is larger by a reference ratio with respect to the fifth sensing value (940). For example, the difference between the fourth sensing value (980-1) and the fourth sensing value (980-2) that are outside the reference range (950) with respect to the fifth sensing value (940) and the fifth sensing value (940) may be relatively large. For example, the difference between the posture of the wearable device (101) at the time of acquiring the fourth sensing value (980-1) or the fourth sensing value (980-2) and the fourth posture may be relatively large.
[0157] For example, at least one processor (300) may execute operation 830 of FIG. 8 based on acquiring a fourth sensing value (980-1) or a fourth sensing value (980-2) outside the reference range (950) after acquiring a fifth sensing value (940).
[0158] Referring again to FIG. 8, at operation 820, at least one processor (300) may refrain from transmitting (or skip, delay, bypass, or not perform transmission) data for a fourth sensing value to an external electronic device (104). For example, the fourth sensing value may be a sensing value within a reference range with respect to a fifth sensing value.
[0159] For example, the power consumed by a wearable device (101) in which at least one processor (300) transmits all data for a fourth sensing value within a reference range for a fifth sensing value to an external electronic device (104) may be relatively high. For example, the power consumed by a wearable device (101) in which at least one processor (300) receives all data for outputting audio to which a spatial sound effect corresponding to a fifth posture of the wearable device (101) is applied may be relatively high.
[0160] For example, at least one processor (300) can reduce power consumed to provide a spatial sound effect by refraining from transmitting (or skipping, or delaying, or bypassing, or not transmitting) data for a fourth sensing value that is within a reference range for a fifth sensing value.
[0161] For example, at least one processor (350) of the external electronic device (104) may consume relatively more power by transmitting audio with a spatial sound effect applied to the wearable device (101) based on receiving all data from the wearable device (101) for the fourth sensing value that is within a reference range for the fifth sensing value. For example, at least one processor (350) of the external electronic device (104) may consume relatively more power by transmitting all data for outputting audio with a spatial sound effect applied corresponding to the fifth posture to the wearable device (101).
[0162] For example, at least one processor (350) can reduce power consumed to provide a spatial sound effect by refraining from receiving (or skipping, or delaying, or bypassing, or not performing reception) data for a fourth sensing value that is within a reference range with respect to a fifth sensing value.
[0163] For example, the difference between the fifth sensing value and the fourth sensing value within the reference range for the fifth sensing value may not be relatively large. For example, the difference between the fifth posture of the wearable device (101) and the fourth posture of the wearable device (101) may not be relatively large. For example, the difference between audio to which a spatial sound effect corresponding to the fifth posture of the wearable device (101) is applied and audio to which a spatial sound effect corresponding to the fourth posture of the wearable device (101) is applied may not be relatively large.
[0164] For example, even if at least one processor (300) refrains from transmitting (or skips, or delays, or bypasses, or does not transmit) data for a fourth sensing value within a reference range to an external electronic device (104) with respect to a fifth sensing value, the impact on the spatial sound effect may not be significant. For example, even if at least one processor (300) refrains from transmitting (or skips, or delays, or bypasses, or does not transmit) data for a fourth sensing value within a reference range to an external electronic device (104) with respect to a fifth sensing value, the quality of the spatial sound effect applied to the audio may be maintained.
[0165] In operation 830, at least one processor (300) may transmit data regarding a fourth sensing value to an external electronic device (104). For example, the fourth sensing value may be a sensing value outside the reference range with respect to the fifth sensing value. For example, at the time when at least one processor (300) acquires the fourth sensing value outside the reference range with respect to the fifth sensing value, the posture of the wearable device (101) may be a sixth posture.
[0166] For example, the difference between the fourth sensing value outside the reference range and the fifth sensing value for the fifth sensing value may be relatively large. For example, the difference between the sixth posture of the wearable device (101) and the fourth posture of the wearable device (101) may be relatively large. For example, the difference between the audio to which the spatial sound effect corresponding to the sixth posture of the wearable device (101) is applied and the audio to which the spatial sound effect corresponding to the fourth posture of the wearable device (101) is applied may be relatively large.
[0167] For example, at least one processor (350) of the external electronic device (104) may receive a fourth sensing value outside the reference range for the fifth sensing value from the wearable device (101). For example, at least one processor (350) may transmit data to the wearable device (101) for applying a spatial sound effect corresponding to the sixth posture of the wearable device (101) to audio. For example, at least one processor (300) of the wearable device (101) may use the received data to apply a spatial sound effect corresponding to the sixth posture of the wearable device (101) changed from the fourth posture of the wearable device (101) to audio. For example, at least one processor (300) may output audio to which the spatial sound effect is applied through a speaker.
[0168] For example, at least one processor (300) may need to maintain a channel between the wearable device (101) and the external electronic device (104). For example, at least one processor (300) may need to transmit sensing values to the external electronic device (104) to maintain the channel. Transmitting sensing values to the external electronic device (104) to maintain the channel is exemplified in the description of FIG. 10.
[0169] Figure 10 illustrates exemplary operations depending on whether the fourth sensing value is within a reference range with respect to the third sensing value most recently acquired before the reference time elapses before another reference time elapses.
[0170] Referring to FIG. 10, in operation 1000, at least one processor (300) of the wearable device (101) can obtain a fourth sensing value after a reference time has elapsed from the above point in time.
[0171] In operation 1010, at least one processor (300) can identify whether another reference time has elapsed from the point in time. For example, the other reference time from the point in time may be longer than the reference time from the point in time.
[0172] For example, at least one processor (300) can identify whether the fourth sensing value is within a reference range with respect to the fifth sensing value. For example, the third sensing value most recently acquired before the reference time elapses from the above point in time may be the fifth sensing value.
[0173] For example, at least one processor (300) may determine whether to transmit data for a sensing value acquired after another reference time has elapsed from the point in time to an external electronic device (104) based on whether a fourth sensing value within a reference range for a fifth sensing value is acquired before another reference time has elapsed from the point in time.
[0174] Whether the fourth sensing value within the reference range is obtained for the fifth sensing value before another reference time elapses from the above point in time is exemplified in the description of Fig. 11.
[0175] Figure 11 illustrates a chart representing a second sensing value, a third sensing value, and a fourth sensing value before the elapse of another reference time and a sensing value after the elapse of another reference time.
[0176] Referring to FIG. 11, charts (1100) and (1140) represent changes in the magnitude of sensing values over time. The vertical axis (610) in charts (1100) and (1140) represents the magnitude of sensing values, and the horizontal axis (620) in charts (1100) and (1140) represents time.
[0177] For example, the sensing values can be expressed as arrows in the chart (1100) and chart (1140).
[0178] For example, at least one processor (300) of the wearable device (101) may obtain a second sensing value (670) outside a reference range with respect to the first sensing value. For example, the reference range (910) may be set based on the second sensing value (670).
[0179] For example, at least one processor (300) may set a reference time (920) from the point in time (915) after acquiring the second sensing value (670). For example, at least one processor (300) may obtain third sensing values (930) before the reference time (920) elapses from the point in time (915) after acquiring the second sensing value (670).
[0180] For example, at least one processor (300) can obtain the fifth sensing value (940) before the reference time (920) elapses from the point in time (915). For example, the reference range (950) can be set based on the fifth sensing value (940).
[0181] For example, in the chart (1100), at least one processor (300) may acquire fourth sensing values (1120) within a reference range (950) with respect to the fifth sensing value (940) before another reference time (1110) elapses from the time point after acquiring the fifth sensing value (940). For example, the fourth sensing values (1120) may be greater than a value that is less than a reference ratio with respect to the fifth sensing value (940) and less than a value that is greater than the reference ratio with respect to the fifth sensing value (940). For example, the difference between the fourth sensing values (1120) within the reference range (950) with respect to the fifth sensing value (940) and the fifth sensing value (940) may not be relatively large.
[0182] For example, at least one processor (300) may acquire the fourth sensing values (1120) within the reference range (950) for the fifth sensing value (940) until another reference time (1110) elapses from the above point in time, and then acquire the sixth sensing value (1130). For example, at least one processor (300) may acquire the sixth sensing value (1130) after another reference time (1110) elapses from the above point in time.
[0183] For example, at least one processor (300) may execute operation 1020 of FIG. 11 based on acquiring fourth sensing values (1120) within a reference range (950) for a fifth sensing value (940) and acquiring a sixth sensing value (1130) after another reference time (1110) has elapsed from the point in time.
[0184] For example, in the chart (1140), at least one processor (300) may acquire a fourth sensing value (980-1) or a fourth sensing value (980-2) outside the reference range (950) before another reference time (1110) elapses from the time point after acquiring the fifth sensing value (940). For example, the fourth sensing value (980-1) may be smaller than a value that is smaller by a reference ratio with respect to the fifth sensing value (940). For example, the fourth sensing value (980-2) may be larger than a value that is larger by a reference ratio with respect to the fifth sensing value (940). For example, the difference between the fourth sensing value (980-1) and the fourth sensing value (980-2) that are outside the reference range (950) with respect to the fifth sensing value (940) and the fifth sensing value (940) may be relatively large. For example, the difference between the posture of the wearable device (101) at the time of acquiring the fourth sensing value (980-1) or the fourth sensing value (980-2) and the fourth posture of the wearable device (101) may be relatively large.
[0185] For example, at least one processor (300) may refrain from (or skip, or delay, or bypass, or not perform identification) identifying whether another reference time (1110) has elapsed from the point in time based on obtaining the fourth sensing value (980-1) or the fourth sensing value (980-2) before another reference time (1110) has elapsed from the point in time.
[0186] For example, at least one processor (300) may execute operation 1030 of FIG. 10 based on obtaining a fourth sensing value (980-1) or a fourth sensing value (980-2) outside a reference range (950) before another reference time (1110) elapses from the above point in time.
[0187] Referring back to FIG. 10, in operation 1020, at least one processor (300) of the wearable device (101) may not acquire a fourth sensing value outside a reference range for the fifth sensing value until another reference time has elapsed from the point in time. For example, the at least one processor (300) may refrain from transmitting (or skip, or delay, or bypass, or not perform transmission) data for the fourth sensing values within the reference range for the fifth sensing value to the external electronic device (104).
[0188] For example, at least one processor (300) may not receive data from the external electronic device (104) for applying a spatial sound effect corresponding to the fifth posture to the audio until another reference time has elapsed from the time point. For example, if at least one processor (300) does not acquire a fourth sensing value outside the reference range for the fifth sensing value even after another reference time has elapsed from the time point, it may be difficult to maintain a channel between the wearable device (101) and the external electronic device (104). As a non-limiting example, the channel may be released due to a sensing value not being transmitted from the wearable device (101) for a time longer than the another reference time.
[0189] For example, at least one processor (300) can obtain the sixth sensing value after another reference time has elapsed from the above point in time. For example, at least one processor (300) can transmit data for the sixth sensing value to the external electronic device (104) independently of whether the data is within a reference range for the fifth sensing value. For example, at least one processor (300) can transmit data for the sixth sensing value to the external electronic device (104) to maintain the channel. For example, at least one processor (300) can maintain a channel between the wearable device (101) and the external electronic device (104) by transmitting data for the sixth sensing value to the external electronic device (104).
[0190] For example, at least one processor (300) can obtain a seventh sensing value after transmitting data for a sixth sensing value to an external electronic device (104).
[0191] For example, the seventh sensing value may be within a reference range with respect to the sixth sensing value. For example, at least one processor (300) may transmit data about the seventh sensing value that is within a reference range with respect to the sixth sensing value to the external electronic device (104). For example, at least one processor (350) of the external electronic device (104) may receive data about the seventh sensing value that is within a reference range with respect to the sixth sensing value from the wearable device (101).
[0192] For example, at least one processor (350) of the external electronic device (104) may transmit data for outputting audio to which a spatial sound effect is applied according to the seventh sensing value to the wearable device (101). For example, at least one processor (300) of the wearable device (101) may receive data for outputting audio to which a spatial sound effect is applied according to the seventh sensing value from the external electronic device (104).
[0193] For example, at least one processor (300) can output audio with a spatial sound effect applied according to the seventh sensing value.
[0194] For example, the seventh sensing value may be outside the reference range with respect to the sixth sensing value. For example, at least one processor (300) may refrain from transmitting (or skip, or delay, or bypass, or not perform identification) data for the seventh sensing value that is outside the reference range with respect to the sixth sensing value to the external electronic device (104).
[0195] In operation 1030, at least one processor (300) may acquire a fourth sensing value outside the reference range for the fifth sensing value before another reference time elapses from the above point in time. For example, at least one processor (300) may transmit data regarding the fourth sensing value outside the reference range for the fifth sensing value to an external electronic device (104).
[0196] For example, at least one processor (350) of the external electronic device (104) may receive a fourth sensing value outside the reference range for the fifth sensing value from the wearable device (101). For example, at least one processor (350) may transmit data to the wearable device (101) for applying a spatial sound effect corresponding to the sixth posture to audio.
[0197] For example, at least one processor (300) of the wearable device (101) may use the received data to output audio to which a spatial sound effect corresponding to a sixth posture changed from the fourth posture is applied.
[0198] For example, if at least one processor (300) obtains a fourth sensing value outside the reference range for the fifth sensing value before another reference time elapses from the time point, the channel between the wearable device (101) and the external electronic device (104) can be maintained. For example, if at least one processor (300) obtains a fourth sensing value outside the reference range for the fifth sensing value before another reference time elapses from the time point, the channel between the wearable device (101) and the external electronic device (104) can be maintained.
[0199] FIG. 12 is a block diagram of an electronic device within a network environment according to various embodiments.
[0200] FIG. 12 is a block diagram of an electronic device (1201) within a network environment (1200) according to various embodiments. Referring to FIG. 12 , in the network environment (1200), the electronic device (1201) may communicate with the electronic device (1202) via a first network (1298) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1204) or the server (1208) via a second network (1299) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1201) may communicate with the electronic device (1204) via the server (1208). According to one embodiment, the electronic device (1201) may include a processor (1220), a memory (1230), an input module (1250), an audio output module (1255), a display module (1260), an audio module (1270), a sensor module (1276), an interface (1277), a connection terminal (1278), a haptic module (1279), a camera module (1280), a power management module (1288), a battery (1289), a communication module (1290), a subscriber identification module (1296), or an antenna module (1297). In some embodiments, the electronic device (1201) may omit at least one of these components (e.g., the connection terminal (1278)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1276), camera module (1280), or antenna module (1297)) may be integrated into a single component (e.g., display module (1260)).
[0201] The processor (1220) may control at least one other component (e.g., hardware or software component) of the electronic device (1201) connected to the processor (1220) by executing, for example, software (e.g., program (1240)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1220) may store commands or data received from other components (e.g., sensor module (1276) or communication module (1290)) in volatile memory (1232), process the commands or data stored in volatile memory (1232), and store result data in non-volatile memory (1234). According to one embodiment, the processor (1220) may include a main processor (1221) (e.g., a central processing unit or an application processor) or an auxiliary processor (1223) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1221). For example, when the electronic device (1201) includes the main processor (1221) and the auxiliary processor (1223), the auxiliary processor (1223) may be configured to use less power than the main processor (1221) or to be specialized for a given function. The auxiliary processor (1223) may be implemented separately from the main processor (1221) or as a part thereof.
[0202] The auxiliary processor (1223) may control at least a portion of functions or states associated with at least one component (e.g., a display module (1260), a sensor module (1276), or a communication module (1290)) of the electronic device (1201), for example, on behalf of the main processor (1221) while the main processor (1221) is in an inactive (e.g., sleep) state, or together with the main processor (1221) while the main processor (1221) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1223) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1280) or a communication module (1290)). In one embodiment, the auxiliary processor (1223) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1201) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1208)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0203] The memory (1230) can store various data used by at least one component (e.g., the processor (1220) or the sensor module (1276)) of the electronic device (1201). The data can include, for example, software (e.g., the program (1240)) and input data or output data for commands related thereto. The memory (1230) can include a volatile memory (1232) or a non-volatile memory (1234).
[0204] The program (1240) may be stored as software in memory (1230) and may include, for example, an operating system (1242), middleware (1244), or an application (1246).
[0205] The input module (1250) can receive commands or data to be used in a component of the electronic device (1201) (e.g., a processor (1220)) from an external source (e.g., a user) of the electronic device (1201). The input module (1250) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0206] The audio output module (1255) can output audio signals to the outside of the electronic device (1201). The audio output module (1255) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0207] The display module (1260) can visually provide information to an external party (e.g., a user) of the electronic device (1201). The display module (1260) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (1260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0208] The audio module (1270) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1270) can acquire sound through the input module (1250), output sound through the sound output module (1255), or an external electronic device (e.g., electronic device (1202)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1201).
[0209] The sensor module (1276) can detect the operating status (e.g., power or temperature) of the electronic device (1201) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1276) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0210] The interface (1277) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1201) with an external electronic device (e.g., the electronic device (1202)). In one embodiment, the interface (1277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0211] The connection terminal (1278) may include a connector through which the electronic device (1201) may be physically connected to an external electronic device (e.g., the electronic device (1202)). In one embodiment, the connection terminal (1278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0212] The haptic module (1279) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1279) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0213] The camera module (1280) can capture still images and videos. According to one embodiment, the camera module (1280) may include one or more lenses, image sensors, image signal processors, or flashes.
[0214] The power management module (1288) can manage the power supplied to the electronic device (1201). According to one embodiment, the power management module (1288) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0215] A battery (1289) may power at least one component of the electronic device (1201). In one embodiment, the battery (1289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0216] The communication module (1290) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1201) and an external electronic device (e.g., electronic device (1202), electronic device (1204), or server (1208)), and the performance of communication through the established communication channel. The communication module (1290) may operate independently from the processor (1220) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1290) may include a wireless communication module (1292) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1294) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1204) via a first network (1298) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1299) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1292) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1296) to verify or authenticate the electronic device (1201) within a communication network such as the first network (1298) or the second network (1299).
[0217] The wireless communication module (1292) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1292) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1292) can support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1292) can support various requirements specified in the electronic device (1201), an external electronic device (e.g., the electronic device (1204)), or a network system (e.g., the second network (1299)). According to one embodiment, the wireless communication module (1292) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0218] The antenna module (1297) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1297) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1298) or the second network (1299), may be selected from the plurality of antennas by, for example, the communication module (1290). A signal or power may be transmitted or received between the communication module (1290) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1297).
[0219] According to various embodiments, the antenna module (1297) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0220] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0221] According to one embodiment, commands or data may be transmitted or received between the electronic device (1201) and an external electronic device (1204) via a server (1208) connected to a second network (1299). Each of the external electronic devices (1202 or 1204) may be the same or a different type of device as the electronic device (1201). According to one embodiment, all or part of the operations executed in the electronic device (1201) may be executed in one or more of the external electronic devices (1202, 1204, or 1208). For example, when the electronic device (1201) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1201) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1201). The electronic device (1201) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1201) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1204) may include an Internet of Things (IoT) device. The server (1208) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1204) or server (1208) may be included within the second network (1299). The electronic device (1201) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.
[0222] Figure 13 is a block diagram of an audio module according to various embodiments.
[0223] FIG. 13 is a block diagram (1300) of an audio module (1270) according to various embodiments. Referring to FIG. 13, the audio module (1270) may include, for example, an audio input interface (1310), an audio input mixer (1320), an analog to digital converter (ADC) (1330), an audio signal processor (1340), a digital to analog converter (DAC) (1350), an audio output mixer (1360), or an audio output interface (1370).
[0224] The audio input interface (1310) can receive an audio signal corresponding to a sound acquired from the outside of the electronic device (1201) as part of the input device (1250) or through a microphone (e.g., a dynamic microphone, a condenser microphone, or a piezo microphone) configured separately from the electronic device (1201). For example, when acquiring an audio signal from an external electronic device (1202) (e.g., a headset or a microphone), the audio input interface (1310) can receive the audio signal by being connected to the external electronic device (1202) by wire through a connection terminal (1278) or wirelessly (e.g., Bluetooth communication) through a wireless communication module (1292). According to one embodiment, the audio input interface (1310) can receive a control signal (e.g., a volume control signal using an input button) related to the audio signal acquired from the external electronic device (1202). The audio input interface (1310) includes a plurality of audio input channels and can receive different audio signals for each audio input channel. In one embodiment, additionally or alternatively, the audio input interface (1310) can receive audio signals from other components of the electronic device (1201), such as the processor (1220) or the memory (1230).
[0225] The audio input mixer (1320) can synthesize a plurality of input audio signals into at least one audio signal. According to one embodiment, the audio input mixer (1320) can synthesize a plurality of analog audio signals input through the audio input interface (1310) into at least one analog audio signal.
[0226] The ADC (1330) can convert an analog audio signal into a digital audio signal. According to one embodiment, the ADC (1330) can convert an analog audio signal received through the audio input interface (1310) or, additionally or alternatively, an analog audio signal synthesized through the audio input mixer (1320) into a digital audio signal.
[0227] The audio signal processor (1340) may perform various processing on a digital audio signal input through the ADC (1330) or a digital audio signal received from another component of the electronic device (1201). For example, the audio signal processor (1340) may change a sampling rate, apply one or more filters, interpolate, amplify or attenuate (e.g., amplify or attenuate a portion of a frequency band or the entire frequency band), noise process (e.g., noise or echo reduction), change a channel (e.g., switch between mono and stereo), mix, or extract a specified signal on one or more digital audio signals. According to one embodiment, at least some functions of the audio signal processor (1340) may be implemented in the form of an equalizer.
[0228] The DAC (1350) can convert a digital audio signal into an analog audio signal. According to one embodiment, the DAC (1350) can convert a digital audio signal processed by the audio signal processor (1340) or a digital audio signal obtained from another component of the electronic device (1201) into an analog audio signal.
[0229] The audio output mixer (1360) can synthesize a plurality of audio signals to be output into at least one audio signal. According to one embodiment, the audio output mixer (1360) can synthesize an audio signal converted into analog through the DAC (1350) and another analog audio signal (e.g., an analog audio signal received through the audio input interface (1310)) into at least one analog audio signal.
[0230] The audio output interface (1370) can output an analog audio signal converted by the DAC (1350), or additionally or alternatively, an analog audio signal synthesized by the audio output mixer (1360) to the outside of the electronic device (1201) through an audio output device (1255) (e.g., a speaker (e.g., a dynamic driver or a balanced armature driver), or a receiver). According to one embodiment, the audio output device (1255) includes a plurality of speakers, and the audio output interface (1370) can output an audio signal having a plurality of different channels (e.g., stereo, or 5.1 channels) through at least some of the speakers. According to one embodiment, the audio output interface (1370) can be connected to an external electronic device (1202) (e.g., an external speaker or a headset) by wire through a connection terminal (1278), or wirelessly through a wireless communication module (1292) to output an audio signal.
[0231] According to one embodiment, the audio module (1270) may generate at least one digital audio signal by synthesizing a plurality of digital audio signals as at least a part of the function of the audio signal processor (1340) without separately having an audio input mixer (1320) or an audio output mixer (1360).
[0232] According to one embodiment, the audio module (1270) may include an audio amplifier (not shown) (e.g., a speaker amplifier circuit) capable of amplifying an analog audio signal input through the audio input interface (1310) or an audio signal to be output through the audio output interface (1370). According to one embodiment, the audio amplifier may be configured as a separate module from the audio module (1270).
[0233] For example, the wearable device outputs audio through the speaker using data received from an external electronic device through the communication circuit, and while the audio is output through the speaker using the data, acquires a first sensing value through the at least one sensor, transmits data about the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a first posture of the wearable device to the audio, acquires a second sensing value through the at least one sensor after transmitting the data about the first sensing value, and transmits data about the second sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a second posture of the wearable device changed from the first posture of the wearable device to the audio based on the second sensing value being outside a reference range with respect to the first sensing value, and transmits the data about the second sensing value to the external electronic device through the communication circuit based on the second sensing value being within the reference range with respect to the first sensing value. Measures may be required to avoid transmitting to the above external electronic devices.
[0234] As described above, the wearable device may include a memory that stores instructions and includes one or more storage media. The wearable device may include at least one sensor configured to obtain sensing values according to a change in a posture of the wearable device. The wearable device may include a speaker. The wearable device may include a communication circuit. The wearable device may include at least one processor including a processing circuit. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to output audio through the speaker using data received from an external electronic device through the communication circuit. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to obtain a first sensing value through the at least one sensor while the audio is output through the speaker using the data. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data about the first sensing value to the external electronic device via the communication circuit to apply a spatial sound effect corresponding to the first posture of the wearable device to the audio. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to obtain a second sensing value via the at least one sensor after transmitting the data about the first sensing value.The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data about the second sensed value to the external electronic device via the communication circuitry to apply a spatial sound effect to the audio corresponding to a second posture of the wearable device changed from the first posture of the wearable device based on the second sensed value being outside a reference range with respect to the first sensed value. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to refrain from transmitting data about the second sensed value to the external electronic device via the communication circuitry based on the second sensed value being within the reference range with respect to the first sensed value.
[0235] For example, the instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to identify whether a reference time has elapsed from a time point at which the second sensed value was transmitted based on transmitting the data for the second sensed value while the audio is output through the speaker using the data. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data for each of the third sensed values acquired through the at least one sensor until the reference time has elapsed from the time point to the external electronic device via the communication circuitry to apply a spatial sound effect corresponding to a third posture of the wearable device to the audio, independently of whether the third sensed values are outside the reference range with respect to the second sensed value. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to identify whether a fourth sensing value acquired through the at least one sensor after the reference time has elapsed from the point in time is outside the reference range with respect to a sensing value most recently transmitted to the external electronic device through the communication circuit among the third sensing values, based on identifying that the reference time has elapsed from the point in time.The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data for the fourth sensing value to the external electronic device via the communication circuitry to apply a spatial sound effect corresponding to a fourth posture of the wearable device to the audio based on the fourth sensing value that is outside the reference range with respect to the sensing value most recently transmitted to the external electronic device via the communication circuitry among the third sensing values. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to refrain from transmitting the data for the fourth sensing value to the external electronic device via the communication circuitry based on the fourth sensing value that is within the reference range with respect to the sensing value most recently transmitted to the external electronic device via the communication circuitry among the third sensing values.
[0236] For example, the instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to obtain a fifth sensing value via the at least one sensor before obtaining the first sensing value while the audio is output through the speaker using the data. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data about the fifth sensing value to the external electronic device via the communication circuit to apply a spatial sound effect corresponding to a fifth posture of the wearable device to the audio. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to obtain the first sensing value via the at least one sensor. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit the data for the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect to the audio corresponding to the first posture of the wearable device changed from the fifth posture of the wearable device. The first sensing value may be a sensing value most recently acquired through the at least one sensor before the reference time elapses from the time the fifth sensing value is transmitted.
[0237] For example, the instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to identify, based on transmitting the data for the second sensed value, whether a reference time has elapsed from a time point at which the data for the second sensed value was transmitted. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit, to the external electronic device via the communication circuit, data for each of the third sensed values acquired through the at least one sensor from the time point until the reference time has elapsed, independently of whether the third sensed values are outside the reference range with respect to the second sensed value. The instructions may include instructions that cause the wearable device to identify whether a fifth sensing value that is outside the reference range is acquired through the at least one sensor with respect to a fourth sensing value that was most recently transmitted to the external electronic device through the communication circuit before another reference time longer than the reference time has elapsed from the point in time, based on identifying that the reference time has elapsed from the point in time when the instructions are individually or collectively executed by the at least one processor.The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data about the sensed value acquired through the at least one sensor to the external electronic device through the communication circuit after the other reference time has elapsed, in response to identifying that the fifth sensed value is not acquired until the other reference time has elapsed from the point in time, thereby maintaining a channel between the wearable device and the external electronic device used to transmit data about the sensed value acquired through the at least one sensor.
[0238] For example, the instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to identify whether the second sensed value is outside the reference range with respect to the first sensed value.
[0239] For example, the instructions, when individually or collectively executed by the at least one processor, may include instructions that cause the wearable device to identify whether the second sensing value is outside the reference range relative to the first sensing value to reduce power consumed for a spatial sound effect applied to the audio.
[0240] For example, the instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to transmit data for the first sensed value and data for the second sensed value to the external electronic device via the communication circuitry on a first channel. The instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to receive, through the communication circuitry, a signal transmitted from the external electronic device on a second channel different from the first channel to apply a spatial sound effect to the audio corresponding to the second posture of the wearable device changed from the first posture of the wearable device.
[0241] For example, the first channel may have a first frequency band, and the second channel may have a second frequency band that is different from the first frequency band.
[0242] For example, the instructions may include instructions that, when individually or collectively executed by the at least one processor, cause the wearable device to receive, from the external electronic device via the communication circuit, data for outputting, through the speaker, the audio to which the spatial sound effect corresponding to the second posture of the wearable device has been applied.
[0243] For example, the spatial sound effect corresponding to the first posture of the wearable device may be applied to the audio to reflect a relative positional relationship between the wearable device having the first posture and a sound source in the virtual space, and the spatial sound effect corresponding to the second posture of the wearable device may be applied to the audio to reflect a relative positional relationship between the wearable device having the second posture changed from the first posture and the sound source in the virtual space.
[0244] As described above, the method may be performed by a wearable device including at least one sensor configured to obtain sensing values according to a change in a posture of the wearable device. The method may include an operation of outputting audio through the speaker using data received from an external electronic device through the communication circuit. The method may include an operation of obtaining a first sensing value through the at least one sensor while the audio is output through the speaker using the data. The method may include an operation of transmitting data for the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to the first posture of the wearable device to the audio. The method may include an operation of obtaining a second sensing value through the at least one sensor after transmitting the data for the first sensing value. The method may include an operation of transmitting data for the second sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a second posture of the wearable device changed from the first posture of the wearable device to the audio based on the second sensing value being outside a reference range with respect to the first sensing value. The method may include an operation of refraining from transmitting the data for the second sensing value to the external electronic device through the communication circuit based on the second sensing value being within the reference range with respect to the first sensing value.
[0245] For example, the method may include an operation of identifying, based on transmitting the data for the second sensing value while the audio is output through the speaker using the data, whether a reference time has elapsed from a time point at which the second sensing value is transmitted. The method may include an operation of transmitting, to the external electronic device via the communication circuit, data for each of the third sensing values acquired through the at least one sensor until the reference time has elapsed from the time point, independently of whether the third sensing values are outside the reference range with respect to the second sensing value, to apply a spatial sound effect corresponding to a third posture of the wearable device to the audio. The method may include an operation of identifying, based on identifying, whether a fourth sensing value acquired through the at least one sensor after the reference time has elapsed from the time point is outside the reference range with respect to a sensing value most recently transmitted to the external electronic device via the communication circuit among the third sensing values. The method may include an operation of transmitting data for the fourth sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a fourth posture of the wearable device to the audio based on the fourth sensing value being outside the reference range with respect to the sensing value most recently transmitted to the external electronic device through the communication circuit among the third sensing values.The method may include an operation of refraining from transmitting the data for the fourth sensing value to the external electronic device through the communication circuit based on the fourth sensing value being within the reference range with respect to the sensing value most recently transmitted to the external electronic device through the communication circuit among the third sensing values.
[0246] For example, the method may include an operation of acquiring a fifth sensing value through the at least one sensor before acquiring the first sensing value while the audio is output through the speaker using the data. For example, the method may include an operation of transmitting data about the fifth sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a fifth posture of the wearable device to the audio. The method may include an operation of acquiring the first sensing value through the at least one sensor. The method may include an operation of transmitting the data about the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to the first posture of the wearable device changed from the fifth posture of the wearable device to the audio. The first sensing value may be a sensing value most recently acquired through the at least one sensor before the reference time elapses from the time at which the fifth sensing value is transmitted.
[0247] For example, the method may include an operation of identifying, based on transmitting the data for the second sensing value, whether a reference time has elapsed from a time point at which the data for the second sensing value was transmitted. The method may include an operation of transmitting, to the external electronic device via the communication circuit, data for each of the third sensing values acquired through the at least one sensor until the reference time has elapsed from the time point, independently of whether the third sensing values are outside the reference range with respect to the second sensing value. The method may include an operation of identifying, based on identifying, based on the elapsed time point from the time point, whether a fifth sensing value is acquired through the at least one sensor, which is outside the reference range, with respect to a fourth sensing value most recently transmitted to the external electronic device via the communication circuit before another reference time longer than the reference time has elapsed from the time point. The method may include, in response to identifying that the fifth sensing value is not acquired until the other reference time elapses from the point in time, transmitting data about the sensing value acquired through the at least one sensor to the external electronic device through the communication circuit after the other reference time elapses, maintaining a channel between the wearable device and the external electronic device used to transmit data about the sensing value acquired through the at least one sensor.
[0248] For example, the method may include an operation of identifying whether the second sensing value is outside the reference range with respect to the first sensing value.
[0249] For example, the method may include an operation of identifying whether the second sensing value is outside the reference range with respect to the first sensing value to reduce power consumed for a spatial sound effect applied to the audio.
[0250] For example, the method may include an operation of transmitting data for the first sensing value and data for the second sensing value to the external electronic device on a first channel through the communication circuit. The method may include an operation of receiving, through the communication circuit, a signal transmitted from the external electronic device on a second channel different from the first channel to apply a spatial sound effect corresponding to the second posture of the wearable device changed from the first posture of the wearable device to the audio.
[0251] For example, the first channel may have a first frequency band, and the second channel may have a second frequency band that is different from the first frequency band.
[0252] For example, the method may include an operation of receiving, from the external electronic device through the communication circuit, the data for outputting the audio to which the spatial sound effect corresponding to the second posture of the wearable device is applied through the speaker.
[0253] For example, the spatial sound effect corresponding to the first posture of the wearable device may be applied to the audio to reflect a relative positional relationship between the wearable device having the first posture and a sound source in the virtual space, and the spatial sound effect corresponding to the second posture of the wearable device may be applied to the audio to reflect a relative positional relationship between the wearable device having the second posture changed from the first posture and the sound source in the virtual space.
[0254] In a computer-readable storage medium having one or more programs stored thereon, as described above, the one or more programs may include instructions that, when executed by a wearable device including at least one sensor configured to obtain sensing values according to a change in a posture of the wearable device, cause the wearable device to output audio through the speaker using data received from an external electronic device through the communication circuit. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to obtain a first sensing value through the at least one sensor while the audio is output through the speaker using the data. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data about the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to the first posture of the wearable device to the audio. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to acquire a second sensing value through the at least one sensor after transmitting the data for the first sensing value. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data for the second sensing value to the external electronic device through the communication circuit to apply a spatial sound effect to the audio corresponding to a second posture of the wearable device changed from the first posture of the wearable device based on the second sensing value being outside a reference range with respect to the first sensing value.The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to refrain from transmitting data for the second sensing value to the external electronic device via the communication circuit based on the second sensing value being within the reference range with respect to the first sensing value.
[0255] For example, the one or more programs may include instructions that cause the wearable device, when executed by the wearable device, to identify whether a reference time has elapsed from a time point at which the second sensing value was transmitted based on transmitting the data for the second sensing value while the audio is output through the speaker using the data. The one or more programs may include instructions that cause the wearable device, when executed by the wearable device, to transmit data for each of the third sensing values acquired through the at least one sensor until the reference time has elapsed from the time point to the external electronic device via the communication circuit to apply a spatial sound effect corresponding to a third posture of the wearable device to the audio, independently of whether the third sensing values are outside the reference range with respect to the second sensing value. The one or more programs may include instructions that cause the wearable device, when executed by the wearable device, to identify whether a fourth sensing value acquired through the at least one sensor after the reference time has elapsed from the point in time is outside the reference range with respect to a sensing value most recently transmitted to the external electronic device through the communication circuit among the third sensing values, based on identifying that the reference time has elapsed from the point in time.The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data for the fourth sensing value to the external electronic device via the communication circuit to apply a spatial sound effect corresponding to a fourth posture of the wearable device to the audio based on the fourth sensing value that is outside the reference range with respect to the sensing value most recently transmitted to the external electronic device via the communication circuit among the third sensing values. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to refrain from transmitting the data for the fourth sensing value to the external electronic device via the communication circuit based on the fourth sensing value that is within the reference range with respect to the sensing value most recently transmitted to the external electronic device via the communication circuit among the third sensing values.
[0256] For example, the one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to obtain a fifth sensing value through the at least one sensor before obtaining the first sensing value while the audio is output through the speaker using the data. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data for the fifth sensing value to the external electronic device through the communication circuit to apply a spatial sound effect corresponding to a fifth posture of the wearable device to the audio. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to obtain the first sensing value through the at least one sensor. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit the data for the first sensing value to the external electronic device through the communication circuit to apply a spatial sound effect to the audio corresponding to the first posture of the wearable device changed from the fifth posture of the wearable device. The first sensing value may be a sensing value most recently acquired through the at least one sensor before the reference time elapses from the time the fifth sensing value is transmitted.
[0257] For example, the one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to identify, based on transmitting the data for the second sensed value, whether a reference time has elapsed from a time point at which the data for the second sensed value was transmitted. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit, to the external electronic device via the communication circuit, data for each of the third sensed values acquired through the at least one sensor until the reference time has elapsed from the time point, independently of whether the third sensed values are outside the reference range with respect to the second sensed value. The one or more programs may include instructions that cause the wearable device, when executed by the wearable device, to identify whether a fifth sensing value outside the reference range is acquired through the at least one sensor with respect to a fourth sensing value most recently transmitted to the external electronic device through the communication circuit before another reference time longer than the reference time has elapsed from the point in time, based on identifying that the reference time has elapsed from the point in time.The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data about the sensed value acquired through the at least one sensor to the external electronic device through the communication circuit after the other reference time has elapsed, in response to identifying that the fifth sensed value is not acquired until the other reference time has elapsed from the point in time, thereby maintaining a channel between the wearable device and the external electronic device used to transmit data about the sensed value acquired through the at least one sensor.
[0258] For example, the one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to identify whether the second sensed value is outside the reference range with respect to the first sensed value.
[0259] For example, the one or more programs, when executed by the wearable device, may include instructions that cause the wearable device to identify whether the second sensing value is outside the reference range relative to the first sensing value to reduce power consumed for a spatial sound effect applied to the audio.
[0260] For example, the one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to transmit data for the first sensed value and data for the second sensed value to the external electronic device on a first channel via the communication circuit. The one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to receive, through the communication circuit, a signal transmitted from the external electronic device on a second channel different from the first channel to apply a spatial sound effect to the audio corresponding to the second posture of the wearable device changed from the first posture of the wearable device.
[0261] For example, the first channel may have a first frequency band, and the second channel may have a second frequency band that is different from the first frequency band.
[0262] For example, the one or more programs may include instructions that, when executed by the wearable device, cause the wearable device to receive, from the external electronic device via the communication circuit, data for outputting the audio to which the spatial sound effect corresponding to the second posture of the wearable device has been applied through the speaker.
[0263] For example, the spatial sound effect corresponding to the first posture of the wearable device may be applied to the audio to reflect a relative positional relationship between the wearable device having the first posture and a sound source in the virtual space, and the spatial sound effect corresponding to the second posture of the wearable device may be applied to the audio to reflect a relative positional relationship between the wearable device having the second posture changed from the first posture and the sound source in the virtual space.
[0264] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.
[0265] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.
[0266] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.
[0267] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
[0268] Therefore, other implementations, other embodiments, and equivalents of the claims are also included in the scope of the claims described below. For example, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a commodity. The computer program product may be distributed in the form of a storage medium that can be read by a machine (e.g., compact disc read only memory (CD-ROM)) or may be available through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0269] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In a wearable device (101), A memory (310) storing instructions and including one or more storage media; At least one sensor (320) configured to obtain sensing values according to changes in the posture of the wearable device (101); Speaker (340); Communication circuit (330); and At least one processor (300) comprising a processing circuit, The above instructions, when individually or collectively executed by the at least one processor (300): Using data received from an external electronic device (104) through the communication circuit (330), audio is output through the speaker (340); and While the above audio is output through the speaker (340) using the above data: Obtaining a first sensing value (630) through at least one sensor (320); Transmitting data for the first sensing value (630) to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the first posture of the wearable device (101) to the audio; After transmitting the data for the first sensing value (630), a second sensing value is acquired through the at least one sensor (320); Based on the second sensing value that is outside the reference range for the first sensing value (630), data for the second sensing value is transmitted to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the second posture of the wearable device (101) changed from the first posture of the wearable device (101) to the audio; and Causing the wearable device (101) to refrain from transmitting the data for the second sensing value to the external electronic device (104) through the communication circuit (330) based on the second sensing value being within the reference range for the first sensing value (630). Wearable device (101).
2. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (300): While the above audio is output through the speaker (340) using the above data: Based on transmitting the data for the second sensing value, it is identified whether a reference time (920) has elapsed from the time point (915) at which the second sensing value was transmitted, From the time point (915) until the reference time (920) elapses, data for each of the third sensing values (930) acquired through the at least one sensor (320) is transmitted to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the third posture of the wearable device (101) to the audio, independently of whether the third sensing values (930) are outside the reference range with respect to the second sensing value, Based on identifying that the reference time (920) has elapsed from the point in time (915), it is identified whether the fourth sensing value acquired through the at least one sensor (320) after the reference time (920) has elapsed from the point in time (915) is outside the reference range with respect to the sensing value (940) most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930). Among the third sensing values (930), based on the fourth sensing value (940) that is outside the reference range with respect to the most recently transmitted sensing value (940) to the external electronic device (104) through the communication circuit (330), data for the fourth sensing value is transmitted to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the fourth posture of the wearable device (101) to the audio; and Further causing the wearable device (101) to refrain from transmitting the data for the fourth sensing value to the external electronic device (104) through the communication circuit (330) based on the fourth sensing value that is within the reference range with respect to the sensing value (940) most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930). Wearable device (101).
3. In claim 2, The above instructions, when individually or collectively executed by the at least one processor (300): While the above audio is output through the speaker (340) using the above data: Before obtaining the first sensing value (630), obtaining the fifth sensing value through the at least one sensor (320); and In order to apply a spatial sound effect corresponding to the fifth posture of the wearable device (101) to the audio, data for the fifth sensing value is transmitted to the external electronic device (104) through the communication circuit (330). Obtaining the first sensing value (630) through at least one sensor (320), Causing the wearable device (101) to transmit the data for the first sensing value (630) to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the first posture of the wearable device (101) changed from the fifth posture of the wearable device (101) to the audio, The above first sensing value (630) is The most recently acquired sensing value through at least one sensor (320) before the reference time (920) elapses from the time the fifth sensing value is transmitted. Wearable device (101).
4. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (300): Based on transmitting the data for the second sensing value, it is identified whether a reference time (920) has elapsed from the time point (915) at which the second sensing value was transmitted, From the time point (915) until the reference time (920) elapses, data for each of the third sensing values (930) acquired through the at least one sensor (320) is transmitted to the external electronic device (104) through the communication circuit (330), independently of whether the third sensing values (930) are outside the reference range with respect to the second sensing value. Based on identifying that the reference time (920) has elapsed from the point in time (915), identifying whether a fifth sensing value outside the reference range is acquired through the at least one sensor (320) with respect to the fourth sensing value most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930) before another reference time (1110) longer than the reference time (920) has elapsed from the point in time (915), In response to identifying that the fifth sensing value is not acquired until the other reference time (1110) has elapsed from the above point in time (915), the wearable device (101) further causes the wearable device (101) to transmit data on the sensing value acquired through the at least one sensor (320) to the external electronic device (104) through the communication circuit (330) after the other reference time (1110) has elapsed, so as to maintain a channel between the wearable device (101) and the external electronic device (104) for transmitting data on the sensing value acquired through the at least one sensor (320). Wearable device (101).
5. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (300): Causing the wearable device (101) to identify whether the second sensing value is outside the reference range with respect to the first sensing value (630). Wearable device (101).
6. In claim 5, The above instructions, when individually or collectively executed by the at least one processor (300): Causing the wearable device (101) to identify whether the second sensing value is outside the reference range with respect to the first sensing value (630) to reduce power consumption for spatial sound effects applied to the audio. Wearable device (101).
7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (300): Transmitting data for the first sensing value (630) and data for the second sensing value to the external electronic device (104) on the first channel through the communication circuit (330), Further causing the wearable device (101) to receive a signal transmitted from the external electronic device (104) on a second channel different from the first channel to apply a spatial sound effect corresponding to the second posture of the wearable device (101) changed from the first posture of the wearable device (101) to the audio through the communication circuit (330). Wearable device (101).
8. In claim 7, the first channel has a first frequency band, and The second channel has a second frequency band different from the first frequency band, Wearable device (101).
9. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (300): Causing the wearable device (101) to receive the data for outputting the audio to which the spatial sound effect corresponding to the second posture of the wearable device (101) is applied through the speaker (340) from the external electronic device (104) through the communication circuit (330). Wearable device (101).
10. In claim 9, The spatial sound effect corresponding to the first posture of the wearable device (101) is The relative positional relationship between the wearable device (101) having the first posture and the sound source in the virtual space is applied to the audio, and The spatial sound effect corresponding to the second posture of the wearable device (101) is In order to reflect the relative positional relationship between the wearable device (101) having the second posture changed from the first posture and the sound source in the virtual space to the audio, Wearable device (101).
11. A method executed in a wearable device (101) having at least one sensor (320), a speaker (340), and a communication circuit (330) configured to obtain sensing values according to a change in the posture of the wearable device (101), An operation of outputting audio through the speaker (340) using data received from an external electronic device (104) through the communication circuit (330); and While the above audio is output through the speaker (340) using the above data: Obtaining a first sensing value (630) through at least one sensor (320); An operation of transmitting data for the first sensing value (630) to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the first posture of the wearable device (101) to the audio; An operation of acquiring a second sensing value through at least one sensor (320) after transmitting the data for the first sensing value (630); An operation of transmitting data for the second sensing value to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the second posture of the wearable device (101) changed from the first posture of the wearable device (101) to the audio based on the second sensing value that is outside the reference range for the first sensing value (630); and An operation including refraining from transmitting the data for the second sensing value to the external electronic device (104) through the communication circuit (330) based on the second sensing value being within the reference range for the first sensing value (630). method.
12. In claim 11, While the above audio is output through the speaker (340) using the above data: An operation of identifying whether a reference time (920) has elapsed from a time point (915) at which the second sensing value is transmitted based on transmitting the data for the second sensing value; An operation of transmitting data for each of the third sensing values (930) acquired through the at least one sensor (320) from the point in time (915) until the reference time (920) elapses to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the third posture of the wearable device (101) to the audio, independently of whether the third sensing values (930) are outside the reference range with respect to the second sensing value; An operation of identifying whether the fourth sensing value acquired through the at least one sensor (320) after the reference time (920) has elapsed from the point in time (915) is outside the reference range with respect to the sensing value most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930), based on identifying that the reference time (920) has elapsed from the point in time (915), An operation of transmitting data for the fourth sensing value to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the fourth posture of the wearable device (101) to the audio based on the fourth sensing value that is outside the reference range with respect to the sensing value most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930); and Further comprising an action of refraining from transmitting the data for the fourth sensing value to the external electronic device (104) through the communication circuit (330) based on the fourth sensing value within the reference range with respect to the sensing value most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930). method.
13. In claim 12, While the above audio is output through the speaker (340) using the above data: Before obtaining the first sensing value (630), an operation of obtaining a fifth sensing value through at least one sensor (320); and An operation of transmitting data for the fifth sensing value to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the fifth posture of the wearable device (101) to the audio; An operation of obtaining the first sensing value (630) through at least one sensor (320), An operation of transmitting the data for the first sensing value (630) to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the first posture of the wearable device (101) changed from the fifth posture of the wearable device (101) to the audio, The above first sensing value (630) is The most recently acquired sensing value through at least one sensor (320) before the reference time (920) elapses from the time the fifth sensing value is transmitted. method.
14. In claim 11, An operation of identifying whether a reference time (920) has elapsed from a time point (915) at which the second sensing value is transmitted based on transmitting the data for the second sensing value; An operation of transmitting data for each of the third sensing values (930) acquired through the at least one sensor (320) from the point in time (915) until the reference time (920) elapses to the external electronic device (104) through the communication circuit (330), independently of whether the third sensing values (930) are outside the reference range with respect to the second sensing value; An operation of identifying whether a fifth sensing value outside the reference range is acquired through the at least one sensor (320) with respect to a fourth sensing value most recently transmitted to the external electronic device (104) through the communication circuit (330) among the third sensing values (930) before another reference time (1110) longer than the reference time (920) from the point in time (915) elapses based on identifying that the reference time (920) has elapsed from the point in time (915); In response to identifying that the fifth sensing value is not acquired until the other reference time (1110) has elapsed from the time point (915), the method further includes transmitting data about the sensing value acquired through the at least one sensor (320) to the external electronic device (104) through the communication circuit (330) so as to maintain a channel between the wearable device (101) and the external electronic device (104) used for transmitting data about the sensing value acquired through the at least one sensor (320) after the other reference time (1110) has elapsed. method.
15. In a non-transitory computer-readable storage medium storing one or more programs, The above one or more programs are executed by the wearable device (101) having at least one sensor (320), a speaker (340), and a communication circuit (330) configured to obtain sensing values according to a change in the posture of the wearable device (101). Using data received from an external electronic device (104) through the communication circuit (330), audio is output through the speaker (340); and While the above audio is output through the speaker (340) using the above data: Obtaining a first sensing value (630) through at least one sensor (320); Transmitting data for the first sensing value (630) to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the first posture of the wearable device (101) to the audio; After transmitting data for the first sensing value (630), a second sensing value is acquired through at least one sensor (320); Based on the second sensing value that is outside the reference range for the first sensing value (630), data for the second sensing value is transmitted to the external electronic device (104) through the communication circuit (330) to apply a spatial sound effect corresponding to the second posture of the wearable device (101) changed from the first posture of the wearable device (101) to the audio; and Including instructions that cause the wearable device (101) to refrain from transmitting the data for the second sensing value to the external electronic device (104) through the communication circuit (330) based on the second sensing value being within the reference range for the first sensing value (630). Non-transitory computer-readable storage medium.
Citation Information
Patent Citations
Sound spatialization with room effect
KR1020160034942A
Gesture interactive wearable spatial audio system
US10585486B2
Spatialized audio output based on predicted position data
US10979843B2
Mobile terminal and method for controlling same
WO2017030212A1
KR20190109019A