Wearable device comprising at least one camera and operation method thereof
The wearable device with a rotating frame and sensors automatically switches shooting modes for real-time stereoscopic image capture, addressing the challenges of intuitive recording and complex operations in wearable devices.
Patent Information
- Application Number
- PCT/KR2025/005850
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-04-29
- Filing Date
- 2025-04-30
- Publication Date
- 2026-01-15
AI Technical Summary
Existing wearable devices face challenges in enabling users to intuitively and easily start or end video recording, particularly when the user is exercising or has limited hand mobility, and require additional software for real-time stereoscopic image creation.
A wearable device with a rotating frame and sensors that allows for automatic switching between shooting modes based on rotational information, enabling real-time stereoscopic image capture without complex operations.
Enables users to create three-dimensional images and stereoscopic data efficiently and intuitively, improving user experience in various applications such as sports, travel, safety monitoring, and daily life.
Smart Images

Figure KR2025005850_15012026_PF_FP_ABST
Abstract
Description
Wearable device including at least one camera and method of operating the same
[0001] Various embodiments disclosed in this document relate to a wearable device including at least one camera, a method of operating the same, and a recording medium for performing the method. For example, the present invention relates to a wearable device including a plurality of camera modules coupled to a rotating frame, a method of operating the same, and a recording medium for performing the method.
[0002] Recently, various forms and structures of wearable devices are being developed to improve user convenience. These advancements can enhance the convenience of wearable devices for users. Accordingly, extensive research is being conducted on providing various functions using wearable devices.
[0003] For example, recently, eXtended Reality (XR) technology, which includes functions such as Augmented Reality (AR) and Virtual Reality (VR) provided by wearable devices, has been attracting attention as a disruptive innovation following the smartphone era and continues to grow. As XR technology continues to develop, many companies are releasing various forms of XR devices, such as Head Mount Displays (HMDs), glasses, and smart lenses.
[0004] These wearable devices are increasingly incorporating features to provide users with various conveniences. In particular, wearable devices equipped with cameras are being utilized to record moments from users' daily lives through video recording and storage capabilities, or to support specific purposes (e.g., sports activities, safety monitoring).
[0005] However, when controlling the start and end of video recording on these wearable devices through a user interface (button, touchscreen, etc.), there are limitations such as the small physical size of the device making it inconvenient to operate, or the difficulty of control in certain situations (e.g., when the user is exercising or has limited hands).
[0006] Additionally, in order to utilize the captured video data as a stereoscopic image, additional software or specialized equipment is required in the post-processing process, which limits the ability of users to create stereoscopic image data that can be utilized in real time.
[0007] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.
[0008] A problem to be solved in the present disclosure may be to enable a user to create a three-dimensional image through a wearable device.
[0009] A problem to be solved in the present disclosure may be to enable a user to intuitively and easily start or end video recording by changing the structural state of a wearable device.
[0010] A problem to be solved in the present disclosure may be to enable a user to generate stereoscopic image data in real time or automatically based on an image captured through a wearable device.
[0011] The problem to be solved in the present disclosure may be to increase convenience by enabling users to intuitively and efficiently capture images and create stereoscopic images using a wearable device without complex operations or additional equipment.
[0012] According to various embodiments, a wearable device includes a rotating frame having at least one camera coupled thereto, at least one sensor for identifying a position of the rotating frame, at least one processor, and a memory for storing instructions, wherein the instructions are individually or collectively executed by the at least one processor to cause the wearable device to acquire a plurality of image frames through at least one camera in a first shooting mode, acquire rotational information about rotation of the rotating frame through at least one sensor while acquiring the plurality of image frames, and perform at least one of terminating the first shooting mode or switching to a second shooting mode based on the rotational information.
[0013] According to various embodiments, a method of operating a wearable device including a rotating frame coupled with at least one camera may include: acquiring a plurality of image frames through at least one camera in a first shooting mode; acquiring rotational information regarding rotation of the rotating frame through at least one sensor configured to identify a position of the rotating frame while acquiring the plurality of image frames; and performing at least one of terminating the first shooting mode or switching to a second shooting mode based on the rotational information.
[0014] Wearable devices according to various embodiments disclosed in this document can enable a user to create a three-dimensional image through the wearable device.
[0015] The wearable device according to various embodiments disclosed in this document can enable a user to intuitively and easily start or end video recording by changing the structural state of the wearable device.
[0016] The wearable device according to various embodiments disclosed in this document can generate stereoscopic image data in real time or automatically based on an image captured by a user through the wearable device.
[0017] The wearable device according to various embodiments disclosed in this document can increase convenience by enabling the user to intuitively and efficiently capture images and create stereoscopic images using the wearable device without complex operations or additional equipment.
[0018] The wearable devices according to various embodiments disclosed in this document can improve user experience and increase the usability of the devices in various application fields such as sports, travel, safety monitoring, medical care, and daily life through simple operation methods and stereoscopic image processing functions.
[0019] In addition, various effects may be provided, either directly or indirectly, through this document.
[0020]
[0021] FIG. 1 illustrates a wearable device according to various embodiments worn on at least a portion of a user's body.
[0022] FIG. 2 is a block diagram of a wearable device according to various embodiments.
[0023] FIG. 3 is a flowchart illustrating an operation of a wearable device according to various embodiments to terminate a first shooting mode or switch to a second shooting mode.
[0024] FIG. 4 illustrates a first operation of a wearable device changing from a first state to a second state according to various embodiments.
[0025] FIG. 5 illustrates a second operation of a wearable device changing from a first state to a second state according to various embodiments.
[0026] FIG. 6 illustrates a third operation of a wearable device changing from a first state to a second state according to various embodiments.
[0027] FIG. 7 is an exploded perspective view of a right rotational portion and a right rotational frame connecting portion of a wearable device according to one embodiment.
[0028] FIG. 8 is a drawing showing a state in which the length of a rotating frame connecting portion is extended according to one embodiment.
[0029] FIG. 9 is a cross-sectional view illustrating at least one sensor arranged in a rotating member according to one embodiment.
[0030] FIG. 10 is a flowchart illustrating an operation of a wearable device generating a stereoscopic image according to various embodiments.
[0031] FIG. 11 is a flowchart illustrating an operation of a wearable device outputting a stereoscopic image acquired through an external device according to various embodiments.
[0032] FIG. 12 is a diagram illustrating how a wearable device manages shooting data according to various embodiments.
[0033] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0034] Specific structural or functional descriptions of various embodiments are merely illustrative for the purpose of explaining the various embodiments, and the various embodiments may be implemented in various forms and should not be construed as limited to the embodiments described in this specification or application.
[0035] Since various embodiments may have various modifications and take various forms, various embodiments are illustrated in the drawings and described in detail in this specification or application. However, the matters disclosed in the drawings are not intended to specify or limit the various embodiments, and should be understood to include all modifications, equivalents, and alternatives included within the spirit and technical scope of the various embodiments.
[0036] While terms such as "first" and / or "second" may be used to describe various components, these components should not be limited by these terms. These terms are only intended to distinguish one component from another; for example, without departing from the scope of the present disclosure, a first component may be referred to as a "second component," and similarly, a second component may also be referred to as a "first component."
[0037] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components in between. Conversely, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. Other expressions that describe the relationship between components, such as "between" and "directly between" or "adjacent to" and "directly adjacent to", should be interpreted similarly.
[0038] The terminology used herein is for the purpose of describing specific embodiments only and is not intended to limit the various embodiments. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, it should be understood that the terms "comprises" or "has" specify the presence of a described feature, number, step, operation, component, part, or combination thereof, but do not exclude in advance the presence or possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.
[0039] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by those of ordinary skill in the art to which this disclosure pertains. Terms defined in commonly used dictionaries should be interpreted to have a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.
[0040] Hereinafter, the present disclosure will be described in detail by describing preferred embodiments of the present disclosure with reference to the attached drawings. The same reference numerals presented in each drawing represent the same components.
[0041]
[0042] FIG. 1 illustrates a wearable device according to various embodiments worn on at least a portion of a user's body.
[0043] Hereinafter, the coordinate axes illustrated in FIGS. 1, 4, 5, 6, 7, 8, and 9 illustrate left (L), right (R), upper (U), lower (D), front (F), and rear (B) sides defined based on the user. The above coordinate axes may be understood as exemplary coordinate axes for explaining a wearable device (1) according to one embodiment of the present disclosure.
[0044] Hereinafter, the configurations of FIGS. 1, 4, 5, and 6 may be referenced by the configurations of other drawings to the extent that they are not mutually superimposed. The same terms and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.
[0045] Referring to FIG. 1, a wearable device (1) according to one embodiment of the present disclosure may include a display device (DR, DL). The display device (DR, DL) may be configured to provide visual information (e.g., images or videos) to a user. As an example, the display device (DR, DL) may be connected to the outside world via separate wiring (not shown).
[0046] According to one embodiment of the present disclosure, a display device (DR, DL) may include a right display (DR) and a left display (DL). The right display (DR) may correspond to the user's right eye, and the left display (DL) may correspond to the user's left eye. The right display (DR) may provide visual information to the user's right eye, and the left display (DL) may provide visual information to the user's left eye. The display devices (DR, DL) may be configured to provide the user with visual information associated with sounds output from a pair of ear cups (101, 102).
[0047] According to one embodiment, the display device (DR, DL) may include at least one lens unit and a window. At least one lens unit may include a first lens unit disposed on the right display (DR) and a second lens unit disposed on the left display (DL). According to one embodiment, the lens unit may be implemented to receive image light output from the display (DR, DL) and provide it to the user's pupil. In addition, the lens unit may be implemented to receive image light output from the display (DR, DL) and provide it to the user's pupil while providing light provided from the outside to the user's pupil of the wearable device (1).
[0048] According to one embodiment, a wearable device (1) may include a pair of ear cups (101, 102) configured to output sound. At least one of the pair of ear cups (101, 102) may have a built-in speaker (not shown) configured to generate sound. Auditory information may be provided to a user through the pair of ear cups (101, 102).
[0049] For convenience of explanation, a pair of ear cups (101, 102) may be described as a right ear cup (101) and a left ear cup (102) based on the user. As an example, the right ear cup (101) and the left ear cup (102) may have structures that are symmetrical left and right based on the user, and unless specifically mentioned, the description of the right ear cup (101) described below may be substantially equally applied to the left ear cup (102) to the extent that they are not arranged with each other.
[0050] According to one embodiment of the present disclosure, a wearable device (1) may include a right rotational part (201) and a left rotational part (202) coupled to a pair of ear cups (101, 102) such that at least a portion thereof is rotatable relative to the pair of ear cups. The right rotational part (201) and the left rotational part (202) may be configured to rotate relative to the ear cups (101, 102) about a left-right axis. The right rotational part (201) may be coupled to the right ear cup (101), and the left rotational part (202) may be coupled to the left ear cup (102). As an example, the right ear cup (101) and the left ear cup (102) may have structures that are symmetrical left and right with respect to the user, and unless specifically mentioned, the description of the right rotational part (201) described below may be substantially equally applied to the left rotational part (202) to the extent that they are not arranged with each other.
[0051] According to one embodiment of the present disclosure, a wearable device (1) may include a rotation frame (M) configured to rotate (see FIG. 4) and / or move with respect to a pair of ear cups (101, 102). The rotation frame (M) may be connected to the pair of ear cups (101, 102) via rotation frame connecting portions (e.g., a right rotation frame connecting portion (301) and a left rotation frame connecting portion (302)). The rotation frame (M) may include a display device (DR, DL) and a rotation frame connecting portion (301). The display device (DR, DL) may be rotated and / or moved with respect to the pair of ear cups (101, 102) to facilitate providing visual information to a user. The rotation frame (M) may include a right rotation frame connecting portion (301) and a left rotation frame connecting portion (302), which will be described below. However, the present invention is not limited thereto.
[0052] According to one embodiment of the present disclosure, a wearable device (1) may include a right rotation frame connecting portion (301) connecting the display device (DR, DL) and the right rotation unit (201). The wearable device (1) may include a left rotation frame connecting portion (302) connecting the display device (DR, DL) and the left rotation unit (202). As an example, the right rotation frame connecting portion (301) and the left rotation frame connecting portion (302) may have a structure that is symmetrical left and right with respect to the user, and unless specifically mentioned, the description of the right rotation frame connecting portion (301) described below may be substantially equally applied to the left rotation frame connecting portion (302) to the extent that they are not arranged with each other.
[0053] Referring to FIG. 1, according to one embodiment of the present disclosure, a rotation frame (M) of a wearable device (1) can be rotated relative to a pair of ear cups (101, 102) so that a display device (DR, DL) is positioned in front of the user. A state in which the display device (DR, DL) is positioned in front of the user by the rotation of the rotation frame (M) can be referred to as a first state. A state in which the display device (DR, DL) is not positioned in front of the user by the rotation of the rotation frame (M), for example, the display device (DR, DL) is positioned above the user's head, can be referred to as a second state.
[0054] According to various embodiments, and not limited to the illustrated example, the rotation frame (M) may be positioned at various locations. Accordingly, a state other than the first state in which the rotation frame (M) is positioned in front of the user may be referred to as a second state. For example, the rotation frame (M) of the wearable device (1) may be formed in a structure that is connected / detached to the mounting frame (H) of the wearable device (1). Accordingly, the wearable device (1) may include a first state in which the rotation frame (M) is directly or indirectly connected to the mounting frame (H) and positioned in front of the user, and a second state in which the rotation frame (M) is directly or indirectly separated from the mounting frame (H) and positioned at a location other than in front of the user.
[0055] Referring to FIG. 1, a wearable device (1) according to one embodiment of the present disclosure can provide visual information to a user through a display device (DR, DL) and provide auditory information to a user through a pair of ear cups (101, 102) by changing from the second state to the first state.
[0056] According to one embodiment of the present disclosure, a wearable device (1) may include a mounting frame (H) that connects a pair of ear cups (101, 102) to each other. When a user wears the wearable device (1), the mounting frame (H) may be mounted on the user's head. The mounting frame (H) may be referred to as a connecting member or a head band. Referring to FIG. 1, a right rotation frame connecting portion (301) and a left rotation frame connecting portion (not shown) may extend along the mounting frame (H), for example, the right rotation frame connecting portion (301) and the left rotation frame connecting portion (302) may extend along an outer side of the mounting frame (H).
[0057] The description of the right ear cup (101), the right rotational part (201), the right rotational frame connection part (301), and the coupling relationship therebetween described below can be substantially equally applied to the left ear cup (102), the left rotational part (202), the left rotational frame connection part (302), and the coupling relationship therebetween, to the extent that they are not mutually aligned.
[0058] Referring to FIG. 1, the wearable device (1) may include at least one sensor (400). For example, the wearable device (1) may include at least one sensor (400) disposed on a rotation frame (M). In addition, for example, the at least one sensor may be disposed on at least one of the right rotation part (201) or the left rotation part (202). However, the present invention is not limited thereto. In one example, the at least one sensor (400) may be disposed on the rotation frame (M) and an ear cup (for example, at least one of the right ear cup (101) or the left ear cup (102). In one example, the at least one sensor (400) may be disposed on a rotation frame connecting part (301, 302).
[0059] According to one embodiment, the wearable device (1) can determine the state of the rotation frame (M) through at least one sensor (400). For example, the wearable device (1) can sense, through at least one sensor (400), whether the rotation frame (M) is in a first state located at a first position adjacent to the user's eyes, or in a second state located at a second position not adjacent to the user's eyes (e.g., above the head).
[0060] According to one embodiment, the wearable device (1) can determine whether the length of the rotating frame connecting portion (301, 302) has been extended through at least one sensor (400). For example, the wearable device (1) can determine whether the rotating frame (M) has been separated from the mounting frame (H) by sensing the extent to which the length of the mounting frame connecting portion has been extended and the extent to which the length of the rotating frame connecting portion (301, 302) has been extended through at least one sensor (400).
[0061] According to various embodiments, the wearable device (1) may include at least one camera (500). For example, the wearable device (1) may include multiple cameras arranged correspondingly within the user's body. For example, at least one camera (500) may be arranged in the rotating frame (M). For example, the wearable device (1) may include a camera (or image sensor) (500) for photographing an external environment (e.g., front, side, rear).
[0062] According to one embodiment, the camera (500) may include a first right camera (501) and a first left camera (502). The first right camera (501) may correspond to the user's right eye, and the first left camera (502) may correspond to the user's left eye. According to various embodiments, the wearable device (1) may capture a stereoscopic image through the cameras (500) corresponding to both eyes of the user. For example, the first right camera (501) may capture an image corresponding to the user's right eye, and the first left camera (502) may capture an image corresponding to the user's left eye. The image captured through the cameras (500) may be converted into a stereoscopic image through post-processing. According to one embodiment, the wearable device (1) may capture an image through the first right camera (501) and the first left camera (502) in a first state in which the rotation frame (M) is positioned at a first position adjacent to the user's eyes. Hereinafter, in the first state, the operation mode for shooting through the first right camera (501) and the first left camera (502) can be expressed as the first shooting mode.
[0063] According to one embodiment, the camera (500) may include a second right camera (503) and a second left camera (504). The second right camera (503) may correspond to the user's right eye, and the second left camera (504) may correspond to the user's left eye. According to various embodiments, the wearable device (1) may capture a stereoscopic image through the cameras (500) corresponding to both eyes of the user. For example, the second right camera (503) may capture an image corresponding to the user's right eye, and the second left camera (504) may capture an image corresponding to the user's left eye. The image acquired through the cameras (500) may be converted into a stereoscopic image through post-processing. According to one embodiment, the wearable device (1) can acquire images through the second right camera (503) and the second left camera (504) in a second state in which the rotation frame (M) is located at a second position that is not adjacent to the user's eyes (e.g., above the head). Hereinafter, in the second state, the operation mode for capturing images through the second right camera (503) and the second left camera (504) may be expressed as a second capturing mode.
[0064] According to various embodiments, the wearable device (1) may omit some of the components described with reference to FIG. 1 or may further include other components. For example, the wearable device (1) may omit the display (DR, DL) and / or the camera (500).
[0065] FIG. 2 is a block diagram of a wearable device according to various embodiments.
[0066] The configuration of FIG. 2 may be referenced by configurations of other drawings to the extent that they are not mutually superimposed. The same terminology and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.
[0067] Referring to FIG. 2, the wearable device (1) may include a processor (2), a memory (3), at least one sensor (4) (hereinafter, for convenience, may be referred to as a sensor (4)), and at least one camera (5) (hereinafter, for convenience, may be referred to as a camera (5)). In addition, without being limited to the above-described example, the wearable device (1) may further include a display (e.g., the display (DR, DL) of FIG. 1) and a communication circuit (not shown) required for executing the function of the device.
[0068] The components listed above may be operatively or electrically connected to each other. The components of the wearable device (1) illustrated in Fig. 2 may be modified, deleted, or added, as an example.
[0069] According to various embodiments, the wearable device (1) may include a processor (2). In various embodiments, the processor (2) may execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of the wearable device (1) connected to the processor (2) and perform various data processing or calculations. According to various embodiments, as at least a part of data processing or calculation, the processor (2) may store commands or data received from other components (e.g., communication circuits) in volatile memory, process the commands or data stored in the volatile memory, and store result data in non-volatile memory. According to various embodiments, the processor (2) may include a main processor (e.g., a central processing unit) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor. For example, when the wearable device (1) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use lower power than the main processor or to be specialized for a given function. The auxiliary processor may be implemented separately from the main processor or as a part thereof.
[0070] The auxiliary processor may control at least a part of functions or states related to at least one component (e.g., a sensor (4), a camera (5), a display, or a communication circuit) of the components of the wearable device (1), for example, on behalf of the main processor while the main processor is in an inactive (e.g., sleep) state, or together with the main processor while the main processor is in an active (e.g., application execution) state. According to various embodiments, the auxiliary processor (e.g., a communication processor) may be implemented as part of another functionally related component (e.g., a communication circuit). According to various embodiments, the auxiliary processor (e.g., a neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, in the wearable device (1) itself on which the artificial intelligence is performed, or may be performed through a separate server.
[0071] According to various embodiments, the processor (2) may execute operations or data processing related to control and / or communication of at least one other component of the wearable device (1) using instructions stored in the memory (3). According to one embodiment, the processor (2) may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a neural processing unit (NPU), and may have multiple cores.
[0072] According to various embodiments, the wearable device (1) may include a memory (3). According to various embodiments, the memory (3) may store various data used by at least one component (e.g., processor (2)) of the wearable device (1). The data may include, for example, software (e.g., program) and input data or output data for commands related thereto. The memory (3) may include volatile memory or non-volatile memory.
[0073] According to various embodiments, the program may be stored as software in the memory (3) and may include, for example, an operating system, middleware, or an application. According to various embodiments, the memory (3) may store instructions that cause the processor (2) to process data or control components of the wearable device (1) to perform operations of the wearable device (1) when executed. The instructions may include code generated by a compiler or code that can be executed by an interpreter.
[0074] According to various embodiments, the memory (3) can store various information acquired through the processor (2). For example, the memory (3) can store at least one image frame acquired through the camera (5).
[0075] According to various embodiments, the instructions stored in the memory (3) may cause the wearable device (1) to perform the operations of FIGS. 3 to 12 when executed by at least one processor (2).
[0076] According to various embodiments, the wearable device (1) may include a sensor (4). According to one embodiment, the wearable device (1) may obtain information regarding the rotation of the rotation frame (M) using the sensor (4). For example, the wearable device (1) may obtain information regarding the rotation of at least a portion of the rotation frame (M) with respect to the ear cup and / or length information regarding the length extension of the rotation frame connecting portion (301, 302) using the sensor (4).
[0077] According to one embodiment, at least one sensor (4) may include, but is not limited to, a position sensor, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0078] According to one embodiment, the position sensor may include at least one of a Hall sensor, a tunnel magnetoresistance (TMR) sensor, an anisotropic magneto-resistance (AMR) sensor, or a giant magneto-resistance (GMR) sensor, but is not limited thereto.
[0079] A wearable device (1) can detect movement (rotation) of a magnetic body (e.g., a magnet) based on a resistance value that changes based on the relative angle of a plurality of magnetic bodies (e.g., magnets) using a tunnel magneto-resistance sensor, or can detect movement (rotation) of a magnetic body using at least one of an anisotropic magneto-resistance (AMR) sensor or a giant magneto-resistance (GMR) sensor. However, the present invention is not limited thereto.
[0080] According to one embodiment, the Hall sensor may include a sensor that converts a magnetic field into an electrical signal using the Hall effect. The Hall sensor can detect a magnetic field and measure a potential difference formed by the Hall effect. At this time, the greater the strength of the magnetic field, the greater the potential difference can be formed. For example, the strength of the magnetic field may be proportional to the potential difference caused by the Hall effect. The Hall sensor can detect the strength of the magnetic field because it measures the current caused by the Hall effect. However, the present invention is not limited thereto.
[0081] According to one embodiment, at least one sensor (4) may detect an operating state (e.g., power or temperature) of the wearable device (1) or an external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state.
[0082] According to various embodiments, the wearable device (1) may include a camera (5). For example, the wearable device (1) may include a plurality of cameras arranged correspondingly within the user's body. For example, at least one camera (5) may be arranged in the rotating frame (M). For example, the wearable device (1) may include a camera (or image sensor) (5) for photographing an external environment (e.g., front, side, rear).
[0083] According to various embodiments, the camera (5) may include components for photographing. For example, the camera (5) may include a lens assembly, an image sensor, memory, and / or an image signal processor.
[0084] According to various embodiments, the processor (2) can acquire a plurality of image frames in a first shooting mode in which the camera (5) takes pictures. In one embodiment, the processor (2) can acquire a video including a plurality of image frames through the camera (5). For example, when the state of the wearable device (1) is the first state, the processor (2) can acquire a plurality of image frames in the first shooting mode using the first right camera (501) and the first left camera (502).
[0085] According to various embodiments, the processor (2) can obtain rotation information regarding the rotation of the rotation frame (M) through the sensor (4). For example, the processor (2) can sense whether the position of the rotation frame (M) has changed through the sensor (4) and obtain rotation information based on this.
[0086] According to various embodiments, the processor (2) may terminate the first shooting mode or switch to the second shooting mode through the camera (5) based on the rotation information. For example, the processor (2) may terminate the shooting mode of the wearable device (1) based on the rotation information of the rotation frame (M). Accordingly, the processor (2) may control the camera (5) to terminate the shooting mode and store the image frames (or videos) acquired until the termination of the shooting mode in the memory (3). For example, the processor (2) may switch the shooting mode of the wearable device (1) from the first shooting mode to the second shooting mode based on the rotation information of the rotation frame (M). Accordingly, the processor (2) may store the image frames (or videos) acquired in the first shooting mode and the second shooting mode in the memory (3) by linking (connecting).
[0087] According to various embodiments, a wearable device (1) may include a display (e.g., a display (DR, DL) of FIG. 1). The display may visually provide information to an external body (e.g., a user) of the wearable device (1). According to various embodiments, the display may display various contents (e.g., text, images, videos, icons, and / or symbols). According to various embodiments, the display may include a liquid crystal display (LCD), a light emitting diode (LED) display, or an organic light emitting diode (OLED) display. According to various embodiments, the display may be configured as various displays that allow image light to be emitted to the user's pupil through a lens unit. For example, the display may include various displays such as a laser display, an LCOS display, and an LED display. The structure of the lens unit may change depending on the type of the display (DR, DL) of the wearable device (1).
[0088] According to various embodiments, the wearable device (1) may include a communication circuit. The communication circuit may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the wearable device (1) and an external device (e.g., an external device (1120) of FIG. 11 or a server (not shown)), and performing communication through the established communication channel. The communication circuit may operate independently from the processor (2) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication circuit may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device via a first network (e.g., a short-range communication network such as Bluetooth, WiFi Direct (wireless fidelity direct), or IrDA (infrared data association)) or a second network (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).
[0089] According to various embodiments, the wearable device (1) may include a speaker (e.g., ear cups (101, 102) of FIG. 1). For example, the wearable device (1) may include a pair of ear cups (101, 102) configured to output sound, in which speakers are built into them. According to one embodiment, auditory information may be provided to a user through the pair of ear cups (101, 102). According to various embodiments, the wearable device (1) may control the output mode of the speaker.
[0090] According to various embodiments, the wearable device (1) may include various devices, not limited to the components described above. For example, the wearable device (1) may include an input device implemented to obtain predetermined information from the outside of the wearable device (1). For example, the input device may include a touch sensor and a physical key for receiving a user's physical input (e.g., touch) to the wearable device (1). For example, the input device may include a microphone for obtaining external sounds (e.g., the user's speech, sounds of the surrounding environment).
[0091] According to various embodiments, the wearable device (1) may include a connection terminal (not shown). The connection terminal may include a connector through which the wearable device (1) may be physically connected to an external electronic device (e.g., an external device (1120) of FIG. 11).
[0092]
[0093] FIG. 3 is a flowchart (3000) showing an operation of a wearable device terminating a shooting mode according to various embodiments.
[0094] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, operations performed by a wearable device (1) may refer to operations performed by a processor (2) of the wearable device (1).
[0095] In addition, the “information” described below may be interpreted to mean “data” or “signal,” and “data” may be understood as a concept that includes both analog data and digital data.
[0096] According to various embodiments, the operations illustrated in FIG. 3 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 3, or at least one operation may be performed less than those illustrated in FIG.
[0097] Referring to FIG. 3, the wearable device (1) can acquire multiple image frames through at least one camera in a first shooting mode at operation 3010. For example, the wearable device (1) operates in the first shooting mode and can acquire images through a camera (5) (e.g., a first right camera (501), a first left camera (502)). The images can include various information included in the images, such as multiple image frames and sounds.
[0098] According to one embodiment, the wearable device (1) can acquire a video through the camera (5) according to the first shooting mode in a first state in which the rotating frame (M) is arranged in front of the user. For example, the wearable device (1) can acquire a video through the first right camera (501) and the first left camera (502) arranged on the rotating frame (M). In this case, the videos acquired through the first right camera (501) and the first left camera (502) can be synchronized.
[0099] According to various embodiments, the wearable device (1) may obtain rotation information regarding the rotation of the rotation frame through at least one sensor while acquiring a plurality of image frames in operation 3020. For example, the wearable device (1) may obtain information regarding the rotation of the rotation frame (M) through the sensor (4) while shooting a video through the camera (5) and / or while acquiring a plurality of image frames. For example, the wearable device (1) may obtain rotation information by sensing, through the sensor (4), that the rotation frame (M) changes from a first state located in front of the user to a second state.
[0100] According to various embodiments, the wearable device (1) may terminate the first shooting mode or switch to the second shooting mode based on the rotation information in operation 3030. For example, the wearable device (1) may obtain rotation information by sensing a change in the position of the rotation frame (M) through the sensor (4), and may terminate the first shooting mode through the camera (5) based on the rotation information. For example, the wearable device (1) may obtain rotation information by sensing a change in the position of the rotation frame (M) from a first state located in front of the user to a second state through the sensor (4), and may terminate the first shooting mode by identifying (or predicting) that the rotation frame (M) has entered the second state. For example, the wearable device (1) may obtain rotation information by sensing a change in the position of the rotation frame (M) through the sensor (4), and may switch from the first shooting mode to the second shooting mode based on the rotation information. For example, the wearable device (1) can acquire rotation information by sensing through the sensor (4) that the rotation frame (M) changes from a first state located in front of the user to a second state, and can identify (or predict) that the rotation frame (M) has entered the second state and switch to a second shooting mode in which the second right camera (503) and the second left camera (504) shoot.
[0101] According to various embodiments, and not limited to the above-described examples, the wearable device (1) can change the shooting mode by controlling the camera (5) according to a change in the state of the rotation frame (M).
[0102]
[0103] FIG. 4 illustrates a first operation of a wearable device changing from a first state to a second state according to various embodiments.
[0104] FIG. 5 illustrates a second operation of a wearable device changing from a first state to a second state according to various embodiments.
[0105] FIG. 6 illustrates a third operation of a wearable device changing from a first state to a second state according to various embodiments.
[0106] The configurations of FIGS. 4, 5, and 6 may be referenced by configurations of other drawings to the extent that they are not mutually superimposed. The same terms and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.
[0107] Any content that overlaps or is similar to that described with reference to Figure 1 may be omitted below.
[0108] According to one embodiment of the present disclosure, the right rotation frame connecting portion (301) may extend from one side of the right rotation portion (201) toward the display device (D). The right rotation frame connecting portion (301) may be connected (or coupled) to one side of the display device (D). The right rotation frame connecting portion (301) may be configured to extend in a length along a direction substantially perpendicular to the left-right axis (e.g., forward-backward or up-down direction).
[0109] According to one embodiment of the present disclosure, the left rotation frame connecting portion (302) may extend from the left rotation portion (202) toward the other side of the display device (D). The left rotation frame connecting portion (302) may be connected (or coupled) to the other side of the display device (D). The left rotation frame connecting portion (302) may be configured to extend in a length along a direction substantially perpendicular to the left-right axis (e.g., forward-backward or up-down direction).
[0110] FIG. 4 illustrates a state in which the rotation frame (M) performs a first operation, which is an operation in which the rotation frame (M) moves away from the user in a first state in which the rotation frame (M) is positioned in front of the user. According to one embodiment, the wearable device (1) can seamlessly change from the first state to the second state without being obstructed by a part of the user's body by performing the first operation, in which the rotation frame (M) moves away from the user.
[0111] The location of at least one sensor (400) illustrated in FIG. 4 is for convenience of explanation and is not limited to the examples illustrated in FIGS. 4 to 6.
[0112] According to one embodiment, the wearable device (1) can obtain information about the position of the rotation frame connection part with respect to the rotation part by using at least one sensor (400). According to one embodiment, the wearable device (1) can obtain information about the position of the right rotation frame connection part (301) with respect to the right rotation part (201) by using at least one sensor (400). For example, the wearable device (1) can obtain information about the position of the left rotation frame connection part (302) with respect to the left rotation part (202) by using at least one sensor (400). For example, the wearable device (1) can obtain information about the position of the right rotation frame connection part (301) with respect to the right rotation part (201) and information about the position of the left rotation frame connection part (302) with respect to the left rotation part (202) by using at least one sensor (400).
[0113] According to one embodiment, the wearable device (1) can obtain length information based on a change in the length of the right rotation frame connecting portion (301) using at least one sensor (400). For example, the wearable device (1) can obtain length information based on a change in the length of the left rotation frame connecting portion (302) using at least one sensor (400). For example, the wearable device (1) can obtain length information of the right rotation frame connecting portion (301) and length information of the left rotation frame connecting portion (302) using at least one sensor (400). Based on the length information, the extent to which the lengths of the right rotation frame connecting portion (301) and the left rotation frame connecting portion (302) are extended can be identified.
[0114] According to one embodiment, the length information of the pivot frame connecting portion (301, 302) may include at least one of information about the extent to which the length of the pivot frame connecting portion (301, 302) is extended, information about the length by which the pivot frame connecting portion (301, 302) moves with respect to the pivot portion (201, 202), or information about the direction in which the pivot frame connecting portion (301, 302) moves with respect to the pivot portion (201, 202).
[0115] According to various embodiments, the wearable device (1) can obtain length information regarding the extent to which the length of the rotation frame connecting portion (301, 302) is extended through at least one sensor (400). Based on the length information, the wearable device (1) can identify (predict) that the state of the wearable device (1) will change from a first state to a second state. For example, in a first state in which the rotation frame (M) of the wearable device (1) is positioned in front of the user, it can be identified that a first operation, which is an operation of moving the rotation frame (M) away from the user, has been performed. For example, it can be identified that the first operation has been performed based on the length information of the extension of the rotation frame connecting portion (301, 302).
[0116] FIG. 5 illustrates a state in which the rotation frame (M) is moved away from the user in a first state in which the rotation frame (M) is positioned in front of the user and then performs a second operation in which the rotation frame (M) rotates above the user's head. According to one embodiment, the wearable device (1) can seamlessly change from the first state to the second state without being obstructed by a part of the user's body by performing the first operation in which the rotation frame (M) moves away from the user. According to one embodiment, the wearable device (1) can perform a second operation of rotating the rotation frame (M) to change to the second state after performing the first operation. According to various embodiments, the rotation frame (M) can be rotated through the second operation and be positioned at a location other than in front of the user (e.g., above the user's head).
[0117] According to one embodiment, the wearable device (1) can obtain rotation information regarding the rotation of the rotating part by using at least one sensor (400). For example, the wearable device (1) can obtain rotation information regarding the rotation of the right rotating part (201) by using at least one sensor (400). For example, the wearable device (1) can obtain rotation information regarding the rotation of the left rotating part (202) by using at least one sensor (400). For example, the wearable device (1) can obtain information regarding the rotation of at least a part of the rotating frame (M) for the ear cup by using at least one sensor (400).
[0118] According to one embodiment, the rotation information may obtain at least one of information about a rotation angle of at least a part of the wearable device (1) or information about a rotation direction. For example, the wearable device (1) may obtain at least one of information about a rotation angle of the rotating part (201, 202) or information about a rotation direction of the rotating part (201, 202) using the at least one sensor (400). For example, the wearable device (1) may obtain at least one of information about a rotation angle of the rotating part (201, 202) with respect to the ear cup (101, 102) or information about a rotation direction of the rotating part (201, 202) with respect to the ear cup (101, 102) using the at least one sensor (400).
[0119] According to various embodiments, the wearable device (1) can obtain rotation information including at least one of an angle or direction in which the rotational unit (201, 202) is rotated through at least one sensor (400). The wearable device (1) can identify (predict) that the state of the wearable device (1) will change from a first state to a second state based on the rotation information. For example, in a first state in which the rotational frame (M) of the wearable device (1) is positioned in front of the user, it can be identified that a second operation, in which the rotational frame (M) is rotated to move to a location other than the front of the user (e.g., the head), has been performed. For example, based on the rotation information, which is information about the rotational direction and rotational angle of the rotational unit (201, 202) with respect to the ear cup (101, 102), it can be identified that the rotational unit (201, 202) is rotated, and based on this, it can be identified that the second operation has been performed.
[0120] According to various embodiments, the wearable device (1) can switch from the first shooting mode to the second shooting mode based on the second operation being performed.
[0121] FIG. 6 illustrates a state in which the rotation frame (M) performs a third operation in which the rotation frame (M) moves closer to the user in a second state in which the rotation frame (M) is positioned at a location other than in front of the user. According to one embodiment, when the wearable device (1) performs the third operation from the second state, the rotation frame (M) becomes closer to the user, so that the rotation frame (M) can be fixed to the rotational portions (201, 202) and fixed in the second state. The fixation of the rotation frame (M) in the second state through the coupling of the rotational portions (201, 202) and the rotational frame connecting portions (301, 302), which are at least a part of the rotation frame (M), will be described later with reference to FIGS. 7 to 9. However, the present invention is not limited to this structure. For example, the wearable device (1) may include a structure for changing the length of the rotating frame connection portion (301, 302) and / or various structures for causing the rotating portion (201, 202) to rotate. For example, the wearable device may include one of various structures such as a rack-and-pinion structure, a Nara-lead screw structure, a cam-follower structure, a worm gear-lifting system, a slide-clamp system, a taper roller-friction drive, a chain-sprocket structure, a structure using at least one electromagnet, a belt-pulley structure, a pin-slot mechanism, etc.
[0122] According to various embodiments, the wearable device (1) can obtain length information indicating the extent to which the length of the rotation frame connecting portion (301, 302) is extended through at least one sensor (400). For example, length information regarding the extent to which the length of the rotation frame connecting portion (301, 302) is shortened can be obtained. Based on the information, the wearable device (1) can identify that the state of the wearable device (1) will change to a second state and be fixed. For example, in the second state in which the rotation frame (M) of the wearable device (1) is positioned at a location other than the front of the user (e.g., the head), it can be identified that a third operation, which is an operation of moving the rotation frame (M) to become closer to the user, has been performed. For example, based on length information indicating the extent to which the length of the rotation frame connecting portion (301, 302) has changed, it is possible to identify that the length of the rotation frame connecting portion (301, 302) has been shortened, and based on this, it is possible to identify that the third operation has been performed.
[0123] According to one embodiment, the wearable device (1) can predict the state of at least a portion of the wearable device (1) (e.g., the rotation frame (M) of FIG. 2) based on the acquired information. For example, the wearable device (1) can predict that the third operation is performed and the rotation frame (M) is fixed in the second state.
[0124] According to various embodiments, the wearable device (1) can control the operation mode of the wearable device (1) based on the prediction. For example, the wearable device (1) can execute at least one operation mode of the wearable device (1) based on the prediction. For example, the wearable device (1) can change the currently executing operation mode to another operation mode based on the prediction.
[0125] In one example, the wearable device (1) can control the operation of a component (e.g., a display device or a camera device) of the wearable device (1) based on the prediction. For example, the wearable device (1) can activate or deactivate a component of the wearable device (1) based on the prediction.
[0126] For example, the wearable device (1) can identify that any one of the first to third operations is performed while a video (including a plurality of image frames) is being acquired through the camera (5) in the first shooting mode, and can predict that the state of the wearable device (1) will change from a first state in which the rotation frame (M) is positioned in front of the user to a second state in which the rotation frame (M) is positioned at a location other than in front of the user. In one embodiment, the wearable device (1) can change the shooting mode of the camera (5) according to the prediction. For example, the wearable device (1) can terminate at least one shooting mode of the first shooting mode or the second shooting mode based on the performance of the third operation.
[0127] According to various embodiments, the wearable device (1) can identify an image (including at least one image frame) acquired through the camera (5) while the first to third operations are performed. For example, the wearable device (1) can identify a period during which the state of the rotation frame (M) changes from a first state to a second state (e.g., the first to third operations) through the sensor (4), and the wearable device (1) can identify at least one image frame acquired during the corresponding period.
[0128] According to various embodiments, the wearable device (1) may generate a video based on image frames (or videos) excluding at least one image frame (or video) acquired while the state of the rotation frame (M) changes from the first state to the second state (e.g., the first operation to the third operation) when a change occurs during shooting in the first shooting mode. That is, the wearable device (1) may store only the remaining videos (e.g., videos acquired while the state of the rotation frame (M) changes from the first state to the second state (e.g., the first operation to the third operation)) excluding the videos acquired from among the entire videos acquired through the camera (5).
[0129] According to various embodiments, the wearable device (1) may generate a video based on image frames (or videos) excluding at least one image frame (or video) acquired while the state of the rotation frame (M) changes from the first state to the second state (e.g., the first operation to the second operation) when a change occurs during shooting in the first shooting mode. That is, the wearable device (1) may store only the remaining videos (e.g., the video acquired while the state of the rotation frame (M) changes from the first state to the second state (e.g., the first operation to the second operation)) excluding the video acquired from the entire video acquired through the camera (5).
[0130] According to various embodiments, the wearable device (1) may switch from the first shooting mode to the second shooting mode after the second operation and store at least one image frame (or video) acquired based on the second shooting mode.
[0131] Accordingly, the wearable device (1) can store an image (or image frame) acquired in a state where at least one camera captures the front of the user, based on the first shooting mode in the first state, and an image acquired in the second state based on the second shooting mode.
[0132] Meanwhile, according to various embodiments, when the wearable device (1) identifies that the rotation frame connecting portion (301) extends away from the user in the second state through at least one sensor (400), the wearable device (1) can execute a second shooting mode to capture a front view through the second right camera (503) and the second left camera (504). In this case, the front view can be captured through the second right camera (503) and the second left camera (504) even without moving the rotation frame (M) to a position adjacent to the user's eyes.
[0133]
[0134] FIG. 7 is an exploded perspective view of a right rotational portion and a right rotational frame connecting portion of a wearable device according to one embodiment.
[0135] The configuration of FIG. 7 may be referenced by configurations of other drawings to the extent that they are not mutually superimposed. The same terminology and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.
[0136] Referring to FIG. 7, according to one embodiment of the present disclosure, the right rotation frame connecting portion (301) may include a plurality of sections (310, 320). For example, the right rotation frame connecting portion (301) may include a first rotation frame arm (310) and a second rotation frame arm (320). For example, the right rotation frame connecting portion (301) may include a first rotation frame arm (310) connected to the rotation portion (201). For example, the right rotation frame connecting portion (301) may include a second rotation frame arm (320) connected (or coupled) to one side of the display device (D, see FIGS. 1 to 3). The second rotation frame arm (320) of the right rotation frame connecting portion (301) may be arranged to be movable in the longitudinal direction with respect to the first rotation frame arm (310). For example, when the first rotation frame arm (310) is positioned inside the second rotation frame arm (320), the second rotation frame arm (320) can move in the longitudinal direction so that the first rotation frame arm (310) can be pulled outward. Accordingly, the length of the right rotation frame connecting portion (301) can be extended.
[0137] According to one embodiment of the present disclosure, the lengths of the right rotation frame connecting portion (301) and the left rotation frame connecting portion (302) are each extended, so that the relative positions of a pair of ear cups (101, 102) of a display device (D) connected to the right rotation frame connecting portion (301) and the left rotation frame connecting portion (302) can be adjusted.
[0138] According to various embodiments, the rotation frame connecting portion (301) is not limited to the illustrated example and may include various structures for extending in the longitudinal direction. For example, the right-axis rotation frame connecting portion (301) may include a first rotation frame arm (310), a second rotation frame arm (320) arranged to be movable along a first longitudinal direction among longitudinal directions with respect to the first rotation frame arm (310), and a third rotation frame arm (320) arranged to be movable along a second longitudinal direction opposite to the first longitudinal direction among longitudinal directions with respect to the first rotation frame arm (310).
[0139] According to one embodiment of the present disclosure, the right rotational member (201) may be accommodated within the ear cup (101). For example, it may be disposed in the accommodation space of an ear cover (110) including an accommodation space. For example, a rotational member (210) and a support member (220) may be disposed in the accommodation space of the ear cover (110).
[0140] According to one embodiment of the present disclosure, the rotating member (210) may be configured to rotate relative to the supporting member (220). For example, the rotating member (210) may be coupled to the outside of the supporting member (220), and the rotating member (210) may be configured to rotate around a groove (or protrusion) formed on the outside of the supporting member (220) and a groove (or protrusion) formed on the inside of the rotating member (210). The rotating member (210) may be rotated around a left-right axis relative to the supporting member (220). As an example, the right-side rotating portion (201) may be rotated outward in a manner in which the supporting member (220) is coupled to a hole formed in the rotating member (210), and the groove (or protrusion) on the inside of the rotating member (210) and the protrusion (or groove) on the outside of the supporting member (220) are engaged and rotated (e.g., a ball plunger structure).
[0141] According to one embodiment of the present disclosure, the right rotational part (201) may be disposed inside the right ear cup (101). Accordingly, the rotational member (210) may be rotated relative to the support member (220), so that the rotational member (210) of the right rotational part (201) may be rotated relative to the right ear cup (101). According to one embodiment, the ear cover (110) may include an opening (e.g., a hole) at least in a portion so that the right rotational frame connecting part (301) coupled with the rotational member (210) may rotate according to the rotation of the rotational member (210). For example, the rotational member (210) disposed inside the ear cover (110) may be coupled with the rotational frame connecting part (301) through the opening.
[0142] According to one embodiment of the present disclosure, the right rotation frame connecting portion (301) may extend from the display device (D, see FIGS. 2 and 3) toward the right rotation frame rotating portion (201). The right rotation frame connecting portion (301) may move relative to the right rotation portion (201) (e.g., the rotating member (210)) along a direction substantially perpendicular to the left-right axis. Referring to FIGS. 4 to 6, the left rotation frame connecting portion (302) may extend from the display device (D) toward the left rotation portion (202). The left rotation frame connecting portion (302) may move relative to the rotating member of the left connection portion (302) along a direction substantially perpendicular to the left-right axis.
[0143] According to one embodiment, the content of the above-described FIG. 7 relates to an example of the present disclosure, and at least one of the configurations of the above-described FIG. 7 may be omitted or replaced with another configuration. For example, at least one of the components arranged in the rotating part of the wearable device (1) may be omitted or replaced with at least one other component, and is not limited to the above-described configuration. At least one of the configurations of the connecting part of the wearable device (1) may be omitted or replaced with at least one other configuration, and is not limited to the above-described configuration.
[0144] FIG. 8 is a drawing for explaining a state in which the length of a rotating frame connecting part is extended according to one embodiment.
[0145] The configuration of FIG. 8 may be referenced by configurations of other drawings to the extent that they are not mutually superimposed. The same terminology and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.
[0146] Figure 8 illustrates a state in which the length of the right rotation frame connecting portion (301) is not extended (810) and a state in which the length of the right rotation frame connecting portion (301) is extended (820).
[0147] Referring to FIG. 8, according to one embodiment of the present disclosure, the first rotation frame arm (310) of the right rotation frame connecting portion (301) may be placed (coupled) inside the second rotation frame arm (320). In this case, the first rotation frame arm (310) may be placed inside the second rotation frame arm (320), so that the length of the rotation frame connecting portion may not be extended.
[0148] In one embodiment, the second rotation frame arm (320) may be arranged to be movable and then fixed relative to the first rotation frame arm (310). For example, a movable and fixable structure may be formed on the inner side of the second rotation frame arm (320) and the outer side of the first rotation frame arm (310), so that the second rotation frame arm (320) may move relative to the first rotation frame arm (310). For example, the second rotation frame arm (320) may move upward (U) or downward (D).
[0149] According to one embodiment, when the second rotation frame arm (320) moves upward (U), the first rotation frame arm (310) disposed inside the second rotation frame arm (320) and connected to the rotation part (201) may be exposed (withdrawn) to the outside. Accordingly, the length of the rotation frame connection part (301) may be extended. In one embodiment, the at least one sensor (400) may sense the distance (position) that the second rotation frame arm (320) has moved with respect to the first rotation frame arm (310). For example, at least one 1_2 sensor (402) disposed on the first rotation frame arm (310) and at least one 1_1 sensor (401) disposed on the second rotation frame arm (320) can sense a change in distance between the two sensors as a Hall sensor to sense the distance (position) moved by the second rotation frame arm (320). Accordingly, the wearable device (1) can obtain length information of the rotation frame connecting portion (301).
[0150] According to one embodiment, when the second rotation frame arm (320) moves downward (D), the first rotation frame arm (310) connected to the second rotation frame arm (320) can be introduced into the interior of the second rotation frame arm (320). Accordingly, the length of the rotation frame connection portion (301) can be shortened. In one embodiment, the at least one sensor (400) can sense the distance (position) that the second rotation frame arm (320) has moved with respect to the first rotation frame arm (310). For example, at least one 1_2 sensor (402) arranged on the first rotation frame arm (310) and at least one 1_1 sensor (401) arranged on the second rotation frame arm (320) can sense the distance (position) that the second rotation frame arm (320) has moved by sensing a change in the distance that the two sensors become closer as Hall sensors. Accordingly, the wearable device (1) can obtain length information of the rotating frame connecting portion (301).
[0151] In the above, the wearable device (1) according to one embodiment of the present disclosure has been described with reference to the right rotation part (201) and the right rotation frame connection part (301) with reference to FIG. 8, but the above description may be substantially equally applied to the left rotation part (202) and the left rotation frame connection part (302). As an example, the left rotation part (202) of the wearable device (1) according to one embodiment of the present disclosure may include components that are symmetrical to the left and right of the components of the right rotation part (201).
[0152] According to one embodiment, the content of the above-described FIG. 8 relates to an example of the present disclosure, and at least one of the components of the above-described FIG. 8 may be omitted or replaced with another component. For example, at least one of the components of the wearable device (1) may be omitted or replaced with at least one other component, and is not limited to the above-described configuration.
[0153] At least one sensor according to one embodiment (e.g., at least one sensor (4) of FIG. 2) may include at least one of at least one 1_1 sensor (401) or at least one 1_2 sensor (402). In one example, at least one of the 1_1 sensor (401) and at least one 1_2 sensor (402) may include at least one magnetic material. For example, at least one of the 1_1 sensor (401) and at least one 1_2 sensor (402) may be replaced with a magnetic material.
[0154] According to one embodiment, a wearable device (e.g., the wearable device (1) of FIG. 1) can obtain length information of a rotation frame connection portion using at least one sensor (e.g., at least one of at least one 1_1 sensor (401) or at least one 1_2 sensor (402)).
[0155] In one example, a wearable device (e.g., the wearable device (1) of FIG. 1) may include at least one first_2 sensor (401) and at least one first magnetic body (401). The at least one first_2 sensor (401) may be disposed on the second rotating frame arm (320). The at least one first magnetic body (401) may be disposed on at least one of the rotating part (e.g., the rotating part of FIG. 2), the ear cup (101), or the first rotating frame arm (310). For example, the at least one first magnetic body (401) may be disposed on a support member of the rotating part (e.g., the support member (220) of FIG. 4). The at least one first_2 sensor (402) may detect the intensity of a magnetic field formed by the at least one first magnetic body (401). At least one first_2 sensor (402) can detect the magnitude of magnetic flux, which is a physical quantity proportional to the strength of a magnetic field. For example, when the second rotating frame arm (320) moves from the first rotating frame arm (310) (or the rotating portion (201), or the ear cup (101)) and the relative positions of the at least one first_2 sensor (401) and the at least one first magnetic body (402) change, the value of magnetic flux detected by the at least one first_2 sensor (402) can change linearly. The wearable device (1) can identify the position of the second rotating frame arm (320) based on the magnetic flux value detected by the at least one first_2 sensor (402). Accordingly, the wearable device (1) can obtain length information of the rotating frame connecting portion. Accordingly, the wearable device (1) can identify the extent to which the length of the rotating frame connecting portion is extended.
[0156] In one embodiment, length information of the rotation frame connection can be obtained in a similar manner to the method described above, even if there is at least one first_1 sensor (401) and at least one second magnetic body (402).
[0157] However, the above-described content is an example of a method for a wearable device (1) to obtain length information of a rotating frame connection part using at least one sensor (for example, at least one of at least one 1_1 sensor (401) or at least one 1_2 sensor (402)), and is not limited to the above-described content.
[0158] For example, at least one of the first_1 sensor (401) or at least one of the first_2 sensor (402) may include a position sensor, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor, but is not limited thereto.
[0159] According to one embodiment, the position sensor may include at least one of a Hall sensor, a tunnel magnetoresistance (TMR) sensor, an anisotropic magneto-resistance (AMR) sensor, or a giant magneto-resistance (GMR) sensor, but is not limited thereto.
[0160] According to one embodiment, the wearable device (1) may terminate a video recording mode (e.g., first recording mode) being executed through the camera (5) when the length of the rotation frame connection part (301) is extended beyond a specified length based on the length information while the rotation frame (M) is in the first state (e.g., when the second rotation frame arm (320) is moved beyond a specified length).
[0161] According to one embodiment, the wearable device (1) can switch the video shooting mode (e.g., first shooting mode) being executed through the camera (5) (e.g., to second shooting mode) when the length of the rotation frame connection part (301) is extended beyond a specified length based on the length information while the rotation frame (M) is in the first state (e.g., second shooting mode).
[0162]
[0163] FIG. 9 is a cross-sectional view illustrating at least one sensor arranged in a rotating member according to one embodiment.
[0164] Referring to FIG. 9, at least one sensor (4) according to one embodiment may include at least one third sensor (403). In one embodiment, at least one third sensor (403) may be disposed on the rotating member (201). For example, the third sensor (403) may be disposed on at least one of the rotating member (210) or the fixed member (220). According to one embodiment, the wearable device (1) may obtain information regarding the rotation of the rotating frame (M) using the at least one third sensor (403). For example, the wearable device (1) may obtain information regarding the rotation of the rotating member (210) using the at least one third sensor (403). For example, the wearable device (1) can obtain at least one of information about a rotation angle of the rotating member (210) or information about a rotation direction of the rotating member (210) using the at least one third sensor (403). For example, the wearable device (1) can obtain rotation information including at least one of information about a rotation angle of the rotating member (210) with respect to the support member (220) or information about a rotation direction of the rotating member (210) with respect to the support member (220) using the at least one third sensor (403).
[0165] According to various embodiments, the wearable device (1) can identify whether the rotational member (210) rotates around the left-right axis with respect to the reference position based on the rotation information while the rotational frame (M) is in the first state. In one embodiment, if the wearable device (1) identifies that the rotational member (210) rotates more than a specified angle with respect to the reference position, the wearable device (1) can terminate the video recording mode being executed through the camera (5). In one embodiment, if the wearable device (1) identifies that the rotational member (210) rotates more than a specified angle with respect to the reference position, the wearable device (1) can switch the video recording mode being executed through the camera (5) (e.g., switching from a first recording mode to a second recording mode).
[0166] According to one embodiment, the wearable device (1) can maintain the video recording mode being executed through the camera (5) when it is determined that the rotating member (210) has rotated less than a specified angle relative to the reference position.
[0167]
[0168] FIG. 10 is a flowchart illustrating an operation of a wearable device generating a stereoscopic image according to various embodiments.
[0169] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).
[0170] In addition, the “information” described below may be interpreted to mean “data” or “signal,” and “data” may be understood as a concept that includes both analog data and digital data.
[0171] According to various embodiments, the operations illustrated in FIG. 10 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 10, or at least one operation may be performed less than those illustrated in FIG.
[0172] Referring to FIG. 10, a wearable device (1) according to various embodiments can generate a stereoscopic image based on a plurality of image frames in operation 1010. For example, the wearable device (1), in a first state of the rotation frame (M), can obtain a video (or a plurality of image frames) through a camera (5) (e.g., the first right camera (501), the first left camera (502) of FIG. 1) coupled to the rotation frame (M), and can generate a stereoscopic image based on the obtained plurality of image frames. For example, the wearable device (1) can capture the same scene from different viewpoints through the first right camera (501) and the first left camera (502) arranged corresponding to both sides of the user's face, and can generate a stereoscopic image based on the captured plurality of image frames.
[0173] According to one embodiment, the wearable device (1) can measure and correct internal parameters (focal length, distortion coefficient, etc.) and external parameters (relative position and direction between cameras) of the first right camera (501) and the first left camera (502) to generate a stereoscopic image based on the plurality of image frames. Accordingly, the wearable device (1) can remove distortion between images through correction and align the coordinate systems of the first right camera (501) and the first left camera (502) to generate a stereoscopic image.
[0174] According to one embodiment, the wearable device (1) can perform stereo matching when generating a stereoscopic image based on a plurality of image frames. For example, the wearable device (1) can find the same feature points of the right and left images acquired through the first right camera (501) and the first left camera (502), calculate the difference in coordinates, and calculate depth information to generate a stereoscopic image. The wearable device (1) can also perform post-processing and rendering on the generated stereoscopic image. However, the wearable device (1) is not limited to the above-described example, and can generate a stereoscopic image based on a plurality of image frames acquired through the first right camera (501) and the first left camera (502).
[0175] According to various embodiments, the wearable device (1) can store the stereoscopic image in the memory (3) in operation 1020. When a user requests output of the stored stereoscopic image, the wearable device (1) can output the stereoscopic image through the display (DR, DL).
[0176] According to various embodiments, the wearable device (1) may, in a second state of the rotation frame (M), acquire a video (or a plurality of image frames) through a camera (5) coupled to the rotation frame (M) (e.g., the second right camera (503) and the second left camera (504) of FIG. 1) and generate a stereoscopic image based on the acquired plurality of image frames. For example, the wearable device (1) may capture the same scene from different viewpoints through the second right camera (503) and the second left camera (504) arranged corresponding to the user's eyes, and generate a stereoscopic image based on the captured plurality of image frames. The operation of generating the stereoscopic image may be the same as or similar to generating an image based on image frames acquired through the first right camera (501) and the first left camera (502).
[0177] According to various embodiments, the wearable device (1) can generate a stereoscopic image by aligning a video (or a plurality of image frames) acquired through a camera (5) (e.g., a first right camera (501), a first left camera (502) of FIG. 1) coupled to the rotating frame (M) in a first state of the rotating frame (M) and a video (or a plurality of image frames) acquired through a camera (5) (e.g., a second right camera (503), a second left camera (504) of FIG. 1) coupled to the rotating frame (M) in a second state of the rotating frame (M). In this case, the stereoscopic image can be generated by editing at least one image frame acquired while the rotating frame (M) changes from the first state to the second state.
[0178]
[0179] FIG. 11 is a flowchart illustrating an operation of a wearable device outputting a stereoscopic image acquired through an external device according to various embodiments.
[0180] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).
[0181] In addition, the “information” described below may be interpreted to mean “data” or “signal,” and “data” may be understood as a concept that includes both analog data and digital data.
[0182] According to various embodiments, the operations illustrated in FIG. 11 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 11, or at least one operation may be performed less than those illustrated in FIG.
[0183] Referring to FIG. 11, a wearable device (1110) (e.g., the wearable device (1) of FIG. 1) can acquire multiple image frames through a camera (5). Depending on changes in the status of various wearable devices (1110), the shooting of the wearable device (1) can be terminated in operation 1101.
[0184] According to various embodiments, in operation 1103, the wearable device (1110) may store a plurality of image frames acquired through the camera (5). In one embodiment, the wearable device (1) may identify and store image frames acquired while the rotation frame (M) is positioned in front.
[0185] According to various embodiments, in operation 1105, the wearable device (1110) may transmit a plurality of image frames to an external device (1120). For example, the wearable device (1110) may transmit a plurality of image frames to the external device (1120) via the communication circuit described with reference to FIG. 2.
[0186] According to various embodiments, the external device (1120) may be configured in the form of various devices. For example, it may include a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a headset, headphones, AR glasses, an HMD device, or a home appliance device.
[0187] According to various embodiments, the external device (1120) may generate a stereoscopic image based on the plurality of image frames acquired in operation 1107. Furthermore, according to various embodiments, the external device (1120) may store the generated stereoscopic image in operation 1109. In various embodiments, the external device (1120) generating the stereoscopic image may be performed through an operation similar to the operation in which the wearable device (1) generates the stereoscopic image in operation 1301 of FIG. 13.
[0188] According to various embodiments, the external device (1120) may transmit the generated stereoscopic image to the wearable device (1110) in operation 1111. According to one embodiment, the external device (1120) may transmit the stereoscopic image to the wearable device (1110) based on a user input.
[0189] According to various embodiments, the wearable device (1110) may output the acquired stereoscopic image in operation 1113. For example, the wearable device (1110) may output the stereoscopic image through a speaker disposed in a display (DR, DL) and / or an ear cup (101, 102). In one embodiment, the wearable device (1110) may output the stereoscopic image through a right display (DR) and a left display (DL) corresponding to both eyes.
[0190]
[0191] FIG. 12 is a diagram illustrating how a wearable device manages shooting data according to various embodiments.
[0192] Referring to FIG. 12, a user interface for managing a stereoscopic image described with reference to FIGS. 10 and 11 is illustrated.
[0193] According to various embodiments, the external device (1210) described with reference to FIG. 11 (e.g., the external device (1120) of FIG. 11) may display an album screen for managing various shooting data. Various shooting data may be classified and managed into albums by the external device (1210), and the external device (1210) may display information about the album and a representative thumbnail image of the album through the display so that a user can easily recognize the album.
[0194] According to one embodiment, the external device (1210) can manage the photographed data acquired through the wearable device (1220) in a separate album (1211). For example, the external device (1210) can store the photographed data acquired through the wearable device (1220) and manage the stored photographed data by classifying it in a separate album (1211).
[0195] According to one embodiment, the external device (1210) can classify and manage captured data related to stereoscopic images (or stereoscopic images) among the acquired captured data into a separate album. In this case, the external device (1210) can additionally display a visual object (1212) so that the user can easily recognize that the captured data is for stereoscopic images (or stereoscopic images).
[0196] According to various embodiments, the wearable device (1220) may separately configure and display data for a stereoscopic image (or stereoscopic image) when displaying the captured data.
[0197] According to one embodiment, while the user wears the wearable device (1220) on at least a part of the body, the user may rotate the rotation frame (M) to a first state while viewing the album screen of the external device (1210) to place the display (DR, DL) in front of the user. In this case, the wearable device (1220) may output the captured data screen output through the external device (1210) so that the user can recognize it through the display (DR, DL). In one embodiment, the wearable device (1200) may output a thumbnail (1221) and a thumbnail list (1222) for a stereoscopic image (or stereoscopic image) among a plurality of captured data output through the external device (1210).
[0198] For example, when a user changes the rotation frame (M) of the wearable device (1220) to the first state while checking the shooting data through an external device (1210), the wearable device (1220) can predict that the user wants to check a stereoscopic image (or stereoscopic image), and output a thumbnail (1221) and a thumbnail list (1222) for a stereoscopic image (or stereoscopic image) among a plurality of shooting data, thereby allowing the user to check the stereoscopic image (or stereoscopic image) more easily and quickly.
[0199] As described above, the wearable device includes a rotating frame having at least one camera coupled thereto, at least one sensor for identifying a position of the rotating frame, at least one processor, and a memory for storing instructions, wherein the instructions are individually or collectively executed by the at least one processor to cause the wearable device to acquire a plurality of image frames through the at least one camera in a first shooting mode, acquire rotation information regarding rotation of the rotating frame through the at least one sensor while acquiring the plurality of image frames, and perform at least one of terminating the first shooting mode or switching to a second shooting mode based on the rotation information.
[0200] According to one embodiment, the rotation information includes a state of the rotation frame, and the state of the rotation frame may include a first state in which the rotation frame is positioned at a first position adjacent to the user's eyes and a second state in which the rotation frame is positioned at a second position adjacent to the user's head.
[0201] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to identify, through the at least one sensor, that the state of the rotation frame has changed from the first state to the second state, and to terminate the first shooting mode based on the state change.
[0202] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to identify at least one image frame acquired while the state of the rotation frame changes from the first state to the second state among the plurality of image frames acquired according to the first shooting mode, and to generate a video based on image frames excluding the at least one image frame among the plurality of image frames.
[0203] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to identify, through the at least one sensor, that the state of the rotation frame has changed from the first state to the second state, and to switch from the first shooting mode to the second shooting mode based on the state change.
[0204] According to one embodiment, the at least one camera may include a first camera module and a second camera module, and the first shooting mode may be a mode for acquiring a plurality of image frames through the first camera module, and the second shooting mode may be a mode for acquiring a plurality of image frames through the second camera module.
[0205] According to one embodiment, the first camera module may be positioned adjacent to a window included in the rotating frame, and the second camera module may be positioned to photograph the front when the state of the rotating frame is the second state.
[0206] According to one embodiment, a pair of ear cups configured to output sound, the pair of ear cups each including an ear cover and an ear cushion, a mounting frame connecting the pair of ear cups and configured to rest on a user's head, and a pivoting member coupled to at least one ear cup of the pair of ear cups, the pivoting member including a support member disposed within the ear cover of the at least one ear cup, and a pivoting member coupled to be rotatable about a left-right axis with respect to the support member, the pivoting frame including a pivoting frame connecting member configured to be extendable along a direction substantially perpendicular to the left-right axis, and the pivoting member being capable of being coupled to the pivoting frame.
[0207] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to identify whether the rotational member rotates around the left-right axis relative to the reference position based on the rotation information while the rotational frame is in the first state, and to terminate the first shooting mode when it is identified that the rotational member rotates by a specified angle or more relative to the reference position.
[0208] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to maintain the first shooting mode when the rotating member is identified as being rotated less than the specified angle relative to the reference position.
[0209] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to identify whether the rotational member rotates around the left-right axis with respect to the reference position based on the rotation information while the rotational frame is in the first state, and to switch from the first shooting mode to the second shooting mode when it is identified that the rotational member rotates by a specified angle or more with respect to the reference position.
[0210] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to obtain length information of the rotation frame connecting portion based on a change in the length of the rotation frame connecting portion through the at least one sensor, identify an extent to which the length of the rotation frame connecting portion is extended based on the length information, and terminate the first shooting mode when the length of the rotation frame connecting portion is extended by a specified length or more while the rotation frame is in the first state.
[0211] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to obtain, through the at least one sensor, length information of the rotation frame connecting portion based on a change in the length of the rotation frame connecting portion while the rotation frame is in the second state, obtain, through the at least one sensor, length information of the mounting frame connecting portion based on a change in the length of the mounting frame connecting portion configured to adjust the length of the mounting frame, and compare the length information of the mounting frame connecting portion and the length information of the rotation frame connecting portion, and execute the second shooting mode when there is a difference of a specified length or more.
[0212] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to identify that the state of the rotation frame changes from the second state to the first state while acquiring a plurality of image frames through the second camera module in the second shooting mode, and to switch from the second shooting mode to the first shooting mode based on the state change.
[0213] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to generate a stereoscopic image based on the plurality of image frames and to store the stereoscopic image in the memory.
[0214] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to transmit the instructions to an external device connected to the wearable device to generate a stereoscopic image based on the plurality of image frames.
[0215] According to one embodiment, a method of operating a wearable device including a rotating frame coupled with at least one camera may include: acquiring a plurality of image frames through the at least one camera in a first shooting mode; acquiring rotational information regarding rotation of the rotating frame through at least one sensor configured to identify a position of the rotating frame while acquiring the plurality of image frames; and performing at least one of terminating the first shooting mode or switching to a second shooting mode based on the rotational information.
[0216] According to one embodiment, the rotation information includes a state of the rotation frame, and the state of the rotation frame may include a first state in which the rotation frame is positioned at a first position adjacent to the user's eyes and a second state in which the rotation frame is positioned at a second position adjacent to the user's head.
[0217] According to one embodiment, the operation of terminating the first shooting mode or switching to the second shooting mode may further include an operation of identifying, through the at least one sensor, that the state of the rotating frame has changed from the first state to the second state, and an operation of terminating the first shooting mode or switching to the second shooting mode based on the state change.
[0218] According to one embodiment, a computer-readable recording medium storing one or more programs may include instructions for performing at least one operation among the operating methods of the wearable device.
[0219]
[0220] In this disclosure, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.
[0221] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).
[0222] The terms "part" and "module" used in various embodiments of the present disclosure may include units implemented in hardware, software, or firmware. For example, they may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integrally formed component or a minimum unit or part of the component that performs one or more functions. The "part" and "module" used in various embodiments of the present disclosure may be stored in an addressable storage medium and implemented by various programs that can be executed by a processor.
[0223] Various embodiments of the present disclosure may be implemented as software (e.g., a program) including one or more commands stored in a memory (3) (e.g., built-in memory or external memory) readable by a device (e.g., a wearable device (1)). The memory (3) may be expressed as a storage medium.
[0224] According to one embodiment, the methods according to the various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices.
[0225] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the above-described components may be omitted, or one or more other components or operations may be added. Additionally or alternatively, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in a manner identical to or similar to that performed by the corresponding component among the plurality of components prior to the integration.
[0226] According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be performed in a different order, omitted, or one or more other operations may be added.
[0227] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.
[0228] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to the embodiments described in the claims or specification of the present disclosure.
[0229] In the present disclosure, a function or operation performed by an electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The function or operation of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure may be understood to include a circuit for performing calculations or controlling other components of the electronic device. For example, the one or more processors may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a neural processing unit (NPU), a system on a chip (SoC), or an integrated circuit implemented to execute one or more instructions, and may have a plurality of cores.
[0230] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory (RAM), a flash memory, a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), a digital versatile disc (DVD) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium or may be formed by a combination of a plurality of storage media. The one or more commands may be stored in a single storage medium or may be distributed and stored in a plurality of storage media.
Claims
1. In wearable devices, A rotating frame with at least one camera attached; At least one sensor identifying the position of the rotating frame; at least one processor; and Contains memory for storing commands, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: In the first shooting mode, a plurality of image frames are acquired through the at least one camera, While acquiring the plurality of image frames, rotation information regarding the rotation of the rotating frame is acquired through the at least one sensor, and A wearable device that performs at least one of terminating the first shooting mode or switching to the second shooting mode based on the rotation information.
2. In claim 1, The above rotation information includes the state of the rotation frame, A wearable device, wherein the state of the rotation frame includes a first state in which the rotation frame is positioned at a first position adjacent to the user's eyes and a second state in which the rotation frame is positioned at a second position adjacent to the user's head.
3. In claim 2, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Through at least one sensor, it is identified that the state of the rotating frame has changed from the first state to the second state, and A wearable device that terminates the first shooting mode based on the above state change.
4. In claim 3, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Identifying at least one image frame acquired while the state of the rotation frame changes from the first state to the second state among the plurality of image frames acquired according to the first shooting mode, and A wearable device that generates a video based on image frames excluding at least one image frame among the plurality of image frames.
5. In claim 2, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Through at least one sensor, it is identified that the state of the rotating frame has changed from the first state to the second state, and A wearable device that switches from the first shooting mode to the second shooting mode based on the change in the above state.
6. In claim 5, The at least one camera comprises a first camera module and a second camera module, The above first shooting mode is a mode for acquiring multiple image frames through the first camera module, and A wearable device, wherein the second shooting mode is a mode for acquiring multiple image frames through the second camera module.
7. In claim 6, The first camera module is positioned adjacent to a window included in the rotating frame, and A wearable device wherein the second camera module is arranged to photograph the front when the state of the rotating frame is the second state.
8. In claim 2, A pair of ear cups configured to output sound, each of said pair of ear cups including an ear cover and an ear cushion; A mounting frame that connects the pair of ear cups and rests on the user's head; and A rotating member coupled to at least one ear cup among the pair of ear cups, wherein the rotating member includes a support member disposed within an ear cover of the at least one ear cup, and a rotating member coupled to be rotatable about a left-right axis with respect to the support member; and the rotating frame includes a rotating frame connecting member configured to be extendable along a direction substantially perpendicular to the left-right axis. A wearable device in which the above rotating part is coupled with the above rotating frame.
9. In claim 8, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: While the above-mentioned rotation frame is in the first state, based on the rotation information, it is identified whether the rotation member rotates around the left-right axis with respect to the reference position, and A wearable device that terminates the first shooting mode when it is determined that the rotating member has rotated by an angle greater than a specified angle relative to the reference position.
10. In claim 9, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: A wearable device that maintains the first shooting mode when it is determined that the rotating member has rotated less than the specified angle relative to the reference position.
11. In claim 8, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: While the above-mentioned rotation frame is in the first state, based on the rotation information, it is identified whether the rotation member rotates around the left-right axis with respect to the reference position, and A wearable device that switches from the first shooting mode to the second shooting mode when it is determined that the rotating member has rotated by an angle greater than a specified angle relative to the reference position.
12. In claim 8, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Obtaining length information of the rotation frame connection based on a change in the length of the rotation frame connection through at least one sensor, Based on the above length information, identify the extent to which the length of the rotation frame connection is extended, and A wearable device that terminates the first shooting mode when the length of the rotation frame connection part extends beyond a specified length while the rotation frame is in the first state.
13. In claim 8, The above instructions are individually or collectively executed by the at least one processor so that the wearable device, while the rotation frame is in the second state: Obtaining length information of the rotation frame connection based on a change in the length of the rotation frame connection through at least one sensor, Obtaining length information of the settling frame connection based on a change in the length of the settling frame connection configured to adjust the length of the settling frame through at least one sensor, and A wearable device that compares the length information of the above-mentioned fixing frame connection part and the length information of the above-mentioned rotating frame connection part, and executes the second shooting mode when the difference is greater than a specified length.
14. A method of operating a wearable device including a rotating frame having at least one camera coupled thereto, An operation of acquiring a plurality of image frames through at least one camera in a first shooting mode; An operation of acquiring rotational information regarding the rotation of the rotation frame through at least one sensor configured to identify a position of the rotation frame while acquiring the plurality of image frames; and A method of operating a wearable device, comprising an action of performing at least one of terminating the first shooting mode or switching to a second shooting mode based on the rotation information.
15. A computer-readable recording medium storing one or more programs including commands for performing the method of claim 14.
Citation Information
Patent Citations
head-mounted electronics
JP2018512816A
Head mounted display
KR1020140132278A
Quartz tube heater module for electric furnace for heat treatment and electric furnace for heat treatment to which the quartz tube heater module is applied
KR1020250117876A
Culture extraction system for jellyfish culture and jellyfish mucus extraction
KR102505914B1
Video headphones, system, platform, methods, apparatuses and media
US20140161412A1