Head movement tracing sensor and wearable capturing system using the same

Abstract

The present invention relates to a wearable shooting system, and more specifically, to a technology that tracks a user's head movements and provides a shooting function linked thereto. It includes a method of detecting a user's head movements using a gyroscope and an accelerometer embedded in an earphone, and transmitting the corresponding data to a wearable device to control the movement of a camera lens or to automatically adjust the screen to the user's gaze direction after wide-angle shooting. Additionally, the wearable device may include a function for storing and charging the earphone, and is characterized by enabling the effective storage and processing of captured data through linkage with a smartphone. The present invention contributes to providing a more natural and intuitive shooting experience by utilizing wearable technology.

Description

Technology Field

[0001] The present invention relates to an earphone with a built-in motion detection sensor and a wearable shooting system utilizing the same. In particular, it is applied to a technology that collects data on a user's head movements through a motion detection sensor within the earphone and controls the operation of a camera based on this data to perform shooting. The present invention can be applied to smart wearable devices, AR / VR, and user eye tracking and control fields. Background Technology

[0002] Recently, smart glasses equipped with cameras have been released. Smart glasses have cameras positioned near the eyes, allowing for images that closely resemble the user's line of sight.

[0003] However, due to the nature of smart glasses positioned on the face, their size and weight are inevitably limited. Since many elements such as the camera, battery, network connection device, CPU, and microphone are integrated into one space, it is difficult to use a battery with sufficient capacity, resulting in a very short usage time. The problem to be solved

[0004] The present invention is intended to overcome these problems by embedding a motion detection sensor within an earphone to collect head movement data and transmitting it to a wearable body containing a camera, thereby enabling the camera to be positioned on the neck or chest rather than the face, and to produce a shooting result that reflects the user's head movement. means of solving the problem

[0005] Earphones capable of inputting and outputting sound;

[0006] An earphone sensor unit that tracks head movements by embedding a gyroscope, an accelerometer, and a geomagnetic sensor in the earphone;

[0007] An earphone communication unit that transmits data collected through the sensor unit of the earphone to a wearable device or a smartphone;

[0008] A wearable device that can be draped over or attached to the body, such as the neck or chest;

[0009] A wearable device receiver that receives head movement data transmitted from the above-mentioned earphones;

[0010] A wearable device processing unit that analyzes data from the wearable device receiver to calculate the direction, rotation angle, and acceleration of the user's head movement;

[0011] A wearable device shooting unit that captures images by physically moving a camera lens to correspond to head movement based on data from the above-mentioned wearable device processing unit;

[0012] A wearable shooting system is provided, characterized by including a storage unit that stores data of the shooting unit of the wearable device.

[0013] A wearable imaging system is provided that can identify the front of a user wearing the wearable device by embedding at least one of a gyroscope, an accelerometer, and a geomagnetic sensor in the wearable device.

[0014] A wearable shooting system is provided, characterized by including a wearable device communication unit that transmits data from the above-mentioned wearable device storage unit to a smartphone.

[0015] The present invention relates to a method for obtaining results similar to shooting in response to head movements without physically moving the camera in the shooting unit of the above-mentioned wearable device, wherein an application is provided that provides results in which the camera appears to move according to the gaze by cropping and providing a scene corresponding to the user's gaze inferred from the head movement data after shooting with a wide angle of view using a wide-angle lens and transmitting the data and head movement data received from earphones to a smartphone.

[0016] A wearable device having the function of storing and charging the above-mentioned earphones is provided. At this time, the earphones can be either wired or wireless.

[0017] A wearable shooting system is provided that can be implemented in various forms such as neckbands, pins, and necklaces. Effects of the invention

[0018] Compared to smart glasses positioned on the face, it is free from constraints on volume and weight, allowing for the use of a large-capacity battery, which has the advantage of dramatically increasing usage time. Brief explanation of the drawing

[0019] Figure 1 illustrates the communication structure between an earphone and a wearable device when operating without a smartphone. FIG. 2 illustrates a communication structure for a wearable device linked with a smartphone that physically controls a camera. Figure 3 illustrates a wearable device communication structure linked with a smartphone that uses a cropped image from a fixed camera. FIG. 4 is a block diagram showing the configuration of a device for implementing the present invention. Specific details for implementing the invention

[0020] The present invention relates to a wearable shooting system, and more specifically, to a technology that tracks a user's head movements and provides a shooting function linked thereto. It includes a method of detecting a user's head movements using a gyroscope, accelerometer, and geomagnetic sensor embedded in an earphone, and transmitting the corresponding data to a wearable device or a smartphone to control the movement of a camera lens mounted on the wearable device or to automatically adjust the screen to the user's gaze direction after wide-angle shooting. Additionally, the wearable device may include a function for storing and charging the earphone, and is characterized by enabling the effective storage and processing of captured data through linkage with a smartphone. The present invention contributes to providing a more natural and intuitive shooting experience by utilizing wearable technology.

[0021] With the advancement of technology, shooting technology using wearable devices is gaining attention. In particular, shooting systems that reflect user movements can be utilized in various fields such as sports, education, medicine, and virtual reality (VR). Conventional wearable shooting devices capture video by mounting a camera on the user's hand or part of the body, but this method has limitations in that it does not perfectly align with the user's line of sight.

[0022] To address these issues, head movement tracking technology is being researched. Utilizing head movement data allows for the effective identification of the user's gaze direction, enabling more intuitive shooting. Currently, advancements in motion sensor technology using gyroscopes and accelerometers have made precise movement tracking possible.

[0023] In addition, existing wearable devices often provide only simple shooting functions, which necessitate being attached to equipment such as helmets or the user's body, causing inconvenience and hindering smooth frontal tracking. Therefore, there is a need for a method that utilizes user-friendly devices, such as earphones, to collect head movement data and integrates it with a wearable camera.

[0024] The present invention aims to provide a more intuitive and natural shooting experience by precisely tracking the user's head movements through at least one of a gyroscope, an accelerometer, and a geomagnetic sensor embedded in an earphone, and enabling gaze-based shooting by linking this with a wearable device.

[0025] Conventional wearable cameras have limitations because they do not automatically adjust recording based on the user's head movements, requiring manual operation or restricting shooting to a fixed angle of view. Additionally, standard wearable cameras struggle to record video from a perspective that perfectly aligns with the user's gaze and lack the functionality to effectively adjust the recorded footage.

[0026] To solve this problem, the present invention includes at least one of a gyroscope, an accelerometer, and a geomagnetic sensor in an earphone to precisely analyze the user's head movements and transmits the data to a wearable device to provide a function that operates a camera lens based on the data or automatically crops the screen corresponding to the user's gaze direction in a captured video. Through this, natural shooting reflecting the user's gaze movement is possible, and the usability of the wearable camera can be further increased.

[0027] In addition, the present invention adds at least one of a gyroscope (111), an accelerometer (112), and a geomagnetic sensor (113) to a wearable device to enable more accurate analysis of head movements based on the user's overall movement. This enables precise head movement tracking even while moving and provides improved gaze-based shooting technology.

[0028] In addition, the present invention enables data transmission and reception between an earphone and a wearable device via a wireless or wired method, and includes a function to transmit captured video to a smartphone for real-time or post-processing. Furthermore, it enhances usability by designing the wearable device to charge the earphone, and maximizes user convenience by enabling it to be implemented in various forms such as a neckband, pin, or necklace.

[0029] Through this technology, the present invention supports shooting that precisely reflects the user's head movements and improves the usability of the wearable camera, enabling more natural and immersive video shooting.

[0030] Referring to FIG. 1, a communication structure between an earphone (100) and a wearable device (200) according to an embodiment of the present invention is illustrated. The earphone (100) transmits head movement data to the wearable device (200), and the wearable device (200) performs data calculations based on this to control camera shooting and image storage.

[0031] Referring to FIG. 2, the earphone (100) tracks the user's head movements through a sensor unit (110) comprising at least one of a gyroscope (111), an accelerometer (112), and a geomagnetic sensor (113). The head movement data collected from the earphone (100) is transmitted to a smartphone (300) via a communication module (150). The processing unit (310) of the smartphone (300) generates camera drive control data to control the camera (250) of the wearable device (200) using the head movement data received from the earphone (100). The communication unit (330) of the smartphone (300) transmits the camera drive control data to the wearable device (200). The camera (250) of the wearable device (200) captures a frontal image of the user's gaze based on the camera drive control data. An image or captured data captured by the camera (250) of the wearable device (200) is stored in the wearable storage unit (270) and transmitted to the smartphone (300) by the communication module (260) of the wearable device (200). The image or captured data transmitted to the smartphone (300) is stored in the storage unit (320) of the smartphone (300).

[0032] This structure provides a shooting result that corresponds to the user's head movement through organic data exchange between the earphone (100), the wearable device (200), and the smartphone (300).

[0033] Referring to FIG. 3, a communication structure between an earphone (100), a wearable device (200), and a smartphone (300) according to an embodiment of the present invention is illustrated. The earphone (100) transmits voice data and head movement data to the smartphone (300). The earphone (100) includes a sensor unit (110), and the sensor unit (110) incorporates a gyroscope (111), an accelerometer (112), or a geomagnetic sensor (113) to track the user's head movements. Data collected from the earphone (100) is transmitted to the smartphone (300) through a communication module (150).

[0034] The processing unit (310) of the smartphone (300) processes the cropping of an image of a wide angle of view (first angle of view) captured by the camera (250) of the wearable device (200) using head movement data received from the earphone (100). The camera (250) of the wearable device (200) captures an image of a wide angle of view (first angle of view) while the camera lens is physically fixed, and the captured image is transmitted to the smartphone (300) by the communication module (260) of the wearable device (200). The processing unit (310) of the smartphone (300) can create an image of a second angle of view that is narrower than the first angle of view by cropping the scene corresponding to the user's gaze from the image of the first angle of view using the head movement data provided from the earphone (100). The image created through the cropping process is stored in the storage unit (320) of the smartphone (300).

[0035] Through this, a shooting result corresponding to the movement of the head can be provided even if the camera does not physically move. The smartphone (300) performs data calculations through the processing unit (310) and stores the final image in the storage unit (320).

[0036] Referring to FIG. 4, a head movement tracking sensor according to an embodiment of the present invention and a wearable shooting device utilizing the same include an earphone (100), a wearable device (200), and a smartphone / terminal (300). The earphone (100) includes a sensor unit (110), a speaker (120), a microphone (130), a battery (140), and a communication module (150). The sensor unit (110) tracks the head movement of a user by incorporating at least one of a gyroscope (111), an accelerometer (112), and a geomagnetic sensor (113). The communication module (150) of the earphone transmits the collected data to the wearable device (200) or the smartphone (300).

[0037] The wearable device (200) includes a sensor unit (210), a speaker (220), a microphone (230), a battery (240), a camera (250), a communication module (260), a storage unit (270), and a processing unit (280). The sensor unit (210) incorporates at least one of a gyroscope (211), an accelerometer (212), and a geomagnetic sensor (113) to provide a reference for user movement. The communication module (260) of the wearable device (200) receives head movement data transmitted from the earphone (100). The head movement data may include the direction of head movement, the angle of rotation, and acceleration. The camera (250) physically moves based on this data to perform shooting, and the captured data is stored in the storage unit.

[0038] A smartphone (or terminal) (300) includes a receiving unit (not shown), a processing unit (310), a storage unit (320), and a communication module (330), and can receive data from a wearable device (200) and perform additional processing. For example, an application can be implemented that crops and provides a scene corresponding to the user's gaze based on head movement data from a wide-angle image captured using a wide-angle lens. In this way, the present invention provides a technology that tracks the user's head movement through communication between an earphone (100), a wearable device (200), and a smartphone (300), and controls the operation of a camera based on this to perform shooting. Explanation of the symbols

[0039] 100: Earphones 110: Sensor section 111: Gyroscope 112: Accelerometer 120: Speaker 130: Microphone 140: Battery 150: Communication module 200: Wearable devices 210: Sensor section 211: Gyroscope 212: Accelerometer 220: Speaker 230: Mike 240: Battery 250: Camera 260: Communication module 270: Storage section 280: Processing unit 300: Smartphone / Device 310: Processing unit 320: Storage section 330: Communication module

Claims

Claim 1 A wearable shooting system characterized by comprising: an earphone capable of inputting and outputting sound; an earphone sensor unit that tracks head movements by embedding a gyroscope, an accelerometer, and a geomagnetic sensor in the earphone; an earphone communication unit that transmits data collected through the earphone sensor unit to a wearable device; a wearable device that can be worn or attached to the body; a wearable device receiver unit that receives head movement data received from the earphone communication unit; a wearable device processing unit that analyzes data from the wearable device receiver unit to calculate the direction of head movement, rotation angle, and acceleration of the user; a wearable device shooting unit that physically moves a camera lens in response to head movements based on data from the wearable device processing unit to take a picture; and a storage unit that stores data from the wearable device shooting unit. Claim 2 A wearable shooting system according to claim 1, which generates head movement data of the user based on the front of the user using a gyroscope, accelerometer, or geomagnetic sensor embedded in the wearable device. Claim 3 A wearable shooting system according to claim 1, further comprising a wearable device communication unit that transmits data stored in a storage unit of the wearable device to a smartphone. Claim 4 A wearable shooting system according to claim 1, wherein the shooting unit of the wearable device captures an image at a first angle of view while the camera lens is physically fixed, transmits the image data captured at the first angle of view to a smartphone, and the smartphone crops the scene corresponding to the user's gaze in the image captured at the first angle of view based on the head movement data generated from the earphones, and outputs an image at a second angle of view narrower than the first angle of view. Claim 5 In claim 1, the wearable device is a wearable shooting system comprising an earphone receiving portion equipped with a charging pad that accommodates the earphone and provides power to the earphone. Claim 6 In claim 1, the wearable device is a wearable imaging system comprising at least one of a neckband, a pin, and a necklace.

Images