Shooting method and device, head-mounted equipment and storage medium

By sending the information to be photographed to the terminal device for display, the problem that the head-mounted device cannot display the information to be photographed in time is solved, and the battery life of the device is improved by optimizing the power usage.

CN119815170APending Publication Date: 2025-04-11ZHUHAI MOJIE TECH CO LTD

Patent Information

Application Number
CN202411735550.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-28
Publication Date
2025-04-11

AI Technical Summary

Technical Problem

The existing head-mounted devices cannot display the information to be shot in time during shooting, resulting in users not being able to understand in time whether the shooting content meets expectations, and when the display function is available, the device has low battery life.

Method used

When the head-mounted device is connected to the terminal device, the information to be photographed is sent to the terminal device for display, so that the user can instantly view the information to be photographed, and when the head-mounted device has the display function, decide whether to send the information to be photographed according to the power supply, thereby improving battery life.

Benefits of technology

When the head-mounted device does not have the display function, the user can instantly view the information to be photographed through the terminal device, which improves the timeliness of the information display; at the same time, when the display function is available, the battery life of the head-mounted device is improved by reducing the display operation on the device itself.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119815170A_ABST
    Figure CN119815170A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a shooting method and device, head-mounted equipment and a storage medium, and the method comprises the steps: obtaining to-be-shot information recognized by a camera shooting assembly after the head-mounted equipment connected with terminal equipment starts the camera shooting assembly; sending the to-be-shot information to the terminal equipment, so that the terminal equipment displays the to-be-shot information after receiving the to-be-shot information; and in response to a detected shooting instruction, generating multimedia information according to the to-be-shot information. According to the method, the head-mounted device can send the to-be-shot information to the terminal device for display in the shooting process of the head-mounted device, and a user can check the to-be-shot information through the terminal device when the head-mounted device does not have a display function, so that the user can check the shot content in time, and the user experience is improved. Whether the shot content is wanted by a user or not is known, so that the timeliness of displaying the information to be shot is improved; in addition, when the head-mounted device has the display function, the user can check the to-be-shot information through the terminal device without checking the to-be-shot information through the head-mounted device, and the cruising ability of the head-mounted device is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of photographing technology, and in particular to a photographing method, apparatus, head-mounted device and storage medium. Background Art

[0002] Current head-mounted devices (such as AI glasses, audio glasses, etc.) have limited storage space and cannot store large amounts of data. Even though many current head-mounted devices have camera components and can take pictures, for some head-mounted devices that do not have display functions, users cannot view the content being shot in time during the shooting process, and therefore cannot understand in time whether the content being shot is what they want. Summary of the invention

[0003] The embodiments of the present invention provide a shooting method, apparatus, head-mounted device and storage medium, aiming that during the shooting process of the head-mounted device, the head-mounted device will send the information to be shot to the terminal device for display, thereby realizing that when the head-mounted device does not have a display function, the user can view the information to be shot through the terminal device, so that the user can view the shot content in time and understand whether the shot content is what he wants, thereby improving the timeliness of the display of the information to be shot; it also realizes that when the head-mounted device has a display function, the user can also view the information to be shot through the terminal device without having to view the information to be shot through the head-mounted device, thereby improving the battery life of the head-mounted device.

[0004] In a first aspect, an embodiment of the present invention provides a shooting method, which is applied to a head mounted device, and the method includes:

[0005] When the head mounted device connected to the terminal device starts the camera component, the information to be photographed recognized by the camera component is obtained;

[0006] sending the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed;

[0007] In response to detecting a shooting instruction, multimedia information is generated according to the information to be shot.

[0008] In a second aspect, an embodiment of the present invention provides a shooting method, which is applied to a head mounted device, and the method includes:

[0009] An information acquisition module, used for acquiring the information to be photographed recognized by the camera component after the head mounted device connected to the terminal device starts the camera component;

[0010] An information sending module, used for sending the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed;

[0011] The information generating module is used to generate multimedia information according to the information to be captured in response to detecting a shooting instruction.

[0012] In the third aspect, an embodiment of the invention further provides a head-mounted device, comprising a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein when the computer program is executed by the processor, the shooting method described in the first aspect is realized.

[0013] In a fourth aspect, an embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the shooting method as described in the first aspect.

[0014] The embodiment of the present invention provides a shooting method, device, head-mounted device and storage medium. In the embodiment of the present application, when the head-mounted device connected to the terminal device starts the camera component, the head-mounted device obtains the information to be shot recognized by the camera component, and sends the information to be shot to the terminal device, so that the terminal device displays the information to be shot after receiving the information to be shot, and generates multimedia information according to the information to be shot when the head-mounted device detects the shooting instruction. The disclosed embodiment realizes that during the shooting process of the head-mounted device, the head-mounted device will send the information to be shot to the terminal device for display, and realizes that when the head-mounted device does not have a display function, the user can view the information to be shot through the terminal device, so that the user can view the content shot in time and understand whether the content shot is what he wants, thereby improving the timeliness of the display of the information to be shot; it also realizes that when the head-mounted device has a display function, the user can also view the information to be shot through the terminal device without viewing the information to be shot through the head-mounted device, thereby improving the endurance of the head-mounted device. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 is a schematic structural block diagram of a head mounted device provided by an embodiment of the present invention;

[0017] Figure 2 is a flowchart of a shooting method provided by an embodiment of the present invention;

[0018] Figure 3 This is a flow chart of step S102 in an embodiment of the present invention;

[0019] Figure 4 is a schematic diagram of information to be photographed displayed in a terminal device provided in an embodiment of the present invention;

[0020] Figure 5 is a schematic diagram of a shooting center line provided by an embodiment of the present invention;

[0021] Figure 6 It is a schematic block diagram of the structure of a shooting device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0024] It should be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0025] The embodiments of the present invention provide a shooting method, an apparatus, a head-mounted device and a storage medium. The embodiments of the present invention provide a technical solution.

[0026] In the embodiment of the present invention, the head-mounted device may be AR (Augmented Reality) glasses, AR helmet, VR (Virtual Reality) glasses, etc.

[0027] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0028] Figure 1 The present invention is a schematic structural block diagram of a head mounted device provided by an embodiment of the present invention.

[0029] like Figure 1 As shown, the head mounted device 100 includes a processor 101 and a memory 102, and the processor 101 and the memory 102 are connected via a bus 103, such as an I2C (Inter-integrated Circuit) bus.

[0030] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire head-mounted device 100. The processor 101 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0031] Specifically, the memory 102 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0032] Those skilled in the art will understand that Figure 1 The structure shown in the figure is merely a block diagram of a partial structure related to the embodiment of the present invention, and does not constitute a limitation on the head-mounted device to which the embodiment of the present invention is applied. The specific head-mounted device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0033] The processor 101 is used to run a computer program stored in the memory 102. The computer program can be set in a head-mounted device. When the head-mounted device executes the computer program, it implements any one of the shooting methods provided in the embodiments of the present invention.

[0034] In one embodiment, the processor is used to run a computer program stored in the memory, and implements the following steps when executing the computer program:

[0035] When the head mounted device connected to the terminal device starts the camera component, the information to be photographed recognized by the camera component is obtained;

[0036] sending the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed;

[0037] In response to detecting a shooting instruction, multimedia information is generated according to the information to be shot.

[0038] In one embodiment, when the head mounted device connected to the terminal device starts a camera component, the step of obtaining the information to be photographed recognized by the camera component includes:

[0039] When the head mounted device connected to the terminal device starts the camera assembly, the rotation angle of the head of the user wearing the head mounted device is obtained;

[0040] The information to be photographed recognized by the camera assembly is obtained based on the rotation angle.

[0041] In one embodiment, the processor is further configured to implement the following steps when executing the computer program:

[0042] If the rotation angle is greater than or equal to the first preset angle, a shooting instruction is triggered, and the step of generating multimedia information according to the information to be shot in response to detecting the shooting instruction is executed.

[0043] In one embodiment, after the step of obtaining the rotation angle of the head of the user wearing the head mounted device after the head mounted device connected to the terminal device starts the camera assembly, the processor is further configured to implement the following steps when executing the computer program:

[0044] If the rotation angle is greater than or equal to a second preset angle, determining a shooting center line of the shooting component corresponding to the horizontal axis;

[0045] The step of acquiring the information to be photographed recognized by the camera assembly based on the rotation angle comprises:

[0046] In one embodiment, after the head mounted device connected to the terminal device starts the camera assembly and obtains the rotation angle of the head of the user wearing the head mounted device, the processor is further configured to implement the following steps when executing the computer program:

[0047] If the rotation angle is greater than or equal to a third set angle, a display instruction is sent to the terminal device, so that the terminal device displays a guide horizontal line for the user's head rotation according to the display instruction;

[0048] The rotation data of the user's head during rotation is acquired, and the rotation data is sent to the terminal device, so that the terminal device controls the display of the guide horizontal line according to the rotation data.

[0049] In one embodiment, after the step of obtaining the information to be photographed recognized by the camera component after the head mounted device connected to the terminal device starts the camera component, the processor is further configured to implement the following steps when executing the computer program:

[0050] If an adjustment instruction for adjusting the information to be photographed sent by the terminal device is received, adjusting the information to be photographed according to the adjustment instruction to obtain the adjusted information to be photographed;

[0051] In response to detecting a shooting instruction, the step of generating multimedia information according to the information to be shot comprises:

[0052] In response to detecting a shooting instruction, multimedia information is generated according to the adjusted information to be shot.

[0053] In one embodiment, after the step of generating multimedia information according to the information to be captured in response to detecting a shooting instruction, the processor is further configured to implement the following steps when executing the computer program:

[0054] Sending the multimedia information to the terminal device for storage;

[0055] or

[0056] The multimedia information is sent to the terminal device for storage, and the multimedia information is deleted after a preset time period.

[0057] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the head-mounted device described above can refer to the corresponding process in the following shooting method embodiment, and will not be repeated here.

[0058] The following will be combined Figure 1 The head mounted device in the embodiment of the present invention is used to introduce the shooting method provided by the embodiment of the present invention in detail. Figure 1 The head mounted device is only used to explain the shooting method provided in the embodiment of the present invention, but does not constitute a limitation on the application scenario of the shooting method provided in the embodiment of the present invention.

[0059] See also Figure 2 , Figure 2 It is a flowchart of a shooting method provided by an embodiment of the present invention.

[0060] like Figure 2As shown, the shooting method is applied to a head mounted device, and the shooting method includes step S101, step S102 and step S103.

[0061] Step S101: After the head mounted device connected to the terminal device starts a camera component, information to be photographed recognized by the camera component is obtained.

[0062] In the disclosed embodiment, the head-mounted device may be a device with a display function or a device without a display function. In the head-mounted device, a camera component is provided, and the user can shoot images or videos through the camera component in the head-mounted device. The terminal device may be a mobile phone, a personal computer, a handheld computer, etc. In the disclosed embodiment, the terminal device is a device with a display function. The terminal device can establish a communication connection with the head-mounted device in a wired or wireless manner. For example, the terminal device can establish a communication connection with the head-mounted device through Bluetooth, WLAN (Wireless Local Area Network), etc. When the head-mounted device establishes a communication connection with the terminal device through a local area network, as long as the head-mounted device and the terminal device are in the same local area network, the head-mounted device and the terminal device can realize data transmission. Since the head-mounted device is not convenient for input, the head-mounted device can scan the code through the camera component to establish a WLAN connection with the terminal device.

[0063] After the head-mounted device establishes a communication connection with the terminal device, if the head-mounted device receives a start-up instruction to start the camera component, the head-mounted device starts the camera component according to the start-up instruction and obtains the information to be shot recognized by the camera component. The start-up instruction can be triggered by the user in the head-mounted device, such as the user can trigger the start-up instruction by single-clicking, double-clicking, or long pressing a button on the head-mounted device, or it can be triggered by the user in the terminal device and sent by the terminal device to the head-mounted device. The information to be shot is the information recognized by the camera component after the camera component is started, such as preview information of the shot content, and the information to be shot can be a person and / or an object.

[0064] Step S102: sending the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed.

[0065] After the head-mounted device obtains the information to be shot, the head-mounted device sends the information to be shot to the terminal device. It is understandable that if the head-mounted device has a display function, the head-mounted device can choose to display the information to be shot on its display interface, or it can choose not to display the information to be shot on the display interface in order to save power consumption. After the terminal device receives the information to be shot, the terminal device outputs the information to be shot on its display interface to display the information to be shot so that the user can view the information to be shot through the terminal device. It is understandable that although the head-mounted device first obtains the information to be shot and then sends the information to be shot to the terminal device, due to the high data transmission efficiency between the head-mounted device and the terminal device, for the user, when the head-mounted device obtains the information to be shot, the user can view the information to be shot through the terminal device. Reference Figure 3 , Figure 3 A schematic diagram of a terminal device displaying information to be photographed in an embodiment of the present invention.

[0066] In one embodiment, after the head-mounted device obtains the information to be shot, if the head-mounted device does not have a display function, the head-mounted device sends the shooting information to the terminal device so that the user can view the information to be shot through the terminal device. If the head-mounted device has a display function, the head-mounted device determines its current remaining power. If the remaining power is greater than the preset power, the head-mounted device does not send the information to be shot to the terminal device, and displays the information to be shot on its display interface for the user to view; if the remaining power is less than or equal to the preset power, the head-mounted device sends the information to be shot to the terminal device. The preset power can be set according to specific needs, such as the preset power can be set to 20% of the total power, or to 10% of the total power, etc. In this embodiment, after the head-mounted device obtains the information to be photographed, the decision is made whether to send the information to be photographed to the terminal device based on whether the head-mounted device has a display function. This ensures that the user can view the information to be photographed regardless of whether the head-mounted device has a display function, thereby improving the timeliness of the display of the information to be photographed. Furthermore, when the head-mounted device has a display function, the information to be photographed can be sent to the terminal device when the battery of the head-mounted device is low. This ensures that the user can view the information to be photographed in a timely manner while improving the battery life of the head-mounted device.

[0067] Step S103: in response to detecting a shooting instruction, generating multimedia information according to the information to be shot.

[0068] After the head-mounted device sends the information to be shot to the terminal device, if the head-mounted device detects a shooting instruction, the head-mounted device generates multimedia information based on the information to be shot. The shooting instruction can be an image shooting instruction or a video recording instruction. When the shooting instruction is an image shooting instruction, the multimedia information is an image; when the shooting instruction is a video recording instruction, the multimedia information is a video. The shooting instruction can be triggered by the user in the head-mounted device, or it can be triggered by the user in the terminal device and sent by the terminal device to the head-mounted device. Figure 3 It can be seen that in the information to be shot displayed by the terminal device, a virtual control for triggering the shooting command can be displayed, that is, Figure 3 Below the area to be shot shown in the figure, at the location of the user's gesture, when the user clicks the virtual control, the shooting command can be triggered.

[0069] In this embodiment, when the head-mounted device connected to the terminal device starts the camera component, the head-mounted device obtains the information to be shot recognized by the camera component, and sends the information to be shot to the terminal device, so that the terminal device can display the information to be shot after receiving the information to be shot, and when the head-mounted device detects the shooting instruction, it generates multimedia information according to the information to be shot. The disclosed embodiment realizes that during the shooting process of the head-mounted device, the head-mounted device will send the information to be shot to the terminal device for display, and realizes that when the head-mounted device does not have a display function, the user can view the information to be shot through the terminal device, so that the user can view the captured content in time, thereby improving the timeliness of the display of the information to be shot; it also realizes that when the head-mounted device has a display function, the user can also view the information to be shot through the terminal device without having to view the information to be shot through the head-mounted device, thereby improving the battery life of the head-mounted device.

[0070] In one embodiment, after step S103, the method further includes: sending the multimedia information to the terminal device for storage;

[0071] or

[0072] The multimedia information is sent to the terminal device for storage, and the multimedia information is deleted after a preset time period.

[0073] After the head-mounted device generates multimedia information, the head-mounted device sends the multimedia information to the terminal device. After the terminal device receives the multimedia information, it displays and stores the multimedia information. In the terminal device, a folder can be set to store the multimedia information captured by the head-mounted device. Since the head-mounted device in the related art has limited storage, the captured multimedia information is sent to the terminal device for storage, thereby saving the storage space of the head-mounted device.

[0074] In one embodiment, after the head mounted device sends multimedia information to the terminal device for storage, the head mounted device deletes the multimedia information after a preset time period, so as to prevent the multimedia information from occupying the storage space of the head mounted device, thereby saving the storage space of the head mounted device. The preset time period can be set according to specific needs, such as 3 minutes, 10 hours, or 23 days.

[0075] In one embodiment, referring to Figure 4 , step S102 includes:

[0076] Step S1021: After the head mounted device connected to the terminal device starts the camera assembly, the rotation angle of the head of the user wearing the head mounted device is obtained.

[0077] Step S1022, obtaining the information to be photographed recognized by the camera assembly based on the rotation angle.

[0078] When the head-mounted device establishes a communication connection with the terminal device, and the head-mounted device starts the camera component, the head-mounted device obtains the rotation angle of the user's head wearing the head-mounted device. In the head-mounted device, a sensor for detecting the rotation angle of the user's head can be set, such as a gyroscope sensor, an angle sensor or an IMU (Inertial Measurement Unit). After the head-mounted device obtains the rotation angle of the user's head, the head-mounted device obtains the information to be shot recognized by the camera component based on the rotation angle. It can be understood that when the head-mounted device starts the camera component to shoot, before the shooting command is detected, if the user turns his head, the shooting range of the camera component will change with the change of the rotation angle. When the rotation angle is larger, the camera component will recognize more information to be shot. When the user is wearing the head-mounted device and turning his head, the user can trigger the shooting command at any time, and the user can turn to the left or to the right during the process of turning his head. It is understandable that when the user's head is rotating, the user's body can also rotate along with it, so the rotation angle of the user's head can reach 360 degrees. The embodiment of the present invention can obtain more shooting information through the rotation of the head, and the rotation angle can reach 360 degrees, that is, 360-degree shooting can be achieved through the head-mounted device. It is understandable that since the camera component of the head-mounted device itself has a shooting angle, the rotation angle of the user's head does not need to reach 360 degrees to achieve 360-degree shooting. Compared with the related art, using a mobile phone to shoot wide-angle shooting (currently mobile phones cannot achieve 360-degree shooting), the embodiment of the present invention increases the shooting area.

[0079] In one embodiment, the step S1021 further includes:

[0080] If the rotation angle is greater than or equal to a second preset angle, determining a shooting center line of the shooting component corresponding to the horizontal axis;

[0081] The step S1022 includes:

[0082] The information to be photographed recognized by the camera assembly is determined according to the shooting center line and the rotation angle.

[0083] When the head-mounted device obtains the rotation angle of the user's head and determines to start the wide-angle shooting function, the head-mounted device determines whether the rotation angle is greater than or equal to the second preset angle, wherein the size of the second preset angle can be set according to specific needs, and the present embodiment does not impose specific restrictions on this, such as the second preset angle can be set to 60 degrees, 80 degrees or 90 degrees, etc. When the rotation angle is greater than or equal to the second preset angle, it indicates that the rotation angle of the user's head is large enough. The wide-angle shooting function can be understood as ultra-wide-angle shooting. When the wide-angle shooting function is started, it indicates that the user wants to shoot scenes within a larger range. The user can start the wide-angle shooting function through voice commands, touch commands, etc.

[0084] If the head-mounted device has activated the wide-angle shooting function, and the rotation angle is greater than or equal to the second preset angle, the head-mounted device determines the shooting center line of the shooting component corresponding to the horizontal axis. Among them, the shooting center line is used to determine the central reference line of the shooting range, and the information to be shot is determined based on the shooting center line and the rotation angle. It can be understood that the shooting center line is used to determine the reference line to be shot when the user starts shooting, and the shooting center line is in the middle of the content to be shot. In this embodiment, the shooting center line can be used to determine the upper and lower ranges of the information to be shot, and the rotation angle is used to determine the left and right ranges of the information to be shot. In one embodiment, in order to avoid the upper and lower ranges of the information to be shot being inconsistent, the upper and lower ranges of the information to be shot can be determined based on the upper and lower preset distances of the shooting center line. The preset distance can be set according to specific needs, and this embodiment does not impose specific restrictions on this.

[0085] When the rotation angle of the user's head is less than the second preset angle, it indicates that the shooting range at this time is still relatively small, so the head-mounted device may not determine the shooting center line of the shooting component corresponding to the horizontal axis, so as to reduce the data processing amount of the head-mounted device and reduce the power consumption of the head-mounted device.

[0086] Please refer to 5. Figure 5 It is a schematic diagram of the shooting center line. When the head-mounted device has a display function, the head-mounted device can display the shooting center line in its display interface. At this time, the user can refer to the shooting center line and turn the head as much as possible on the same horizontal line, so that the head-mounted device can obtain better information to be shot.

[0087] In one embodiment, when the head-mounted device does not display the shooting center line, the head-mounted device can determine the shooting area of ​​the shooting component corresponding to the longitudinal axis, and then determine the information to be shot according to the shooting center line, the shooting area and the rotation angle. It can be understood that the horizontal axis corresponding to the shooting component is the horizontal direction, that is, the left-right direction; the longitudinal axis corresponding to the shooting component is the gravity direction, that is, the up-down direction. There are two scenarios in which the head-mounted device does not display the shooting center line. One is that when the head-mounted device has a display function, the head-mounted device does not display the shooting center line to save power; the other is that the head-mounted device does not have a display function.

[0088] In the process of the head-mounted device determining the information to be photographed according to the shooting center line, the shooting area and the rotation angle, the head-mounted device can determine the deviation degree of the user's head in the horizontal direction during the rotation process according to the shooting center line, and determine the selection center line of the information to be photographed based on the deviation degree. For example, a preset number of reference points can be selected on the shooting center line, and then the deviation distance of the user's head position from the shooting center line at each reference point during the rotation of the user's head is determined, and the deviation average value is determined based on the deviation distance, and the selection center line is obtained based on the deviation average value and the shooting center line. For example, when the deviation average value is +1cm (centimeter), the selection center line is 1cm above the shooting center line; when the deviation average value is -0.5cm (centimeter), the selection center line is 0.5cm below the shooting center line. It can be understood that when the position of the user's head deviates upward relative to the shooting center line during the rotation of the user's head, the deviation distance is a positive value; when the position of the user's head deviates downward relative to the shooting center line, the deviation distance is a negative value. In one embodiment, the position of the user's head may be the position of the center of the user's eyebrows, or the position of the user's head may be determined as the position of the center point of the camera assembly, or other places of the head-mounted device may be determined as the position of the user's head. For example, when the head-mounted device is a pair of smart glasses, the position of the user's head may be determined as the center point of the frame. In this embodiment, the number of reference points is not specifically displayed, that is, the preset number can be set as needed, and the greater the rotation angle, the more reference points can be. It can be understood that the more reference points there are, the more accurate the selected center line is.

[0089] After the head mounted device determines the selected center line of the information to be photographed, the first shooting point with the minimum distance above the selected center line within the shooting range is determined, and the second shooting point with the minimum distance below the selected center line within the shooting range is determined, and the first selected line of the information to be photographed is determined according to the first shooting point, and the second selected line of the information to be photographed is determined according to the second shooting point. It can be understood that the first shooting point is a point on the first selected line, the second shooting point is a point on the second selected line, the first selected line, the selected center line and the second selected line are all parallel, but the distance between the first selected line and the selected center line is not necessarily equal to the distance between the second selected line and the selected center line. After the head mounted device determines the first selected line and the second selected line, the head mounted device can determine the information to be photographed according to the first selected line, the second selected line and the rotation angle. It can be understood that the first selected line and the second selected line are used to determine the upper and lower ranges of the information to be photographed, and the rotation angle is used to determine the left and right ranges of the information to be photographed, and the content enclosed by the upper and lower ranges and the left and right ranges is the information to be photographed.

[0090] This embodiment determines the information to be photographed by the shooting center line, shooting area and rotation angle, thereby improving the aesthetics of the multimedia information generated according to the information to be photographed in a large-scale shooting scene, and avoiding the situation where the real scene corresponding to the photographed information is not on the same horizontal line due to the user's head not being on the same horizontal line when the user turns his head.

[0091] In one embodiment, the method further includes: if the rotation angle is greater than or equal to a first preset angle, triggering a shooting instruction and executing step S103.

[0092] After the head mounted device determines the rotation angle of the user's head, the head mounted device determines whether the rotation angle is greater than or equal to a first preset angle; if the rotation angle is greater than or equal to the first preset angle, the head mounted device automatically triggers a shooting command. If it is determined that the rotation angle is less than the first preset angle, the head mounted device does not automatically trigger a shooting command. The first preset angle may be equal to or different from the second preset angle.

[0093] This embodiment improves the intelligence of shooting through the head-mounted device by automatically triggering a shooting instruction when the rotation angle of the user's head is greater than or equal to a first preset angle, that is, when the shooting range is large enough.

[0094] In one embodiment, after step S1021, the method further includes:

[0095] If the rotation angle is greater than or equal to a third preset angle, a display instruction is sent to the terminal device, so that the terminal device displays a guide horizontal line for the user's head rotation according to the display instruction;

[0096] The rotation data of the user's head during rotation is acquired, and the rotation data is sent to the terminal device, so that the terminal device controls the display of the guide horizontal line according to the rotation data.

[0097] If the head mounted device determines that the rotation angle of the user's head is greater than or equal to the third preset angle, it indicates that the current shooting angle is large, and the head mounted device sends a display instruction to the terminal device. Among them, the third preset angle may be equal to or different from the first preset angle and the second preset angle. When the head mounted device determines that the rotation angle of the user's head is less than the third preset angle, it indicates that the current shooting angle is not large, and the head mounted device may not send a display instruction to the terminal device. When the terminal device receives the display instruction, the terminal device displays a guide horizontal line for the user's head rotation according to the display instruction. Among them, the guide horizontal line and the shooting center line may be the same line. Through the guide horizontal line, it can be known whether the user's head is in a horizontal state during the rotation process, that is, whether the position of the user's head is on a horizontal line during the rotation process of the user's head. When the head mounted device sends the display instruction to the terminal device, the head mounted device will obtain the rotation data of the user's head during the rotation process, and send the rotation data to the terminal device. After the terminal device receives the rotation data, the display of the guide horizontal line is controlled by the rotation data. For example, when the user's head is rotating, if the user's head position deviates upward from the guide horizontal line, the guide horizontal line will also move upward; if the user's head position deviates downward from the guide horizontal line, the guide horizontal line will also move downward. It is understandable that the terminal device can determine whether the user's head position deviates from the guide horizontal line based on the rotation data.

[0098] In one embodiment, after step S101, the method further includes:

[0099] If an adjustment instruction for adjusting the information to be photographed sent by the terminal device is received, adjusting the information to be photographed according to the adjustment instruction to obtain the adjusted information to be photographed;

[0100] The step S103 includes:

[0101] In response to detecting a shooting instruction, multimedia information is generated according to the adjusted information to be shot.

[0102] After the terminal device displays the information to be photographed, the user can trigger an adjustment instruction for adjusting the information to be photographed in the terminal device. The adjustment instruction can be to adjust the photographing parameters, such as adjusting the shooting mode, or adjusting the degree of beauty, etc. After the terminal device receives the adjustment instruction, the terminal device sends the adjustment instruction to the head-mounted device. When the head-mounted device receives the adjustment instruction, the head-mounted device adjusts the information to be photographed according to the adjustment instruction to obtain the adjusted information to be photographed. When the head-mounted device detects the shooting instruction, the head-mounted device generates multimedia information according to the adjusted information to be photographed. In one embodiment, if the head-mounted device has a display function, the adjustment instruction can also be triggered by the head-mounted device.

[0103] This embodiment adjusts the information to be photographed acquired by the head mounted device according to the adjustment instruction in the terminal device, thereby improving the flexibility of adjusting the information to be photographed and preventing the user from having to adjust the information to be photographed only through the head mounted device.

[0104] See also Figure 6 , Figure 6 It is a schematic block diagram of the structure of a shooting device provided by an embodiment of the present invention.

[0105] like Figure 6 As shown, the shooting device 600 is applied to a head mounted device, and the shooting device 600 includes:

[0106] The information acquisition module 610 is used to acquire the information to be photographed recognized by the camera component after the head mounted device connected to the terminal device starts the camera component;

[0107] A first information sending module 620, configured to send the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed;

[0108] The information generating module 630 is configured to generate multimedia information according to the information to be captured in response to detecting a shooting instruction.

[0109] In one embodiment, the information acquisition module 610 further includes:

[0110] An angle acquisition unit, used to acquire the rotation angle of the head of the user wearing the head-mounted device after the head-mounted device connected to the terminal device starts the camera assembly;

[0111] The information acquisition unit is used to acquire the information to be photographed recognized by the camera component based on the rotation angle.

[0112] In one embodiment, the photographing device 600 further includes:

[0113] The instruction triggering module is used to trigger a shooting instruction if the rotation angle is greater than or equal to a first preset angle, and execute the step of generating multimedia information according to the information to be shot in response to detecting the shooting instruction.

[0114] In one embodiment, the information acquisition module 610 further includes:

[0115] a centerline determining unit, configured to determine a shooting centerline of the shooting component corresponding to the horizontal axis if the rotation angle is greater than or equal to a second preset angle;

[0116] The information acquisition unit is also used to determine the information to be photographed recognized by the camera assembly according to the shooting center line and the rotation angle.

[0117] In one embodiment, the photographing device 600 further includes:

[0118] an instruction sending module, configured to send a display instruction to the terminal device if the rotation angle is greater than or equal to a third set angle, so that the terminal device displays a guide horizontal line for the user's head rotation according to the display instruction;

[0119] The data sending module is used to obtain the rotation data of the user's head during rotation, and send the rotation data to the terminal device, so that the terminal device can control the display of the guide horizontal line according to the rotation data.

[0120] In one embodiment, the photographing device 600 further includes:

[0121] The information adjustment module is used to obtain the rotation data of the user's head during rotation, and send the rotation data to the terminal device so that the terminal device can control the display of the guide horizontal line according to the rotation data.

[0122] The information generating module 630 is further configured to generate multimedia information according to the adjusted information to be captured in response to detecting a capturing instruction.

[0123] In one embodiment, the photographing device 600 further includes:

[0124] A second information sending module, used to send the multimedia information to the terminal device for storage;

[0125] Alternatively, the second information sending module is used to send the multimedia information to the terminal device for storage, and delete the multimedia information after a preset time period.

[0126] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the shooting device described above can refer to the corresponding process in the aforementioned shooting method embodiment, and will not be repeated here.

[0127] An embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any shooting method provided in the description of the embodiment of the present invention.

[0128] The storage medium may be an internal storage unit of the head-mounted device described in the foregoing embodiment, such as a hard disk or memory of the head-mounted device. The storage medium may also be an external storage device of the head-mounted device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., provided on the head-mounted device.

[0129] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware embodiment, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0130] It should be understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system including the element.

[0131] The serial numbers of the embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments. The above description is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A shooting method, characterized in that: The method is applied to a head mounted device, and the method comprises: When the head mounted device connected to the terminal device starts the camera component, the information to be photographed recognized by the camera component is obtained; sending the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed; In response to detecting a shooting instruction, multimedia information is generated according to the information to be shot.

2. The shooting method according to claim 1, characterized in that: When the head mounted device connected to the terminal device starts the camera component, the step of obtaining the information to be photographed recognized by the camera component includes: When the head mounted device connected to the terminal device starts the camera assembly, the rotation angle of the head of the user wearing the head mounted device is obtained; The information to be photographed recognized by the camera assembly is obtained based on the rotation angle.

3. The shooting method according to claim 2, characterized in that: The method further comprises: If the rotation angle is greater than or equal to the first preset angle, a shooting instruction is triggered, and the step of generating multimedia information according to the information to be shot in response to detecting the shooting instruction is executed.

4. The shooting method according to claim 2, characterized in that: After the head mounted device connected to the terminal device starts the camera assembly and obtains the rotation angle of the head of the user wearing the head mounted device, the method further includes: If the rotation angle is greater than or equal to a second preset angle, determining a shooting center line of the shooting component corresponding to the horizontal axis; The step of acquiring the information to be photographed recognized by the camera assembly based on the rotation angle comprises: The information to be photographed recognized by the camera assembly is determined according to the shooting center line and the rotation angle.

5. The shooting method according to claim 2, characterized in that: After the step of obtaining the rotation angle of the head of the user wearing the head mounted device after the head mounted device connected to the terminal device starts the camera assembly, the method further includes: If the rotation angle is greater than or equal to a third set angle, a display instruction is sent to the terminal device, so that the terminal device displays a guide horizontal line for the user's head rotation according to the display instruction; The rotation data of the user's head during rotation is acquired, and the rotation data is sent to the terminal device, so that the terminal device controls the display of the guide horizontal line according to the rotation data.

6. The shooting method according to claim 1, characterized in that: After the head mounted device connected to the terminal device starts the camera component and obtains the information to be photographed recognized by the camera component, the method further includes: If an adjustment instruction for adjusting the information to be photographed sent by the terminal device is received, adjusting the information to be photographed according to the adjustment instruction to obtain the adjusted information to be photographed; In response to detecting a shooting instruction, the step of generating multimedia information according to the information to be shot comprises: In response to detecting a shooting instruction, multimedia information is generated according to the adjusted information to be shot.

7. The shooting method according to any one of claims 1 to 6, characterized in that: After the step of generating multimedia information according to the information to be photographed in response to detecting a shooting instruction, the method further includes: Sending the multimedia information to the terminal device for storage; or The multimedia information is sent to the terminal device for storage, and the multimedia information is deleted after a preset time period.

8. A photographing device, characterized in that: The shooting device is applied to a head mounted device, and the shooting device comprises: An information acquisition module, used for acquiring the information to be photographed recognized by the camera component after the head mounted device connected to the terminal device starts the camera component; An information sending module, used for sending the information to be photographed to the terminal device, so that the terminal device displays the information to be photographed after receiving the information to be photographed; The information generating module is used to generate multimedia information according to the information to be captured in response to detecting a shooting instruction.

9. A head mounted device, characterized in that: The head mounted device comprises a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein when the computer program is executed by the processor, the shooting method as described in any one of claims 1 to 7 is realized.

10. A storage medium for computer-readable storage, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the shooting method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Shooting module component angle adjusting method and head mounted display device

    CN107439001A

  • Image shooting display method and equipment and computer readable storage medium

    CN110248088A

  • Head-mounted remote imaging system, head-mounted imaging device, and imaging direction display method

    JP2012156930A

  • Remote support system, display system, head mounted display, operation terminal, display control program, and control method

    JP2019074637A

Cited By

  • Photographing method and apparatus, head-mounted device, and storage medium

    WO2026113323A1