Earphone control method, earphone and storage medium

Abstract

The invention discloses an earphone control method, an earphone and a storage medium, and relates to the technical field of earphones, and the earphone control method comprises the following steps: if a shooting process of conference data is triggered, determining whether a current shooting angle of the earphone is at a target shooting angle according to shooting angle verification information of the earphone; and if yes, controlling a video module of the earphone to execute a shooting action. The earphone can shoot the conference data, can automatically check the shooting angle information during shooting, and carries out shooting after the current shooting angle meets the target shooting angle, thereby guaranteeing that the earphone can shoot the conference data, and also can accurately judge the shooting angle. And the accuracy and effectiveness of conference data recording are improved.

Description

Technical Field

[0001] The present application relates to the field of earphone technology, and in particular to an earphone control method, an earphone, and a storage medium. Background Art

[0002] In modern conference scenarios, headphones are commonly used as conference auxiliary tools, mainly used for voice communication and audio reception. When recording conference information based on headphones, the voice-to-text function of the headphones can record the conference communication information in real time, and the headphones can adjust the recorded content based on the speaker. However, in the conference recording scenario, headphones can only record the content of the conversation, but not the visual data, resulting in incomplete recording of conference information.

[0003] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of the present application is to provide a headset control method, headset and storage medium, aiming to solve the technical problem that current headsets are difficult to record visual data, resulting in incomplete recording of conference data.

[0005] To achieve the above object, the present application proposes a method for controlling an earphone, the method comprising:

[0006] If the shooting process of the conference material is triggered, the shooting angle verification information of the headset is used to determine whether the current shooting angle of the headset is at the target shooting angle;

[0007] If so, control the video module of the headset to perform a shooting action.

[0008] In one embodiment, if the conference material shooting process is triggered, after the step of verifying the shooting angle information of the headset to determine whether the current shooting angle of the headset is at the target shooting angle, the method further includes:

[0009] If the current shooting angle is not at the target shooting angle, determining a rotation parameter of the video module, the rotation parameter including a horizontal rotation parameter and / or a vertical rotation parameter;

[0010] Controlling the rotation mechanism of the headset to operate according to the horizontal rotation parameter and / or the vertical rotation parameter so that the shooting angle of the headset is at the target shooting angle; and / or

[0011] If the current shooting angle is at the target shooting angle, the video module is controlled to perform a focusing action based on the preview image of the current shooting angle.

[0012] In one embodiment, the step of determining the rotation parameters of the video module includes:

[0013] Determine the horizontal angle and / or horizontal offset of the conference material according to the current picture information captured by the headset and the horizontal reference line;

[0014] The horizontal rotation parameter of the video module is generated according to the horizontal angle and / or the horizontal offset of the picture.

[0015] In one embodiment, the step of determining the rotation parameters of the video module includes:

[0016] Determine the vertical angle and / or vertical offset of the conference material according to the current picture information captured by the headset and the vertical reference line;

[0017] The vertical rotation parameter of the video module is generated according to the vertical angle and / or the vertical offset of the picture.

[0018] In one embodiment, after the step of determining the rotation parameters of the video module if the current shooting angle is not at the target shooting angle, the step further includes:

[0019] If the position change process is triggered, obtaining the position change information of the earphone based on the position sensor and the acceleration sensor;

[0020] The rotation parameter is updated according to the position change information.

[0021] In one embodiment, the step of controlling the video module to perform a focusing action according to the preview image based on the current shooting angle includes:

[0022] Acquire image parameters of a preview picture of the video module at the target shooting angle, and determine edge contour parameters of the preview picture after edge detection processing;

[0023] Determining a focus area based on contrast and clarity change information between the image parameters and the edge profile parameters;

[0024] According to the phase detection result of the focus area, the focus parameter of the video module is determined, and the focal length of the video module is adjusted based on the focus parameter.

[0025] In one embodiment, the step of verifying the shooting angle information of the headset to determine whether the current shooting angle of the headset is at the target shooting angle includes:

[0026] If the process of shooting conference materials is triggered, the headphone units to be shot are determined according to the image information currently shot by the headphone, wherein the number of the headphone units to be shot is one or two;

[0027] According to the shooting angle verification information of the earphone unit to be photographed, it is determined whether the current shooting angle of the earphone unit to be photographed is located at the target shooting angle.

[0028] In one embodiment, if the number of the earphone units to be photographed is two, the step of determining whether the current shooting angle of the earphone unit to be photographed is located at the target shooting angle according to the shooting angle verification information of the earphone unit to be photographed includes:

[0029] If the photographable range of the earphone units to be photographed does not cover the display interface of the conference materials, based on the two earphone units to be photographed, performing the step of verifying the photographing angle of the earphone units to be photographed to determine whether the current photographing angle of the earphone units to be photographed is within the target photographing angle; or

[0030] If the shootable range covers the display interface of the conference materials, the step of verifying the shooting angle of the headphone unit to be shot is performed based on the preset headphone unit to determine whether the current shooting angle of the headphone unit to be shot is within the target shooting angle.

[0031] In one embodiment, the step of determining the headphone unit to be photographed according to the image information currently photographed by the headphone comprises:

[0032] Determining the photographable range of each earphone unit according to the image information;

[0033] If the photographable range of one of the earphone units exists, covering the display interface of the conference materials, it is determined that the number of the earphone units to be photographed is one;

[0034] Otherwise, it is determined that the number of the earphone units to be photographed is two.

[0035] In one embodiment, before the step of determining whether the current shooting angle of the headset is at the target shooting angle according to the shooting angle verification information of the headset if the shooting process of the conference data is triggered, the step further includes:

[0036] In response to the conference material sharing process, triggering the process of photographing the conference material; or

[0037] In response to the received shooting instruction, the shooting process of the conference material is triggered.

[0038] In addition, to achieve the above-mentioned purpose, the present application also proposes an earphone, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the earphone control method as described above.

[0039] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the headphone control method described above are implemented.

[0040] One or more technical solutions proposed in this application have at least the following technical effects:

[0041] When the shooting process of conference materials is triggered, the shooting angle of the headset is checked to determine whether the current shooting angle of the headset is at the target shooting angle. Then, when it is at the target shooting angle, the video module of the headset is controlled to perform the shooting action to shoot and record the current conference materials. Based on this, the recording of visual materials in the meeting can be achieved through the headset shooting method, thereby ensuring the authenticity and integrity of the conference material records. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0043] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0044] Figure 1 A schematic diagram of a flow chart of a first embodiment of a method for controlling headphones of the present application;

[0045] Figure 2 A schematic diagram of a flow chart of a second embodiment of a method for controlling headphones of the present application;

[0046] Figure 3 A schematic diagram of a flow chart provided for a third embodiment of a method for controlling headphones of the present application;

[0047] Figure 4 A schematic diagram of the shooting range of the headset provided by the headset control method of the present application;

[0048] Figure 5 A schematic diagram of a flow chart provided for a fourth embodiment of a method for controlling headphones of the present application;

[0049] Figure 6 A schematic diagram of a simplified flow chart of a method for controlling headphones according to a fourth embodiment of the present application

[0050] Figure 7 Schematic diagram of the device structure of the hardware operating environment involved in the headset control method in the embodiment of the present application.

[0051] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0052] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0053] The main solution of the embodiment of the present application is: if the shooting process of the conference material is triggered, it is determined whether the current shooting angle of the headset is at the target shooting angle according to the shooting angle verification information of the headset;

[0054] If so, control the video module of the headset to perform a shooting action.

[0055] In this embodiment, for the convenience of description, the following description is made with the earphone as the execution subject.

[0056] In the prior art, when recording conference information with headphones, the voice-to-text function of the headphones is used to record the conference communication information in real time, and the headphones can adjust the recorded content based on the speaker. However, in the conference recording scenario, the headphones can only record the content of the conversation, but not the visual data, resulting in incomplete recording of the conference information.

[0057] The present application provides a solution. After the earphone or the control system of the earphone triggers the shooting process of the conference material, the earphone verifies the shooting angle of the earphone and determines whether the current shooting angle is at an ideal shooting angle based on the verification information. If so, the video module of the earphone is controlled to perform the shooting action, so as to record the conference material by shooting with the earphone, thereby improving the integrity of the visual conference material recording.

[0058] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, a headset and a headset control system capable of realizing the above functions. The headset is taken as an example to illustrate this embodiment and the following embodiments, wherein the headset can be a wireless headset, a wired headset or a headphone, etc., and this application does not limit this.

[0059] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0060] The present application embodiment provides a method for controlling an earphone, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the earphone control method of the present application.

[0061] In this embodiment, the headset is provided with a video module, which integrates components such as a camera, an image sensor, and a video encoder / decoder. A rotating mechanism is also provided between the video module and the headset, and the headset performs a shooting action through the video module, and can adjust the shooting position of the headset through the rotating mechanism. The headset control method includes steps S10 to S20:

[0062] Step S10: If the conference material shooting process is triggered, the shooting angle verification information of the headset is used to determine whether the current shooting angle of the headset is at the target shooting angle.

[0063] It should be noted that meeting materials refer to all text, graphics, audio, video and other forms of materials involved and used in the preparation, conduct and subsequent summary of the meeting. In offline or online meetings, meeting materials are usually projected onto a projection area such as a projection screen to ensure the smooth progress of the meeting and improve meeting efficiency. The target shooting angle refers to the ideal shooting angle at which the headset can accurately capture and fully record the content of the meeting materials to the storage device during the shooting of the meeting materials, also known as the optimal shooting angle. Among them, when the optical element in the video module of the headset is facing the projection screen of the meeting, the headset is usually considered to be at the target shooting angle.

[0064] In modern conference scenarios, headphones are commonly used as conference auxiliary tools, mainly used for voice communication, audio reception and other functions. With the diversification of conference formats and the increase in demand for data recording, existing headphones have obvious deficiencies in conference material shooting. In this embodiment, after the user attends a meeting and wears headphones, when the shooting process of the conference material is triggered, the headphones detect the current shooting angle information to determine whether the shooting is at the target shooting angle. The target shooting angle can be obtained based on the ideal shooting angle model.

[0065] Specifically, the headset can continuously monitor whether there is a demand for shooting conference materials and whether the shooting process is triggered. In the process of determining whether the current shooting angle is at the target shooting angle, the headset obtains the current shooting angle information of the current video module through the sensor, including the shooting angle information in the horizontal and vertical directions, and then compares and analyzes the acquired shooting angle information with the target shooting angle generated by the target shooting angle model (also known as the ideal shooting angle model), and calculates the angle deviation value through a specific optimization algorithm such as the least squares method. The angle deviation value includes the deviation value between the current shooting angle and the target shooting angle in the horizontal and vertical directions, and generates shooting angle verification information including being at the target shooting angle / not at the target shooting angle based on the deviation value, so that the headset can determine whether the current shooting angle is at the target shooting angle based on the shooting angle verification information. Among them, the shooting angle verification information can be generated by analyzing whether the deviation value exceeds the preset deviation value or the preset deviation range.

[0066] It is understandable that the headset stores a preset target shooting angle model, which is based on a large amount of experimental data and conference scene analysis, and can determine the optimal shooting angle range and parameters for different types of conference materials (such as documents, presentations, physical displays, etc.) and shooting needs (such as shooting full views, close-ups, etc.).

[0067] As an optional implementation method of triggering the process of shooting conference materials, the shooting of conference materials can be triggered after responding to the process of sharing conference materials. Exemplarily, during the meeting, the headset and the conference software interact via Bluetooth. After the user performs a data sharing / data recording operation in the conference software, the conference software synchronizes the operation process information to the headset, and the headset triggers the process of shooting the conference materials. Optionally, the headset responds to voice commands triggered by the user during the meeting, such as receiving a voice of "shoot current conference materials", converting the voice into text and analyzing the text to determine the current need to shoot conference materials, triggering the process of shooting conference materials. In addition, the shooting process can also be triggered by other conference material sharing operations, which is not limited in this application.

[0068] In another optional embodiment of triggering the shooting process of conference materials, the headset triggers the shooting process of conference materials after responding to the received shooting instruction. Exemplarily, the headset is provided with a physical button for taking images or videos, or the remote control software is provided with a virtual button, and when the user presses the physical button or the virtual button in the software to which the headset is remotely connected during the conference, the headset triggers the shooting process.

[0069] This embodiment determines whether the current shooting angle of the headset is at the target shooting angle, so as to perform the shooting action when the headset is at the target shooting angle, thereby improving the shooting clarity when recording conference materials and the effectiveness of visual conference material recording.

[0070] Step S20: If yes, control the video module of the headset to perform a shooting action.

[0071] In this embodiment, when the headset is at the target shooting angle, it means that the headset can clearly and accurately shoot and record the content of the conference materials at the current position. Therefore, the headset can control its video module to perform shooting actions, and then shoot images displayed during the meeting, or shoot pictures, videos and other content displayed during the meeting. Based on this, the headset realizes the recording of visual conference materials during the meeting, improves the integrity of the conference material information record, and at the same time shoots based on the target shooting angle to improve the clarity of the conference material record, thereby improving the accuracy of the conference material.

[0072] It should be noted that while the headset's video module performs shooting actions to record the visual materials displayed during the meeting, it also turns on the microphone to record the audio information generated during the meeting in real time. When a participant first starts the headset with the automatic camera calibration function, the headset system automatically performs a self-check on each hardware component to ensure that all parts are working properly.

[0073] This embodiment provides a method for controlling headphones, which triggers the shooting process of conference materials through interactive instructions between the headphones and conference software or operation instructions between the user and the headphones, and executes the shooting and recording action of the conference materials after judging that the headphones are in the target shooting position through shooting position detection information. At the same time, it can record the audio content generated by the meeting, thereby ensuring the integrity of the video conference material recording and improving the conference material recording effect.

[0074] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the first embodiment can be referred to the above description and will not be described in detail later. The headset can automatically and flexibly rotate and adjust according to factors such as the location and distance of the conference site materials and the user's viewing angle requirements to ensure full coverage of the conference materials. On this basis, please refer to Figure 2 , after step S10, further comprising steps S30 to S40:

[0075] Step S30: If the current shooting angle is not at the target shooting angle, determine the rotation parameters of the video module, where the rotation parameters include horizontal rotation parameters and / or vertical rotation parameters.

[0076] In this embodiment, the headset can dynamically adjust the current shooting range through the rotation mechanism, thereby improving the flexibility of shooting conference materials through the headset. Therefore, when the current shooting angle of the headset is not at the target shooting angle, it is necessary to calculate the parameters for controlling the rotation of the rotation mechanism, and control the operation of the rotation mechanism through the parameters. The rotation parameters include horizontal rotation parameters and / or vertical rotation parameters, so as to control the operation of the headset's rotation mechanism through deviations in the horizontal and / or vertical directions.

[0077] In the process of determining the rotation parameters of the video module, the deviation information of the picture currently captured by the headset can be used to calculate the deviation information of the picture in the horizontal plane and / or the vertical plane, and the rotation parameters required to control the rotation of the rotating mechanism can be calculated based on the deviation information. In addition, the headset can also determine the current spatial posture information of the headset through built-in sensors such as accelerometers and gyroscopes, and calculate the rotation parameters required to control the rotation of the rotating mechanism based on the position of the conference materials in the picture.

[0078] Therefore, as an optional implementation method of calculating the rotation parameters according to the currently captured image information, step S30 includes steps S31 to S32:

[0079] Step S31, determining the horizontal angle and / or horizontal offset of the conference material according to the current picture information captured by the headset and the horizontal reference line.

[0080] It should be noted that the horizontal angle refers to the horizontal offset angle of the conference material content in the current screen information; the horizontal offset of the screen is used to determine whether the horizontal distribution of the conference material in the screen is uniform;

[0081] In this embodiment, the headset can determine the location of the conference material in the current image through image recognition technology. If the conference material does not exist in the current image, the headset outputs corresponding prompt screen information.

[0082] Specifically, when there is conference material in the current picture information, the image analysis module of the headset can analyze the area where the conference material is located in the picture information through the horizontal reference line when the headset is shooting, including automatically analyzing whether the bottom edge of the conference material area, the lower frame of the projector screen or the horizontal bar of the display stand are parallel to the horizontal reference line. If it is parallel, it means that the horizontal angle is normal. If the lines are not parallel, it means that there may be a horizontal angle offset when the headset shoots the video, causing the picture to look crooked. At the same time, the image analysis module of the headset continues to check whether the horizontal distribution of the conference material in the current picture is uniform. For example, it is detected whether there are blank parts or decorative elements of roughly equal range on the left and right sides of the conference material to avoid the situation where the material is obviously biased to one side of the picture, so as to better determine the direction and parameters that need to be adjusted in the horizontal direction of the video module.

[0083] By analyzing the picture information captured by the headset at the current shooting angle, the horizontal offset information of the conference material in the current picture is determined based on the picture information.

[0084] Optionally, in addition to analyzing the conference material information in the screen through image analysis technology, the location information, angle information, etc. of the conference material can also be analyzed and judged through machine learning technology. The specific image recognition and detection technology is not limited in this application.

[0085] Step S32: Generate the horizontal rotation parameter of the video module according to the horizontal angle and / or the horizontal offset of the picture.

[0086] In this embodiment, after obtaining the horizontal angle and / or the horizontal offset of the picture, the headset determines the actual horizontal rotation parameter through the mapping relationship between the horizontal angle and / or the horizontal offset of the picture and the horizontal rotation parameter. In addition, these data can also be processed by the microprocessor inside the headset.

[0087] When the microprocessor processes the horizontal rotation parameters, the microprocessor processes these data according to the pre-set mathematical model and algorithm. For example, after obtaining the relevant data of the offset, the gyroscope and accelerometer parameters are integrated and analyzed, and the horizontal angle that the camera needs to rotate is calculated using the trigonometric function relationship. At the same time, the range of travel and speed control parameters of the camera during the rotation process are determined in combination with the data of the distance sensor. Based on this, when these parameters are mapped to the rotation mechanism of the video module through the actual horizontal angle, horizontal offset of the picture, etc., the parameters that need to be adjusted in the horizontal direction of the rotation mechanism are determined. For example, if the horizontal offset is 30px, the rotation parameter of the rotation mechanism offset to the right can be a distance of 15 pixels.

[0088] Optionally, in addition to determining the rotation parameters by parameter mapping, the directly measured data may be directly used as part of the rotation parameters. For example, if the horizontal offset is 30px, the rotation parameter of the rotation mechanism shifting to the right may be a distance of 30 pixels.

[0089] In another optional implementation of calculating the rotation parameters according to the currently captured image information, step S30 includes steps S33 to S34:

[0090] Step S33, determining the vertical angle and / or vertical offset of the conference material according to the current picture information captured by the headset and the vertical reference line.

[0091] Step S34: generating the vertical rotation parameter of the video module according to the vertical angle and / or the vertical offset of the picture.

[0092] It should be noted that the vertical angle is the flip angle of the conference materials in the vertical direction, which avoids the situation where the upper part of the material is too large and the lower part is too small due to the camera shooting upward, or the material looks disproportionate when shooting from below; the vertical offset of the picture is used to determine whether the vertical distribution of the conference materials in the picture is uniform.

[0093] When the headset analyzes the current screen vertically, it detects whether the conference materials meet the normal viewing angle in the vertical direction of the screen. The detection method is based on the vertical reference line for vertical comparison, and then determines the rotation parameters that meet the requirements based on the detected vertical angle, so that the conference materials are presented in a normal aspect ratio. At the same time, when detecting whether the vertical distribution of the conference materials in the current screen is uniform, it analyzes whether there are roughly equal blank areas or decorative elements on the upper and lower sides of the conference materials, so as to avoid the situation where the materials are obviously biased to one side of the screen.

[0094] The method of generating the vertical rotation parameters based on the vertical angle and / or the vertical offset of the picture is the same as the method of generating the horizontal rotation parameters, and this application will not elaborate on it here.

[0095] It is understandable that if no horizontal adjustment is required, the generated horizontal rotation parameter is 0 or empty, and the same is true if no vertical adjustment is required.

[0096] Step S40: controlling the rotation mechanism of the headset to operate according to the horizontal rotation parameter and / or the vertical rotation parameter, so that the shooting angle of the headset is located at the target shooting angle.

[0097] In this embodiment, after obtaining the rotation parameters in the horizontal and / or vertical direction, the microprocessor of the headset sends the rotation parameters to the rotation mechanism that drives the video module to rotate, so as to control the operation of the rotation mechanism according to the rotation parameters, so that the shooting angle of the headset approaches or is located at the target shooting angle.

[0098] Exemplarily, it is calculated that the video module needs to be rotated 45 degrees horizontally to the left and 30 degrees vertically upward. At this time, the rotating mechanism gradually adjusts the position of the video module based on the set speed and accuracy to fully cover the conference materials.

[0099] After the rotation mechanism of the headset is controlled to operate according to the rotation parameters, if the wearer of the headset turns his head, lowers his head, or performs other actions to change the shooting angle of the headset, it is necessary to calculate the changed position information of the headset and update the rotation parameters in real time through the position information. Therefore, after step S40, if the position change process is triggered, the position change information of the headset is obtained based on the position sensor and the acceleration sensor, and then the rotation parameters are updated according to the position change information. Among them, the position sensor can be a gyroscope and a distance sensor, and the acceleration sensor can be an accelerometer. The position change information is obtained through the gyroscope and accelerometer of the headset. For example, if it is calculated that the headset has moved x° and y° in the horizontal direction and vertical direction respectively, the headset needs to move in the opposite direction by the corresponding angle to obtain the new rotation parameters.

[0100] It is understandable that the gyroscope is used to detect the change in the rotation angle of the headset itself, the accelerometer can sense the acceleration of the headset in space, thereby determining its motion state and direction, and the distance sensor is responsible for measuring the straight-line distance between the headset and the conference materials. Through the coordinated work between the sensors, the headset can collect information such as the orientation and distance of the conference materials relative to the headset and the change in the user's perspective in real time, thereby updating the rotation parameters in real time, so that the shooting angle of the headset is always at the target shooting angle, improving the effectiveness and accuracy of the conference material recording.

[0101] This embodiment provides a method for controlling headphones. When the current shooting angle is not at the target shooting angle, the picture information captured by the headphones in the current picture information is analyzed, the horizontal deviation and vertical deviation of the conference material in the shooting picture are calculated, and the deviation information such as the horizontal deviation and the vertical deviation is mapped to the rotation parameters that need to be adjusted by the video module. Finally, the rotation mechanism is controlled by the rotation parameters to ensure that the shooting angle of the headphones is at the ideal shooting angle and the authenticity and integrity of the conference material records are ensured. At the same time, the position information of the headphones is detected in real time by the sensor, so that the headphones change with the passive changes of the shooting angle, that is, the rotation parameters of the headphones are dynamically updated, thereby improving the recording effect of the conference materials.

[0102] Based on the second embodiment of the present application, in the third embodiment of the present application, the same or similar content as the above-mentioned second embodiment can be referred to the above introduction, and will not be repeated later. On this basis, in addition to being able to automatically calibrate the current shooting angle, the headset can also automatically perform shooting focus processing to improve the accuracy and clarity of the conference material recording, and ensure that the content of the conference material is clearly and completely recorded. Therefore, when the current shooting angle is at the target shooting angle, or after the shooting angle of the headset is adjusted to the target shooting angle according to the rotation parameters, it is necessary to control the video module to perform the focusing action to improve the shooting clarity.

[0103] For details, please refer to Figure 3After step S10, the control of the earphone further includes step S50:

[0104] Step S50: If the current shooting angle is at the target shooting angle, the video module is controlled to perform a focusing action based on the preview image of the current shooting angle.

[0105] In this embodiment, after the headset is at an ideal shooting angle, the video module is controlled to perform a focusing action to improve the clarity of the captured video, thereby improving the clarity of the conference material recording. Among them, the focusing action is usually performed only when the current shooting angle is at the target shooting angle, so the action of step S50 can be performed after step S40.

[0106] Specifically, in the process of controlling the video module to perform the focusing action based on the preview image of the current shooting angle, it is also necessary to determine the specific focusing area and focusing parameters. Therefore, in this embodiment, step S50 also includes steps S51 to S53

[0107] Step S51, obtaining image parameters of the preview picture of the video module at the target shooting angle, and determining edge contour parameters of the preview picture after edge detection processing.

[0108] It should be noted that image parameters refer to the preliminary information in the preview screen, including image brightness, contrast, color distribution and other parameters, while edge contour parameters refer to the edge contour parameters of the screen edge when conference materials are displayed based on a projector screen, etc. The edge contour parameters also include brightness, contrast, color distribution and other parameters.

[0109] In this embodiment, after the headset completes the adjustment of the shooting angle, it quickly scans the shooting scene to obtain preliminary information of the image, including parameters such as image brightness, contrast, and color distribution. The preview image is then processed using an edge detection algorithm to identify the edge contour and edge contour parameters of the area where the conference materials are located in the image, so as to analyze the focus area that currently needs to be focused through the edge contour parameters and basic parameters in the preview image. The edge detection algorithm can be a conventional detection algorithm such as the Canny algorithm, the Sobel algorithm, etc., which is not limited in this application.

[0110] Step S52: determining a focus area based on the contrast and clarity change information between the image parameters and the edge contour parameters.

[0111] In this embodiment, image parameters and edge contour parameter values ​​are obtained, and by analyzing the clarity and contrast changes between these edge contours and image parameters, a possible focus area is preliminarily determined. For example, for conference materials containing text and charts, the edges of the text and charts usually have a high contrast and are easy to detect. Therefore, this area is the area that needs to be focused.

[0112] Optionally, the location of the conference materials can be identified through image recognition technology, so that the location of the conference materials is set as the focus area. The specific method of identifying the location of the conference materials is not limited in this application.

[0113] By determining the focus area, the focus parameters can be adjusted based on the focus area to avoid blurry or unclear recorded images due to focusing errors, thereby ensuring the integrity and clarity of the conference material records.

[0114] Step S53, determining a focus parameter of the video module according to the phase detection result of the focus area, and adjusting the focal length of the video module based on the focus parameter.

[0115] In this embodiment, within the determined focus area, phase detection autofocus (PDAF) technology can be used to perform focus detection processing. When light passes through the lens and focuses at different positions, different phase differences will be generated. At this time, the headset calculates the distance deviation between the lens and the photographed object based on these phase difference information. Among them, PDAF technology can simultaneously detect the phase difference of light by setting a special pixel structure on the image sensor. The phase detection result is the phase difference of light calculated by the headset.

[0116] Therefore, the focus drive device inside the headset video module can accurately adjust the focal length of the lens according to the calculated distance deviation, that is, determine the focus parameters that need to be adjusted based on the phase detection results, and adjust the focal length of the video module based on the focus parameters, so that the conference materials can be clearly presented in the shooting picture.

[0117] For example, when shooting a meeting document with text and charts, the focusing algorithm can identify the outlines of the text and charts, and then focus the lens to the position where these elements are presented most clearly, effectively avoiding problems such as blurred images and unclear focus caused by focusing errors, and ensuring the high quality of document records.

[0118] It is understandable that after the video module completes the focus, if the headset adjusts the shooting angle in real time due to the change in position, after the headset controls the operation of the rotation mechanism based on the updated rotation parameters, the headset automatically executes the action of step S50 to achieve dynamic focus when shooting conference materials.

[0119] This embodiment provides a method for controlling headphones. After completing the automatic adjustment of the shooting position of the headphones, the area that needs to be focused when shooting conference materials can be calculated based on the image parameters and edge contour parameters of the preview screen at the shooting position, and the focus parameters can be calculated based on the phase detection results of the area. Then, the focal length of the video module is adjusted to complete the focus processing of the conference materials, thereby improving the clarity of the captured conference materials. At the same time, the shooting angle is automatically adjusted, and the shooting area is automatically focused, without the need for manual adjustment by the user, thereby improving the efficiency of recording conference materials.

[0120] Based on any of the above embodiments, in the fourth embodiment of the present application, the same or similar contents as any of the above embodiments can be referred to the above description, and will not be described in detail later. On this basis, before determining whether the current shooting angle of the headset is at the target shooting angle, the side of the headset unit that needs to be shot can also be analyzed. For example, when shooting with one earphone, a relatively complete picture and video can be taken. At this time, the shooting angle can be verified or subsequently adjusted with one earphone, while the other earphone does not need to shoot or adjust the angle.

[0121] Optionally, see Figure 4 When shooting at the current shooting angle, both the left and right earphone units cannot capture the complete content on the conference material display screen within the adjustable shooting range. Therefore, it is necessary to shoot video through both earphone units at the same time.

[0122] Therefore, please refer to Figure 5 , step S10 also includes steps S11 to S12:

[0123] Step S11, if the process of photographing conference materials is triggered, the earphone unit to be photographed is determined according to the image information currently photographed by the earphone.

[0124] In this embodiment, when determining the headphone units to be photographed, the photographable range of each headphone unit can be determined by the currently photographed image information, wherein the photographable range refers to the corresponding photographing range of the video module under the maximum rotation limit of the rotating mechanism. Then, the number of headphones to be photographed is determined based on the photographable range. Specifically, when the photographable range of one of the headphone units covers the display interface of the conference materials, the number of headphone units to be photographed is determined to be one, otherwise, the number of headphone units to be photographed is determined to be two. That is, if the photographable ranges of both headphone units do not cover the display interface, or both cover the display interface, then the number of headphone units to be photographed is determined to be two.

[0125] For example, if the user is facing the conference material, the photographic range of each earphone unit side when wearing the earphone is as follows: Figure 4As shown, it can be seen that the shooting range of the two earphone units does not completely cover the display interface of the conference materials. At this time, the earphone units on both sides are required to shoot together and splice the captured content to obtain the complete conference material content.

[0126] Step S12, determining whether the current shooting angle of the headphone unit to be photographed is at the target shooting angle according to the shooting angle verification information of the headphone unit to be photographed;

[0127] After the headphone unit to be photographed is determined, it can be determined whether the current shooting angle of the headphone unit to be photographed is at the target shooting angle based on the shooting angle verification information of the headphone unit to be photographed. If the number of the headphone unit to be photographed is one, the step of determining whether the current shooting angle of the headphone is at the target shooting angle based on the shooting angle verification information of the headphone is performed based on the headphone unit to be photographed, so that the complete conference material can be photographed with one headphone unit.

[0128] Optionally, after determining the number of the earphone units to be photographed, if the number of the earphone units to be photographed is two, and the photographable range of the earphone units to be photographed does not cover the display interface of the conference materials, then based on the two earphone units to be photographed, step S10 is performed to determine whether the current shooting angle of the earphone is at the target shooting angle according to the shooting angle verification information of the earphone. Thus, the complete conference materials can be photographed with one earphone unit.

[0129] Optionally, when the earphone unit to be photographed is determined and the number of the earphone units to be photographed is two, if the photographable ranges of the two earphone units to be photographed both cover the display interface of the conference materials, then one earphone unit that meets the requirements can be selected to perform subsequent shooting actions, avoiding adjusting the two earphone units at the same time and reducing power consumption. Specifically, the action of step S10 can be performed based on the preset earphone unit, that is, when the above situation occurs, the subsequent shooting action is usually performed by the left earphone unit. In addition, in addition to being pre-set, the preset earphone unit can also be an earphone unit with a higher power, or a judgment is made based on both, that is, when the power of the two earphone units is the same, the left earphone unit is selected as the preset earphone unit. In addition, the preset earphone unit for shooting can also be selected based on the distance, such as performing the action of step S10 based on the earphone unit with a smaller distance from the display interface of the conference materials. It can be understood that, under normal circumstances, when the video module parameters of the earphone units are the same, the closer to the object to be photographed, the clearer the image captured. At this time, the shooting action is performed based on the earphone unit that shoots clearer, thereby improving the shooting effect of the conference materials.

[0130] This embodiment selects one or two earphone units as the earphone units for performing the conference material shooting action. This can effectively reduce the system power consumption caused by unnecessary adjustments of the dual-ear cameras at the same time before adjusting the shooting angle, improve the battery life when recording conference materials based on the earphone units, and thus improve the integrity of the conference material recording.

[0131] For example, in order to help understand the implementation process of the headset control method obtained by combining the present embodiment with the above embodiments, please refer to Figure 6 , the figure provides a flow chart of an optional implementation method of a headset control method, specifically: in the device startup stage, the participant turns on the headset with automatic camera calibration function. At this time, by detecting whether there is a data sharing operation in the conference software, or whether the participant triggers a shooting request operation on the Bluetooth headset operation interface, it is determined whether there is any conference data that needs to be photographed. If not, the headset enters a continuous monitoring state, that is, maintains a normal conference listening state and continuously monitors the display of new data, and turns off the headset device at the end of the meeting.

[0132] When there is currently a conference material being photographed, the process of photographing the conference material is triggered. At this time, it is necessary to first detect whether the current shooting angle of the headset meets the ideal shooting angle (not shown in the figure). If it does, the shooting action is directly executed to obtain photos and videos of the conference material. Further, if the ideal shooting angle is not met, it is determined that the angle of the unilateral or bilateral camera needs to be adjusted, that is, it is determined whether the shooting position is adjusted through the unilateral headset or the bilateral headset. After determining that the headset unit needs to be adjusted, in the process of rotating optimization, the automatic rotation function of the camera is started, and the rotation parameters are calculated at the same time. The camera is controlled to adjust the angle based on the calculated rotation parameters. After the complete angle adjustment, the camera needs to be focused, that is, the focus start-up phase is entered, and the camera starts the automatic focus function and performs automatic focus processing. Finally, after completing the focus processing, it is necessary to perform calibration detection. At this time, the headset system automatically performs automatic calibration detection of the shooting angle and determines whether the current shooting angle meets the ideal shooting angle. If it does not meet the angle, the headset unit needs to be readjusted. If it meets the angle, the photo action is performed until the headset device is turned off at the end of the meeting.

[0133] Therefore, by combining automatic rotation, automatic focus, and automatic calibration of shooting angles with headphones for shooting conference materials, the shortcomings of existing headphones in shooting conference materials are solved, the completeness and accuracy of conference material records are ensured, and the efficiency of recording conference materials is improved.

[0134] The present application provides an earphone, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the earphone control method in the above-mentioned first embodiment.

[0135] Reference below Figure 7 , which shows a schematic structural diagram of headphones suitable for implementing the embodiments of the present application. Figure 7 The earphones shown are merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0136] like Figure 7 As shown, the headset may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the headset are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the headset to communicate with other devices wirelessly or wired to exchange data. Although the headset with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0137] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0138] The headset provided by the present application adopts the headset control method in the above embodiment, which can solve the technical problem that the current headset is difficult to record visual data, resulting in incomplete recording of conference data. Compared with the prior art, the beneficial effects of the headset provided by the present application are the same as the beneficial effects of the headset control method provided by the above embodiment, and the other technical features of the headset are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0139] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0140] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0141] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the earphone control method in the above-mentioned embodiment.

[0142] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0143] The computer-readable storage medium may be contained in the earphone, or may exist independently without being assembled in the earphone.

[0144] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the headset, the headset:

[0145] If the shooting process of the conference material is triggered, the shooting angle verification information of the headset is used to determine whether the current shooting angle of the headset is at the target shooting angle;

[0146] If so, control the video module of the headset to perform a shooting action.

[0147] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0148] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0149] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0150] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned headset control method, and can solve the technical problem that the current headset is difficult to record visual data, resulting in incomplete conference data recording. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the headset control method provided by the above-mentioned embodiment, and will not be repeated here.

[0151] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A method for controlling a headset, characterized in that: The earphone control method comprises: If the shooting process of the conference material is triggered, the shooting angle verification information of the headset is used to determine whether the current shooting angle of the headset is at the target shooting angle; If so, control the video module of the headset to perform a shooting action.

2. The method for controlling the earphone according to claim 1, characterized in that: After the step of determining whether the current shooting angle of the headset is at the target shooting angle according to the shooting angle verification information of the headset if the shooting process of the conference data is triggered, the method further includes: If the current shooting angle is not at the target shooting angle, determining a rotation parameter of the video module, the rotation parameter including a horizontal rotation parameter and / or a vertical rotation parameter; Controlling the rotation mechanism of the headset to operate according to the horizontal rotation parameter and / or the vertical rotation parameter so that the shooting angle of the headset is at the target shooting angle; and / or If the current shooting angle is at the target shooting angle, the video module is controlled to perform a focusing action based on the preview image of the current shooting angle.

3. The method for controlling the earphone according to claim 2, characterized in that: The step of determining the rotation parameters of the video module comprises: Determine the horizontal angle and / or horizontal offset of the conference material according to the current picture information captured by the headset and the horizontal reference line; The horizontal rotation parameter of the video module is generated according to the horizontal angle and / or the horizontal offset of the picture.

4. The method for controlling the earphone according to claim 2, characterized in that: The step of determining the rotation parameters of the video module comprises: Determine the vertical angle and / or vertical offset of the conference material according to the current picture information captured by the headset and the vertical reference line; The vertical rotation parameter of the video module is generated according to the vertical angle and / or the vertical offset of the picture.

5. The method for controlling the earphone according to claim 2, wherein: After the step of determining the rotation parameters of the video module if the current shooting angle is not at the target shooting angle, the method further includes: If the position change process is triggered, obtaining the position change information of the earphone based on the position sensor and the acceleration sensor; The rotation parameter is updated according to the position change information.

6. The method for controlling the earphone according to any one of claims 2 to 5, characterized in that: The step of controlling the video module to perform a focusing action according to the preview image based on the current shooting angle comprises: Acquire image parameters of a preview picture of the video module at the target shooting angle, and determine edge contour parameters of the preview picture after edge detection processing; Determining a focus area based on contrast and clarity change information between the image parameters and the edge profile parameters; According to the phase detection result of the focus area, the focus parameter of the video module is determined, and the focal length of the video module is adjusted based on the focus parameter.

7. The method for controlling an earphone according to any one of claims 2 to 5, characterized in that: The step of verifying the shooting angle information of the headset to determine whether the current shooting angle of the headset is at the target shooting angle comprises: If the process of shooting conference materials is triggered, the headphone units to be shot are determined according to the image information currently shot by the headphone, wherein the number of the headphone units to be shot is one or two; According to the shooting angle verification information of the earphone unit to be photographed, it is determined whether the current shooting angle of the earphone unit to be photographed is located at the target shooting angle.

8. The method for controlling the earphone according to claim 7, characterized in that: If the number of the earphone units to be photographed is two, the step of determining whether the current shooting angle of the earphone units to be photographed is located at the target shooting angle according to the shooting angle verification information of the earphone units to be photographed comprises: If the photographable range of the earphone units to be photographed does not cover the display interface of the conference materials, based on the two earphone units to be photographed, performing the step of verifying the photographing angle of the earphone units to be photographed to determine whether the current photographing angle of the earphone units to be photographed is within the target photographing angle; or If the shootable range covers the display interface of the conference materials, the step of verifying the shooting angle of the headphone unit to be shot is performed based on the preset headphone unit to determine whether the current shooting angle of the headphone unit to be shot is within the target shooting angle.

9. The method for controlling earphones according to claim 7, characterized in that: The step of determining the headphone unit to be photographed according to the image information currently photographed by the headphone comprises: Determining the photographable range of each earphone unit according to the image information; If the photographable range of one of the earphone units exists, covering the display interface of the conference materials, it is determined that the number of the earphone units to be photographed is one; Otherwise, it is determined that the number of the earphone units to be photographed is two.

10. The method for controlling earphones according to claim 1, characterized in that: Before the step of determining whether the current shooting angle of the headset is at the target shooting angle according to the shooting angle verification information of the headset if the shooting process of the conference data is triggered, the method further includes: In response to the conference material sharing process, triggering the process of photographing the conference material; or In response to the received shooting instruction, the shooting process of the conference material is triggered.

11. An earphone, characterized in that: The headset comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the headset control method according to any one of claims 1 to 10.

12. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the method for controlling the earphone according to any one of claims 1 to 10 are implemented.

Images