A control method, device and recording equipment
By obtaining and parsing the motion information of the recording device to control the recording device, the problem of cumbersome operation of the recording device is solved and a more convenient user interaction experience is achieved.
Patent Information
- Application Number
- CN202011043934.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-28
- Publication Date
- 2025-05-13
- Estimated Expiration
- 2040-11-05
AI Technical Summary
The large recording device makes it difficult for users to operate physical buttons or display screens with one hand, and the display screen needs to enter the current interface before clicking, resulting in cumbersome operation.
By acquiring the motion information of the recording device, the recording device is controlled based on this information, and for example, by shaking the recording device, it can start recording, pause recording, switch mode and other operations.
It simplifies the interaction process between users and recording devices, avoids the difficulty of manually operating physical buttons or display screens, and improves the convenience of operation and user experience.
Smart Images

Figure CN114283856B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data processing, and in particular to a control method, device and recording equipment. Background Art
[0002] In recent years, recording equipment, as a product in the professional field, has developed rapidly and entered the public field. Various groups such as journalists, students, and teachers usually need recording equipment for recording. In addition, recording equipment is also needed for recording various TV programs, movies, music, etc.
[0003] The recording device is provided with physical buttons or display screens, and the user can manually operate the physical buttons or buttons on the screen of the recording device to control the recording device to start recording, pause recording, switch to various modes, post-process the recording data, etc. If the recording device is large, it will be difficult for the user to operate the physical buttons or display screen with one hand; and if the display screen is operated, the user must enter the current interface before clicking, which is cumbersome. Summary of the invention
[0004] The embodiment of the present invention provides a control method to simplify the operation during the interaction between a user and a recording device.
[0005] Correspondingly, the embodiment of the present invention also provides a control device and a recording device to ensure the implementation and application of the above method.
[0006] In order to solve the above problem, an embodiment of the present invention discloses a control method, which specifically includes: acquiring motion information of a recording device; and controlling the recording device based on the motion information.
[0007] Optionally, controlling the recording device based on the motion information includes: determining a control instruction corresponding to the motion information; and executing a control operation corresponding to the control instruction.
[0008] Optionally, determining the control instruction corresponding to the motion information includes: searching for a target trigger condition satisfied by the motion information from preset trigger conditions; and searching for a mapping relationship based on the target trigger condition to determine the control instruction corresponding to the motion information.
[0009] Optionally, the motion information includes: shaking times, shaking direction and shaking rate; the trigger condition includes: trigger shaking times, trigger shaking direction and trigger shaking rate; searching the target trigger condition satisfied by the motion information from the preset trigger conditions includes: for each preset trigger condition, comparing the shaking times in the motion information with the trigger shaking times in the trigger condition, comparing the shaking direction with the trigger shaking direction, and comparing the shaking rate with the trigger shaking rate; if the shaking times in the motion information match the trigger shaking times in the trigger condition, the shaking direction matches the trigger shaking direction, and the shaking rate matches the trigger shaking rate, then the trigger condition is determined as the target trigger condition.
[0010] Optionally, the recording device is provided with an information collection module, and the obtaining of the motion information of the recording device includes: obtaining sensor information collected by the information collection module in the recording device; and determining the motion information of the recording device based on the sensor information.
[0011] Optionally, the method further includes: providing prompts based on control results.
[0012] The embodiment of the present invention further discloses a control device, which specifically includes: an acquisition module, used to acquire motion information of a recording device; and a control module, used to control the recording device based on the motion information.
[0013] Optionally, the control module includes: an instruction determination submodule, used to determine the control instruction corresponding to the motion information; and an operation execution submodule, used to execute the control operation corresponding to the control instruction.
[0014] Optionally, the instruction determination submodule is used to search for a target trigger condition satisfied by the motion information from preset trigger conditions; and search for a mapping relationship based on the target trigger condition to determine a control instruction corresponding to the motion information.
[0015] Optionally, the motion information includes: shaking times, shaking direction and shaking rate; the trigger condition includes: trigger shaking times, trigger shaking direction and trigger shaking rate; the instruction determination submodule is used to compare the shaking times in the motion information with the trigger shaking times in the trigger condition, the shaking direction with the trigger shaking direction, and the shaking rate with the trigger shaking rate for each preset trigger condition; if the shaking times in the motion information match the trigger shaking times in the trigger condition, the shaking direction matches the trigger shaking direction, and the shaking rate matches the trigger shaking rate, the trigger condition is determined as the target trigger condition.
[0016] Optionally, the recording device is provided with an information collection module, and the acquisition module is used to acquire sensor information collected by the information collection module in the recording device; based on the sensor information, determine the motion information of the recording device.
[0017] Optionally, the device further comprises: a prompt module, configured to provide a prompt based on the control result.
[0018] The embodiment of the present invention further discloses a readable storage medium. When the instructions in the storage medium are executed by the processor of the recording device, the recording device can execute the control method as described in any one of the embodiments of the present invention.
[0019] An embodiment of the present invention also discloses a recording device, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: obtaining motion information of the recording device; and controlling the recording device based on the motion information.
[0020] Optionally, controlling the recording device based on the motion information includes: determining a control instruction corresponding to the motion information; and executing a control operation corresponding to the control instruction.
[0021] Optionally, determining the control instruction corresponding to the motion information includes: searching for a target trigger condition satisfied by the motion information from preset trigger conditions; and searching for a mapping relationship based on the target trigger condition to determine the control instruction corresponding to the motion information.
[0022] Optionally, the motion information includes: shaking times, shaking direction and shaking rate; the trigger condition includes: trigger shaking times, trigger shaking direction and trigger shaking rate; searching the target trigger condition satisfied by the motion information from the preset trigger conditions includes: for each preset trigger condition, comparing the shaking times in the motion information with the trigger shaking times in the trigger condition, comparing the shaking direction with the trigger shaking direction, and comparing the shaking rate with the trigger shaking rate; if the shaking times in the motion information match the trigger shaking times in the trigger condition, the shaking direction matches the trigger shaking direction, and the shaking rate matches the trigger shaking rate, then the trigger condition is determined as the target trigger condition.
[0023] Optionally, the recording device is provided with an information collection module, and the obtaining of the motion information of the recording device includes: obtaining sensor information collected by the information collection module in the recording device; and determining the motion information of the recording device based on the sensor information.
[0024] Optionally, it also includes instructions for performing the following operations: providing prompts based on control results.
[0025] The embodiments of the present invention include the following advantages:
[0026] In the embodiment of the present invention, the motion information of the recording device can be obtained, and then the recording device can be controlled based on the motion information; thereby, the user can control the recording device by holding the recording device and driving the recording device to move through hand movements; there is no need to manually operate the physical buttons or display device of the recording device, which solves the problem that the recording device is large and makes it difficult for the user to operate the physical buttons or display screen with one hand; and the problem that when the display screen is operated, the user must enter the current interface before clicking, resulting in cumbersome operations; and simplifies the operations during the user's interaction with the recording device. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 is a flow chart of steps of an embodiment of a control method of the present invention;
[0028] Figure 2 is a flow chart of steps of an optional embodiment of a control method of the present invention;
[0029] Figure 3 is a flowchart of steps of another optional embodiment of the control method of the present invention;
[0030] Figure 4 is a structural block diagram of an embodiment of a control device of the present invention;
[0031] Figure 5 is a structural block diagram of an optional embodiment of a control device of the present invention;
[0032] Figure 6 A structural block diagram of a recording device for control is shown according to an exemplary embodiment. DETAILED DESCRIPTION
[0033] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0034] In the prior art, the interaction between the user and the recording device, such as controlling the recording device to start recording, pause recording, switch to various modes, post-process the recording data, etc., requires the user to manually operate the physical buttons of the recording device or the buttons on the screen. If the recording device is large, it is difficult for the user to operate the physical buttons or the display screen with one hand; and if the display screen is operated, the user must enter the current interface before clicking, which is cumbersome.
[0035] Therefore, an embodiment of the present invention provides a control method, which can control a recording device based on the motion information of the recording device; thereby enabling a user to control the recording device by holding the recording device and driving the recording device to move through hand movements, thereby simplifying operations during the user's interaction with the recording device.
[0036] Among them, a control method provided in an embodiment of the present invention can be executed by a recording device; the recording device can be a recording device, and the recording device can refer to a device with a recording function, such as a recording pen, a translation pen, a translation machine, etc., which is not limited in the embodiment of the present invention. The recording device can also be other devices except the recording device, and the other devices can be terminal devices or servers, which is not limited in the embodiment of the present invention.
[0037] The following description is made by taking a recording device that executes the control method provided in an embodiment of the present invention as an example.
[0038] The recording device may be provided with a voice collection module for collecting voice data; the language collection module may be a microphone array, and the microphone array may include an omnidirectional microphone array and / or a directional microphone array, which is not limited in the embodiment of the present invention.
[0039] In addition, the recording device may be provided with a display screen or may not be provided with a display screen; the recording device may be provided with physical buttons or may not be provided with physical buttons; the embodiment of the present invention does not limit this.
[0040] Reference Figure 1 , shows a flow chart of steps of a control method embodiment of the present invention, which may specifically include the following steps:
[0041] Step 102: Obtain motion information of the recording device.
[0042] Step 104: Control the recording device based on the motion information.
[0043] In an embodiment of the present invention, when the user needs to control the recording device, such as controlling the recording device to start recording, pause recording, switch to various modes, post-process the recording data, etc., the user can hold the recording device and drive the recording device to move through hand movements, such as shaking the recording device.
[0044] The recording device can monitor its own motion state. After the user holds the recording device and drives the recording device to move through hand movements, the recording device can obtain its own motion information; and then control the recording device according to the motion information; for example, according to the motion information, the various functions of the recording device can be controlled to be turned on / off, switched, etc., such as: controlling the recording device to turn on / off recording, controlling the recording device to switch recording modes, etc.
[0045] In summary, in the embodiments of the present invention, the motion information of the recording device can be obtained, and then the recording device can be controlled based on the motion information; thereby, the user can control the recording device by holding the recording device and driving the recording device to move through hand movements; there is no need to manually operate the physical buttons or display device of the recording device, which solves the problem that the recording device is large, making it difficult for the user to operate the physical buttons or display screen with one hand; and the problem that when the display screen is operated, the user must enter the current interface before clicking, resulting in cumbersome operations; and simplifies the operations during the user's interaction with the recording device.
[0046] Secondly, the existing method of controlling the recording device by manually operating the physical buttons of the recording device or the buttons on the display device requires the recording device to be provided with physical buttons or display devices; and the provision of physical buttons / display screens has certain requirements for the hardware structure design of the recording pen, such as size, position, pressing force, waterproofing, etc., and each person's usage habits are different, and physical buttons may not bring a good user experience to all users. By adopting the control method provided in the embodiment of the present invention, even if no physical buttons or display devices are provided in the recording device, the recording device can be controlled, reducing the hardware and design requirements for the recording device.
[0047] In one embodiment of the present invention, controlling the recording device based on the motion information may include: determining a control instruction corresponding to the motion information; and executing a control operation corresponding to the control instruction. Then, the recording device is controlled by executing the corresponding control operation according to the motion information of the recording device.
[0048] The following describes how to determine the control instruction corresponding to the motion information.
[0049] Reference Figure 2 , shows a flow chart of steps of an optional embodiment of a control method of the present invention, which may specifically include the following steps:
[0050] Step 202: Acquire sensor information collected by the information collection module in the recording device.
[0051] Step 204: Determine the motion information of the recording device based on the sensor information.
[0052] In the embodiment of the present invention, the recording device may be provided with an information collection module such as a gravity acceleration sensor, a gyroscope, a camera, etc., which can collect information during the movement of the recording device to obtain corresponding sensor information.
[0053] Wherein, the motion information may refer to information related to the motion of the recording device. When the information acquisition module is a gyroscope, the sensor information may include: angle information; the angle information may refer to the angle information between the recording device and the reference position. Then, it is possible to first determine whether the recording device is moving based on the angle information; when it is determined that the recording device is moving, the angle information acquired by the gyroscope may continue to be acquired until it is determined that the recording device stops moving based on the angle information; then, the angle information acquired during the time period from when the recording device starts moving to when it stops moving is used to calculate the motion information. When the information acquisition module is a camera, the sensor information may include: image information. Then, it is possible to first determine whether the recording device is moving based on the image information; when it is determined that the recording device is moving, the image information acquired by the camera may continue to be acquired until it is determined that the recording device stops moving based on the image information; then, the image information acquired during the time period from when the recording device starts moving to when it stops moving is used to calculate the motion information.
[0054] In an optional embodiment of the present invention, the user can control the recording device by holding the recording device and shaking it. Correspondingly, the motion information may include: the number of shakes, the shaking direction, and the shaking speed; of course, it may also include other information such as the shaking angle, which is not limited in the embodiment of the present invention.
[0055] Step 206: Search for a target trigger condition satisfied by the motion information from among preset trigger conditions.
[0056] Step 208: Search for a mapping relationship based on the target trigger condition to determine a control instruction corresponding to the motion information.
[0057] In an embodiment of the present invention, control instructions corresponding to various functions in the recording device may be predetermined; for example, for the recording function, the corresponding control instructions may include: a recording start instruction, a recording pause instruction, a recording continuation instruction, and a recording stop instruction. For another example, for the translation function, the corresponding control instructions may include: a translation function start instruction and a translation function stop instruction. For another example, for the simultaneous interpretation function, the corresponding control instructions may include: a simultaneous interpretation function start instruction and a simultaneous interpretation function stop instruction. For another example, for the recording mode switching function, the corresponding control instructions may include: a conference mode switching instruction, a lecture mode switching instruction, an interview mode switching instruction, and a concert mode switching instruction. For another example, for the "one-to-one" dialogue function, the corresponding control instructions may include: a "one-to-one" dialogue instruction. For another example, for the editing function, the corresponding control instructions may include editing instructions, and the editing instructions may include multiple types, such as voice data deletion instructions, sound effect addition instructions, and the like. For another example, for the transcription function, the corresponding control instructions may include transcription instructions to transcribe voice data into text. Of course, when the recording device also includes other functions such as a memo function, the control instructions may include control instructions for controlling other functions of the recording device, such as instructions for turning on the memo function and turning off the memo function, etc., and the embodiment of the present invention does not limit this.
[0058] And trigger conditions corresponding to various control instructions can be pre-set, so that when the motion information meets a certain trigger condition, the control instruction corresponding to the trigger condition can be triggered to generate; and then the control operation corresponding to the control instruction is executed.
[0059] For one control instruction, one trigger condition or multiple trigger conditions can be set; and the trigger conditions corresponding to different control instructions can be different or the same, which is not limited in the embodiment of the present invention. The trigger conditions can include: the number of trigger shakes, the direction of trigger shakes, and the rate of trigger shakes; the number of trigger shakes and the rate of trigger shakes can be a specific value or a range of values, which is not limited in the embodiment of the present invention.
[0060] For example, for the command to start recording, the corresponding trigger conditions may be: the number of trigger shakes is 2, the trigger shake direction is up and down, and the trigger shake rate is 3 cm / s to 5 cm / s.
[0061] For example, for the translation command, the corresponding trigger conditions may be: the number of trigger shakes is 2, the trigger shake direction is left and right, and the trigger shake rate is 2 cm / s to 3 cm / s.
[0062] For example, for the instruction to start simultaneous interpretation, the corresponding trigger conditions may be: the number of trigger shakes is 2, the direction of trigger shakes is left and right, and the rate of trigger shakes is 5 cm / s to 7 cm / s.
[0063] Of course, the trigger condition may also include a trigger shaking angle, which may be set as required, and the embodiment of the present invention does not limit this. When the trigger condition also includes a trigger shaking angle:
[0064] For example, for the command to start recording, the corresponding trigger conditions may be: the number of trigger shakes is 2, the trigger shake direction is up and down, the trigger shake rate is 3 cm / s to 5 cm / s, and the trigger shake angle is 30° to 45°.
[0065] For example, for the translation command, the corresponding trigger conditions may be: the number of trigger shakes is 2, the trigger shake direction is left and right, the trigger shake rate is 2 cm / s to 3 cm / s, and the trigger shake angle is 30° to 45°.
[0066] For example, for the command to start simultaneous interpretation, the corresponding trigger conditions may be: the number of trigger shakes is 2, the trigger shake direction is left and right, the trigger shake rate is 5 cm / s to 7 cm / s, and the trigger shake angle is 50° to 90°.
[0067] In the embodiment of the present invention, the recording device may automatically set the triggering conditions corresponding to each control instruction; or the recording device may set the user-defined triggering conditions according to the user operation, which is not limited in the embodiment of the present invention.
[0068] Therefore, after determining the motion information of the recording device, the trigger condition satisfied by the motion information can be searched from the preset trigger conditions; wherein, for the convenience of subsequent description, the trigger condition satisfied by the motion state can be referred to as the target trigger condition. Then, based on the pre-established mapping relationship, the control instruction corresponding to the target trigger condition is searched from the mapping relationship, thereby obtaining the control instruction corresponding to the motion information.
[0069] In one embodiment of the present invention, searching for a target trigger condition satisfied by the motion information from preset trigger conditions may include the following sub-steps S22-S24:
[0070] Sub-step S22: for each preset trigger condition, compare the shaking times in the motion information with the trigger shaking times in the trigger condition, compare the shaking direction with the trigger shaking direction, and compare the shaking rate with the trigger shaking rate.
[0071] Sub-step S24: if the number of shakes in the motion information matches the number of trigger shakes in the trigger condition, the shaking direction matches the trigger shaking direction, and the shaking rate matches the trigger shaking rate, then the trigger condition is determined as the target trigger condition.
[0072] In the embodiment of the present invention, when the same trigger condition is set for multiple control instructions in advance, the determined target trigger condition may include multiple ones; correspondingly, the control instructions corresponding to the motion information may also include multiple ones. Then, the control instruction finally corresponding to the motion information may be screened out according to the current use status of the recording device.
[0073] For example, the same trigger condition is set for the recording on command and the recording off command; if the target trigger condition includes: the trigger condition for the recording on command and the trigger condition for the recording off command; correspondingly, the control instruction finally corresponding to the motion information includes: the recording on command and the recording off command. Then it is determined whether the recording device has turned on recording. If the recording device has turned on recording, the control instruction finally corresponding to the motion information is filtered out as: the recording off command; if the recording device has not turned on recording, the control instruction finally corresponding to the motion information is filtered out as: the recording on command.
[0074] Another example: the same trigger condition is set for the instruction to turn off translation and the instruction to turn off simultaneous interpretation; if the target trigger condition includes: the trigger condition for turning off translation and the trigger condition for turning off simultaneous interpretation; correspondingly, the control instruction that the motion information finally corresponds to includes: the trigger condition for turning on recording and the trigger for turning off recording. Then it is determined whether the recording device is in the translation state or the simultaneous interpretation state. If the recording device is in the translation state, the control instruction that the motion information finally corresponds to is filtered out as: the instruction to turn off translation; if the recording device is in the simultaneous interpretation, the control instruction that the motion information finally corresponds to is filtered out as: the instruction to turn off simultaneous interpretation.
[0075] Step 210: Execute the control operation corresponding to the control instruction.
[0076] In the embodiment of the present invention, when the control instructions are different, the operations performed by the recording device are also different accordingly, which can be as follows:
[0077] When the control instruction is a recording start instruction, the recording start operation is performed.
[0078] When the control instruction is a recording start instruction, the recording device performs a recording start operation, and then the recording function of the recording device is turned on, and the recording device enters a recording state. Thus, the user can turn on the recording function of the recording device by shaking the recording device, and then use the recording device to record.
[0079] When the control instruction is a recording pause instruction, a recording pause operation is performed.
[0080] When the control instruction is a pause recording instruction, the recording device can perform a pause recording operation, and then the recording device pauses recording. Therefore, during the recording process using the recording device, the user can control the recording device to pause recording by shaking the recording device.
[0081] When the control instruction is a continue recording instruction, a continue recording operation is performed.
[0082] When the control instruction is a continue recording instruction, the recording device can execute a continue recording operation, and then the recording device continues recording. Therefore, after the recording device pauses recording during recording using the recording device, the user can control the recording device to continue recording by shaking the recording device.
[0083] When the control instruction is a recording off instruction, a recording off operation is performed.
[0084] When the control instruction is a recording off instruction, the recording device performs a recording off operation, and the recording function of the recording device is turned off. Thus, the user can turn off the recording function of the recording device by shaking the recording device.
[0085] In the embodiment of the present invention, the user can turn on or off the recording function of the recording device by shaking the recording device; and during the recording process, the user can control the recording device to pause or continue recording by shaking the recording device; thereby, the recording device can be controlled to record without the user manually triggering a button or display device in the recording device, which is easy to operate and can improve the user experience.
[0086] When the control instruction is an instruction to start the translation function, an operation of starting the translation function is performed.
[0087] When the control instruction is an instruction to turn on the translation function, the recording device can execute the operation of turning on the translation function; and then the translation function of the recording device is turned on. If the recording is currently in progress, the shortened voice data can be translated after each voice data segment is collected; if the recording is currently finished, the previous recording data can be translated.
[0088] When the control instruction is an instruction for turning off the translation function, an operation of turning off the translation function is performed.
[0089] When the control instruction is a translation function off instruction, the recording device can execute the translation function off operation; and then the translation function of the recording device is turned on. If the recording is currently in progress, the translation of each collected voice data can be stopped; if the recording is currently finished, the translation of the previous recording data can be stopped.
[0090] When the control instruction is an instruction for starting the simultaneous interpretation function, an operation for starting the simultaneous interpretation function is executed.
[0091] When the control instruction is an instruction to turn on the simultaneous interpretation function, the recording device can execute the operation of turning on the simultaneous interpretation function; then the simultaneous interpretation function of the recording device is turned on; thus, the recording device can perform simultaneous interpretation on the currently collected voice data in real time.
[0092] When the control instruction is an instruction for closing the simultaneous interpretation function, an operation of closing the simultaneous interpretation function is performed.
[0093] When the control instruction is an instruction to turn off the simultaneous interpretation function, the recording device can execute the operation of turning off the simultaneous interpretation function; thereby the simultaneous interpretation function of the recording device is turned off; thereby the recording device can stop real-time simultaneous interpretation of the currently collected voice data.
[0094] In an embodiment of the present invention, the user can turn on / off the translation function of the recording device and the simultaneous interpretation function of the recording device by shaking the recording device; thereby, the translation / simultaneous interpretation of the recording device can be controlled without the user manually triggering a button in the recording device, which is easy to operate and can improve the user experience.
[0095] When the control instruction is a conference mode switching instruction, an operation of switching to the conference mode is executed.
[0096] When the control instruction is a conference mode switching instruction, the recording device can execute the operation of switching to the conference mode, thereby switching the recording mode of the recording device to the conference mode. Thus, the user can use the recording device to record in the conference mode.
[0097] When the control instruction is a lecture mode switching instruction, an operation of switching to the lecture mode is executed.
[0098] When the control instruction is a lecture mode switching instruction, the recording device can execute the operation of switching to the lecture mode, thereby switching the recording mode of the recording device to the lecture mode. Thus, the user can use the recording device to record in the lecture mode.
[0099] When the control instruction is an interview mode switching instruction, an operation of switching to the interview mode is executed.
[0100] When the control instruction is an interview mode switching instruction, the recording device can execute the operation of switching to the interview mode, thereby switching the recording mode of the recording device from the current recording mode to the interview mode. Thus, the user can use the recording device to record in the interview mode.
[0101] Among them, after the recording mode of the recording device is switched to the interview mode, when the control command is a "one-to-one" conversation command, the recording device can be controlled to perform a "one-to-one" conversation recording.
[0102] When the control instruction is a concert mode switching instruction, an operation of switching to the concert mode is executed.
[0103] When the control instruction is a concert mode switching instruction, the recording device can execute the operation of switching to the concert mode, thereby switching the recording mode of the recording device to the concert mode. Thus, the user can use the recording device to record in the concert mode, which can achieve better recording effect.
[0104] In the embodiment of the present invention, the user can control the recording device to switch the recording mode by shaking the recording device; compared with the prior art, when the recording mode needs to be switched during the recording process, it is necessary to exit the recording and then manually switch the recording mode, the embodiment of the present invention can quickly and easily control the recording device to switch the recording mode, thereby improving the user experience.
[0105] During the recording process or after the recording device is finished, when the control instruction is an editing instruction, a voice editing operation is performed.
[0106] When the control instruction is an editing instruction, the voice editing operation is performed, and the voice data can be edited. When the editing instruction is an add sound effect instruction, the corresponding operation of adding sound effects can be performed, such as adding applause and laughter; when the editing instruction is voice data deletion, the corresponding operation of deleting voice data can be performed, such as deleting the wrong part of the recording just now, removing the empty recording part (long pause time) in the recording, etc.
[0107] In the embodiment of the present invention, not only can the user control the recording device to edit by shaking it after the recording is finished, but also can control the recording device to edit by shaking it during the recording process. For example, when the user of the recording device thinks that the speaker's speech is wonderful, the user can shake the recording device left and right 3 times, each time at a rate of 2cm / s to 3cm / s, to add applause to a section of voice data that is closer to the current time. For another example, the speaker says "I'm sorry, I just said it wrong"; the user of the recording device can shake the recording device left and right 3 times, each time at a rate of 4cm / s to 5cm / s, to delete a section of voice data that is closer to the current time, and so on. Compared with the prior art that can only edit voice data after the recording is finished and needs to operate on a specified interface, the user in the embodiment of the present invention can control the recording device to edit voice data by shaking the recording device, and can also edit voice data during the recording process, thereby realizing simple, real-time and efficient editing of voice data, and improving user experience.
[0108] During the recording process or after the recording device is finished, when the control instruction is a transcription instruction, a transcription operation is performed.
[0109] When the control instruction is a transcription instruction, the transcription operation is performed, and the voice data is transcribed into text information. In the embodiment of the present invention, the user can control the recording device to transcribe by voice not only after the recording is finished, but also during the recording process; the embodiment of the present invention does not limit this.
[0110] When the control instruction is an open memo instruction, the open memo operation is performed, and then the recording device can open the memo and store the collected voice data in the memo. When the control instruction is a close memo instruction, the close memo operation is performed, and then the memo is closed.
[0111] In summary, the present invention determines whether to execute a control operation by setting a trigger condition and judging whether the motion information satisfies the trigger condition. This can avoid erroneous operations caused by accidental touches when the voice recorder has many physical buttons.
[0112] Secondly, the trigger condition can be set by the recording device, and when the function of the recording device is increased, the corresponding trigger condition can be added accordingly; it has strong scalability. In addition, the trigger condition can also be customized by the user, so that the user can control the recording device according to his own habits, which is more personalized and improves the user experience.
[0113] In one embodiment of the present invention, after the recording device controls itself, it can also prompt the user based on the control result to prompt whether the control is successful, thereby further improving the user experience.
[0114] Reference Figure 3 , shows a step flow chart of another optional embodiment of the control method of the present invention.
[0115] Step 302: Obtain motion information of the recording device.
[0116] Step 304: Control the recording device based on the motion information.
[0117] Among them, step 302 to step 304 can be similar to the above-mentioned step 202 to step 208, and will not be repeated here.
[0118] Step 306: Prompt based on the control result.
[0119] In an embodiment of the present invention, after the recording device is controlled, the control result can be determined; and then a prompt can be given based on the control result. The control result may include: the result of successfully controlling the recording device based on the motion information (which may be referred to as a successful control result), and the result of failing to control the recording device based on the motion information (which may be referred to as a failed control result). When the user determines that the recording device is successfully controlled based on the prompt, the user may continue to shake the recording device to control the recording device; of course, the user may not perform any operation. When the user determines that the recording device is unsuccessful based on the prompt, the user may shake the recording device again in the same manner as the last time the recording device was shaken, so as to control the recording device again.
[0120] In the embodiment of the present invention, there may be multiple ways of providing prompts based on the control results, such as voice prompts, vibration prompts, light prompts, etc., which are not limited in the embodiment of the present invention.
[0121] For example: Let's take voice prompt as an example.
[0122] For example, in a departmental meeting, when entering a demonstration video or taking a break, the recording needs to be paused. The meeting organizer can shake the recording device up and down 3 times, each time at a rate of 2cm / s to 3cm / s. If the recording device pauses the recording, it can broadcast: "Recording has been paused"; at this time, the meeting organizer does not need to perform any operation. If the recording device fails to pause the recording, it can broadcast: "Recording failed to pause successfully"; at this time, the meeting organizer shakes the recording device up and down 3 times again, each time at a rate of 2cm / s to 3cm / s; to control the recording device to pause the recording again.
[0123] For example, in the scenario of a technical sharing meeting, the speaker will mainly give a technical sharing speech in the first half of the meeting. If the recording mode is set to the "listening mode" with better directionality, the recording effect will be better. In the second half, everyone needs to ask questions and discuss. If the recording mode is switched to the "conference mode" with 360-degree sound reception, the recording effect will be better. Therefore, at the beginning of the meeting, the meeting organizer can shake the recording device left and right 5 times, each time at a rate of 2cm / s to 3cm / s. When the recording device switches the recording mode to the "listening mode", it can broadcast: "Switch to the listening mode" and then continue recording. At this time, the meeting organizer does not need to perform any operation. If the recording device fails to switch to the listening mode, it can broadcast: "Listening mode failed to switch successfully". At this time, the meeting organizer shakes the recording device left and right 5 times again, each time at a rate of 2cm / s to 3cm / s, to control the recording device to switch to the listening mode again. When entering the question and discussion session, the conference organizer can shake the recording device left and right 7 times, each time at a rate of 2cm / s to 3cm / s; when the recording device switches the recording mode to "conference mode", it can broadcast: "Switch to conference mode" and then continue recording; at this time, the conference organizer does not need to perform any operation. If the recording device fails to switch to conference mode, it can broadcast: "Conference mode failed to switch successfully"; at this time, the conference organizer can shake the recording device left and right 7 times again, each time at a rate of 2cm / s to 3cm / s; to control the recording device to switch to conference mode again.
[0124] There are many ways to provide vibration prompts, such as prompts based on the number of vibrations. For example, a successful control result can correspond to one vibration; a failed control result can correspond to two vibrations. Another example is based on the duration of vibration. A successful control result can correspond to 0.5 seconds of vibration; a failed control result can correspond to 3 seconds of vibration. There are also many ways to provide light prompts, such as prompting a successful control result based on the color of the light, with a green light on; and a failed control result, with a red light on. Another example is based on the frequency of light flashing. For example, a successful control result can correspond to 10 flashes per second; a failed control result can correspond to 20 flashes per second, and so on.
[0125] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0126] Reference Figure 4 , shows a structural block diagram of a control device embodiment of the present invention, which may specifically include the following modules:
[0127] An acquisition module 402 is used to acquire motion information of a recording device;
[0128] The control module 404 is used to control the recording device based on the motion information.
[0129] Reference Figure 5 , shows a structural block diagram of an optional embodiment of a control device of the present invention.
[0130] In an optional embodiment of the present invention, the control module 404 includes:
[0131] An instruction determination submodule 4042 is used to determine a control instruction corresponding to the motion information;
[0132] The operation execution submodule 4044 is used to execute the control operation corresponding to the control instruction.
[0133] In an optional embodiment of the present invention, the instruction determination submodule 4042 is used to search for a target trigger condition satisfied by the motion information from preset trigger conditions; and to search for a mapping relationship based on the target trigger condition to determine a control instruction corresponding to the motion information.
[0134] In an optional embodiment of the present invention, the motion information includes: shaking times, shaking direction and shaking rate; the trigger condition includes: trigger shaking times, trigger shaking direction and trigger shaking rate; the instruction determination submodule 4042 is used to compare the shaking times in the motion information with the trigger shaking times in the trigger condition, the shaking direction with the trigger shaking direction, and the shaking rate with the trigger shaking rate for each preset trigger condition; if the shaking times in the motion information match the trigger shaking times in the trigger condition, the shaking direction matches the trigger shaking direction, and the shaking rate matches the trigger shaking rate, the trigger condition is determined as the target trigger condition.
[0135] In an optional embodiment of the present invention, the recording device is provided with an information collection module, and the acquisition module 402 is used to obtain the sensor information collected by the information collection module in the recording device; based on the sensor information, the motion information of the recording device is determined.
[0136] In an optional embodiment of the present invention, the device further comprises:
[0137] The prompt module 406 is used to provide prompts based on the control results.
[0138] In summary, in the embodiments of the present invention, the motion information of the recording device can be obtained, and then the recording device can be controlled based on the motion information; thereby, the user can control the recording device by holding the recording device and driving the recording device to move through hand movements; there is no need to manually operate the physical buttons or display device of the recording device, which solves the problem that the recording device is large, making it difficult for the user to operate the physical buttons or display screen with one hand; and the problem that when the display screen is operated, the user must enter the current interface before clicking, resulting in cumbersome operations; and simplifies the operations during the user's interaction with the recording device.
[0139] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0140] Figure 6 1 is a block diagram of a recording device 600 for control according to an exemplary embodiment. For example, the recording device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0141] Reference Figure 6 The recording device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .
[0142] The processing component 602 generally controls the overall operation of the recording device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 602 may include one or more modules to facilitate interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.
[0143] The memory 604 is configured to store various types of data to support the operation of the recording device 600. Examples of such data include instructions for any application or method operating on the recording device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0144] The power component 606 provides power to the various components of the recording device 600. The power component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the recording device 600.
[0145] The multimedia component 608 includes a screen that provides an output interface between the recording device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the recording device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0146] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the recording device 600 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.
[0147] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0148] The sensor assembly 614 includes one or more sensors for providing various aspects of the status assessment of the recording device 600. For example, the sensor assembly 614 can detect the open / closed state of the recording device 600, the relative positioning of components, such as the display and keypad of the recording device 600, the sensor assembly 614 can also detect the position change of the recording device 600 or a component of the recording device 600, the presence or absence of user contact with the recording device 600, the position or acceleration / deceleration of the recording device 600, and the temperature change of the recording device 600. The sensor assembly 614 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0149] The communication component 616 is configured to facilitate wired or wireless communication between the recording device 600 and other devices. The recording device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0150] In an exemplary embodiment, the recording device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.
[0151] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, and the instructions can be executed by the processor 620 of the recording device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0152] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a recording device, enables the recording device to perform a control method, the method comprising:
[0153] (I will improve it after the draft is confirmed)
[0154] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0155] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0156] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0157] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0158] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0159] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0160] The control method, the control device and the recording device provided by the present invention are introduced in detail above. The principle and implementation mode of the present invention are explained in detail by using specific examples. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation mode and the scope of application. In summary, the content of this specification should not be understood as limiting the present invention.
Claims
1. A control method, characterized in that: include: Acquire motion information of the recording device, wherein the motion information includes the number of shakes, the direction of shakes, and the rate of shakes; Determining a control instruction corresponding to the motion information; One of the control instructions corresponds to one or more trigger conditions, and the trigger conditions include the number of trigger shakes, the direction of trigger shakes, and the rate of trigger shakes; the control instructions correspond to multiple functions in the recording device; the multiple functions in the recording device include recording function, translation function, simultaneous interpretation function, recording mode switching function, "one-to-one conversation recording" function, editing function, transcription function, and memo function; the control instructions corresponding to the recording mode switching include: conference mode switching instruction, lecture mode switching instruction, interview mode switching instruction, and concert mode switching instruction; Execute the control operation corresponding to the control instruction; When the same trigger condition is set in advance for multiple control instructions, the motion information corresponds to multiple control instructions, and determining the control instruction corresponding to the motion information includes: According to the current use status of the recording device, the control instructions corresponding to the motion information are filtered out; When the control instruction is an editing instruction, the executing the control operation corresponding to the control instruction includes: When the editing instruction is an instruction to add a sound effect, an operation of adding a sound effect is performed, and the sound effect includes applause and laughter; When the editing instruction is a voice data deletion instruction, executing an operation of deleting the voice data; The operation of deleting the voice data includes: removing the empty recording part of the voice data; When the control instruction is an interview mode switching instruction, the control operation corresponding to the execution of the control instruction includes: Execute the operation of switching to interview mode. When the control command is a "one-to-one" conversation command, control the recording device to record a "one-to-one" conversation.
2. The method according to claim 1, characterized in that The determining the control instruction corresponding to the motion information includes: From the preset trigger conditions, searching for a target trigger condition satisfied by the motion information; A mapping relationship is searched based on the target trigger condition to determine a control instruction corresponding to the motion information.
3. The method according to claim 2, characterized in that The searching, from the preset trigger conditions, for a target trigger condition satisfied by the motion information includes: For each preset trigger condition, compare the shaking times in the motion information with the trigger shaking times in the trigger condition, compare the shaking direction with the trigger shaking direction, and compare the shaking rate with the trigger shaking rate; If the number of shakes in the motion information matches the number of trigger shakes in the trigger condition, the shaking direction matches the trigger shaking direction, and the shaking rate matches the trigger shaking rate, the trigger condition is determined as the target trigger condition.
4. The method according to claim 1, characterized in that The recording device is provided with an information acquisition module, and the step of acquiring the motion information of the recording device includes: Acquiring sensor information collected by an information collection module in the recording device; Based on the sensor information, motion information of the recording device is determined.
5. The method according to claim 1, characterized in that The method further comprises: Prompt based on control results.
6. A control device, characterized in that: include: An acquisition module, used to acquire motion information of the recording device, wherein the motion information includes the number of shakes, the direction of shakes, and the rate of shakes; An instruction determination submodule is used to determine the control instruction corresponding to the motion information; one of the control instructions corresponds to one or more trigger conditions, and the trigger conditions include the number of trigger shakes, the direction of trigger shakes, and the rate of trigger shakes; the control instruction corresponds to multiple functions in the recording device; the multiple functions in the recording device include recording function, translation function, simultaneous interpretation function, recording mode switching function, "one-to-one conversation recording" function, editing function, transcription function, and memo function; the control instructions corresponding to the recording mode switching include: conference mode switching instruction, lecture mode switching instruction, interview mode switching instruction, and concert mode switching instruction; An operation execution submodule, used for executing the control operation corresponding to the control instruction; When the same trigger condition is set for multiple control instructions in advance, the control instructions corresponding to the motion information include multiple ones, and the instruction determination submodule is further used to filter out the control instructions corresponding to the motion information according to the current use status of the recording device; When the control instruction is an editing instruction, the operation execution submodule is further used to execute the operation of adding sound effects when the editing instruction is an instruction to add sound effects, and the sound effects include applause and laughter; when the editing instruction is an instruction to delete voice data, the operation of deleting the empty recording part is executed; When the control instruction is an interview mode switching instruction, the operation execution submodule is also used to execute the operation of switching to the interview mode. When the control instruction is a "one-to-one" conversation instruction, the recording device is controlled to perform "one-to-one" conversation recording.
7. A recording device, characterized in that: The system comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: Acquire motion information of the recording device, wherein the motion information includes the number of shakes, the direction of shakes, and the rate of shakes; Determine the control instruction corresponding to the motion information; one of the control instructions corresponds to one or more trigger conditions, and the trigger conditions include the number of trigger shakes, the direction of trigger shakes, and the rate of trigger shakes; the control instruction corresponds to multiple functions in the recording device; the multiple functions in the recording device include recording function, translation function, simultaneous interpretation function, recording mode switching function, "one-to-one conversation recording" function, editing function, transcription function, and memo function; the control instructions corresponding to the recording mode switching include: conference mode switching instruction, lecture mode switching instruction, interview mode switching instruction, and concert mode switching instruction; Execute the control operation corresponding to the control instruction; When the same trigger condition is set in advance for multiple control instructions, the motion information corresponds to multiple control instructions, and determining the control instruction corresponding to the motion information includes: According to the current use status of the recording device, the control instructions corresponding to the motion information are filtered out; When the control instruction is an editing instruction, the executing the control operation corresponding to the control instruction includes: When the editing instruction is an instruction to add a sound effect, an operation of adding a sound effect is performed, and the sound effect includes applause and laughter; When the editing instruction is a voice data deletion instruction, executing an operation of deleting the voice data; The operation of deleting the voice data includes: removing the empty recording part of the voice data; When the control instruction is an interview mode switching instruction, the control operation corresponding to the execution of the control instruction includes: Execute the operation of switching to interview mode. When the control command is a "one-to-one" conversation command, control the recording device to record a "one-to-one" conversation.
8. A readable storage medium, characterized in that: When the instructions in the storage medium are executed by the processor of the recording device, the recording device can execute the control method as described in any one of method claims 1-5.
Citation Information
Patent Citations
Information recording method and device of mobile terminal
CN102938808A
Automatic recording system and method for movable terminal in communication
CN104519188A
Mobile terminal and method for controlling the same
CN105453444A
Information recording method and equipment thereof
CN106874057A