Directing method and device, directing pen, directing system and storage medium

Abstract

The invention discloses a director method and device, a director pen, a director system and a storage medium. The program director method is applied to a program director pen, and comprises the following steps: determining a program director mode of the program director pen; determining a director event of the director pen in the director mode; and transmitting the director event to a recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to media data acquired by media acquisition equipment based on the director event. According to the technical scheme, the user using the director pen can participate in the director process through the director pen, and based on the director event of the director pen in the corresponding director mode, the media content corresponding to the director event is generated in combination with the recording and broadcasting host, so that the required media content can be directed and recorded in time, and the accuracy of the director content is improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of intelligent directing technology, and in particular to a directing method, device, directing pen, directing system and storage medium. Background Art

[0002] In scenarios such as teaching or remote conferencing, recording and directing technology can be used in combination with acquisition devices such as cameras or microphones to record the speaker's explanations, the playback of presentations, and the interactions between different participants, thereby achieving the recording or live broadcast of teaching or meeting content.

[0003] In the prior art, directing can be achieved through a director's desk, which is operated by a professional director. The director can adjust the content of the recording and directing according to the content of the speaker by operating the director's desk. However, since different speakers have different habits, the director cannot understand the content of the speaker and switch to the corresponding lens in time, which may cause the lens to switch incorrectly, and may also direct the lens that does not need to be directed, reducing the accuracy of the directed content. Summary of the invention

[0004] The present invention provides a directing method, a device, a directing pen, a directing system and a storage medium. The directing pen can allow a user who uses the directing pen to participate in the directing process, thereby improving the accuracy of the directed content.

[0005] In a first aspect, an embodiment of the present invention provides a directing method, which is applied to a directing pen, and the method includes:

[0006] Determine the directing mode the director pen is in;

[0007] Determine a directing event of the directing pen in the directing mode;

[0008] The directing event is transmitted to the recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to the media data collected by the media collection device based on the directing event.

[0009] In a second aspect, an embodiment of the present invention provides a directing method, which is applied to a recording and broadcasting host, and the method includes:

[0010] Determine the directing mode the director pen is in;

[0011] Determine a directing event of the directing pen in the directing mode;

[0012] Media content corresponding to the media data collected by the media collection device is generated based on the director event.

[0013] In a third aspect, an embodiment of the present invention provides a broadcast director device, including:

[0014] A first directing mode determination module, used to determine the directing mode of the directing pen;

[0015] A first directing module, used for determining a directing event of the directing pen in the directing mode;

[0016] The data transmission module is used to transmit the director event to the recording and broadcasting host, so that the recording and broadcasting host can generate media content corresponding to the media data collected by the media collection device based on the director event.

[0017] In a fourth aspect, an embodiment of the present invention provides a broadcast director device, including:

[0018] A second directing mode determination module is used to determine the directing mode of the directing pen;

[0019] A second directing module, used for determining a directing event of the directing pen in the directing mode;

[0020] The media content generation module is used to generate media content corresponding to the media data collected by the media collection device based on the director event.

[0021] In a fifth aspect, an embodiment of the present invention provides a director pen, comprising: a positioning module, a communication module, at least one processor and a memory connected to the at least one processor in communication, wherein the positioning module and the communication module are connected to the processor respectively; wherein:

[0022] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the directing method according to the first aspect;

[0023] The positioning module is used to determine the location information of the director pen, and the communication module is used to communicate with the recording and broadcasting host.

[0024] In a sixth aspect, an embodiment of the present invention provides a recording and broadcasting host, including:

[0025] at least one processor; and

[0026] a memory communicatively connected to the at least one processor; wherein,

[0027] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the directing method as described in the second aspect.

[0028] In the seventh aspect, an embodiment of the present invention provides a director system, comprising the director pen as described in the fifth aspect, multiple media acquisition devices and a recording and broadcasting host, the multiple media acquisition devices are used to acquire media data within a collection area, the director pen is used to transmit director events to the recording and broadcasting host, and the recording and broadcasting host is used to generate media content corresponding to the media data collected by the media acquisition devices based on the director events.

[0029] In the eighth aspect, an embodiment of the present invention provides a director system, comprising a director pen, multiple media acquisition devices and a recording and broadcasting host as described in the sixth aspect, the multiple media acquisition devices are used to acquire media data within a collection area, the recording and broadcasting host is used to determine the director event corresponding to the director pen, and generate media content corresponding to the media data collected by the media acquisition device based on the director event, and the director pen is used to transmit the data associated with the director pen required for the recording and broadcasting host to determine the director event to the recording and broadcasting host.

[0030] In the ninth aspect, an embodiment of the present invention provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program is used to enable the processor to implement the directing method as described in the first aspect, or implement the directing method as described in the second aspect when executed.

[0031] The embodiment of the present invention provides a directing method, device, directing pen, directing system and storage medium. The directing method is applied to the directing pen, and the method includes: determining the directing mode of the directing pen; determining the directing event of the directing pen in the directing mode; transmitting the directing event to the recording and broadcasting host, so that the recording and broadcasting host can generate the media content corresponding to the media data collected by the media acquisition device based on the directing event. The above technical scheme allows the user who uses the directing pen to participate in the directing process through the directing pen, and based on the directing event of the directing pen in the corresponding directing mode, combined with the recording and broadcasting host to generate the media content corresponding to the directing event, the required media content can be directed and recorded in time, thereby improving the accuracy of the directed content.

[0032] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0034] Figure 1 is a flowchart of a broadcast directing method provided according to Embodiment 1 of the present invention;

[0035] Figure 2a is a flowchart of a broadcast directing method provided according to Embodiment 2 of the present invention;

[0036] Figure 2b is a schematic diagram of directing in an automatic directing mode according to Embodiment 2 of the present invention;

[0037] Figure 2c is a schematic diagram of directing in another automatic directing mode provided according to the second embodiment of the present invention;

[0038] Figure 3a is a flowchart of another directing method provided according to Embodiment 2 of the present invention;

[0039] Figure 3b is a schematic diagram of directing in a manual directing mode according to Embodiment 2 of the present invention;

[0040] Figure 4 is a schematic diagram of a director pen provided according to Embodiment 2 of the present invention;

[0041] Figure 5a is a flowchart of another directing method provided according to Embodiment 2 of the present invention;

[0042] Figure 5b is a schematic diagram of directing in a blackboard writing mode according to a second embodiment of the present invention;

[0043] Figure 6 is a schematic diagram of another director pen provided according to Embodiment 2 of the present invention;

[0044] Figure 7 is a flowchart of a broadcast directing method provided according to Embodiment 3 of the present invention;

[0045] Figure 8 is a structural schematic diagram of a broadcast director device provided according to a fourth embodiment of the present invention;

[0046] Fig. 9 is a structural schematic diagram of a broadcast director device provided according to Embodiment 5 of the present invention;

[0047] Fig.10 It is a structural schematic diagram of a director pen for implementing the director method of an embodiment of the present invention;

[0048] Fig.11 It is a structural schematic diagram of another directing pen for implementing the directing method of the embodiment of the present invention;

[0049] Fig.12 It is a structural diagram of a recording and broadcasting host that implements the directing method of an embodiment of the present invention;

[0050] Fig.13 is a structural diagram of a broadcast director system provided according to Embodiment 7 of the present invention;

[0051] Fig.14 is a structural schematic diagram of a broadcast director system provided according to Embodiment 8 of the present invention;

[0052] Fig.15 It is a structural diagram of a director system provided according to Embodiment 9 of the present invention. DETAILED DESCRIPTION

[0053] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0054] It should be noted that the terms "first", "second", etc. in the present invention are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0055] It is understandable that before using the technical solutions disclosed in the embodiments of the present invention, the types, scope of use, and usage scenarios of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0056] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0057] It should be noted that the location information of the director's pen, the behavior information of the director's pen, and the acquisition, storage, use, and processing of the triggering operations of the buttons on the director's pen by the speaker (i.e., the user of the director's pen) involved in the embodiments of the present invention have all been authorized by the speaker and comply with relevant provisions of national laws and regulations, and can be used only for directing.

[0058] Embodiment 1

[0059] Figure 1 It is a flowchart of a directing method provided according to the first embodiment of the present invention. This embodiment is applicable to the situation where directing is achieved through a director's pen. The method can be executed by a director's device. The director's device can be implemented in the form of software and / or hardware and integrated in the director's pen.

[0060] The director pen in the embodiment of the present invention can form a director system with multiple media acquisition devices and a recording and broadcasting host. Through the linkage between the director pen, multiple media acquisition devices and the recording and broadcasting host, directing and recording and broadcasting can be realized.

[0061] Among them, the media acquisition device can be a device for acquiring media data, such as a media acquisition device can be a camera and a pickup microphone, etc., and correspondingly, the media data can be video data and audio data; for example, the media acquisition device can be a computer or a laptop computer, etc., and correspondingly, the media data can be a presentation played in the computer or laptop computer.

[0062] The director's pen in the embodiment of the present invention can be understood as an intelligent pen with integrated director function. In the director's pen, there can be multiple buttons for triggering manual switching of different director's screens, and it can also be triggered by the built-in algorithm of the director's pen. Automatic switching of different director's screens. In addition, the director's pen can also have a writing function. Users who use the director's pen, such as the lecturer, can hold the director's pen and write on the blackboard on an electronic whiteboard or touch screen. While writing, the content of the blackboard can be determined as the director's screen. Among them, in the teaching scenario, the lecturer can be a teacher, and in the meeting scenario, the lecturer can be the host of the meeting. The lecturer can be determined according to different application scenarios, and there is no specific limitation.

[0063] Both the director pen and the recording and broadcasting host can include a director module, which can be used to determine the director event. When the director module in the director pen confirms the switching of the screen that triggers the director, the director pen can communicate with multiple media acquisition devices and the recording and broadcasting host through the built-in communication unit. The director module of the recording and broadcasting host can confirm the final screen for directing in combination with the director event determined by the director pen, and direct and record the required screen in combination with the media acquisition device. In addition, the recording and broadcasting host can also be controlled by the director pen, such as controlling the start, pause or end of the recording and broadcast.

[0064] For example, in a teaching scenario, through the above-mentioned director system, the teacher's explanations, blackboard writing, playback of courseware and interaction between teachers and students in classroom activities can be collected and recorded in a timely manner according to the teacher's (i.e., lecturer) teaching plan, and finally a complete teaching video can be generated.

[0065] like Figure 1 As shown, the directing method includes:

[0066] S110, determining the directing mode of the director pen.

[0067] When directing is achieved through the director pen in the embodiment of the present invention, there may be multiple directing modes, and the directing mode may be a mode in which directing is achieved through the director pen. For example, the directing mode may include but is not limited to a manual directing mode, an automatic directing mode, and a blackboard writing mode. Taking the user who uses the director pen as the main speaker as an example, the above three directing modes are described.

[0068] The manual directing mode can be a mode in which the presenter manually operates the buttons of the director pen to realize directing. In the manual directing mode, the presenter can trigger different buttons in the director pen to realize directing of different pictures. Among them, different buttons are used to trigger switching of different directing pictures. The buttons used to trigger switching of different directing pictures can be regarded as picture switching buttons. The number of picture switching buttons can be set according to the number of pictures that need to be directed.

[0069] The automatic directing mode can be a mode in which directing is automatically achieved through the algorithm built into the director pen. In the automatic directing mode, directing can be automatically achieved without the presenter actively triggering the screen switching button in the director pen.

[0070] The blackboard writing mode can be a directing mode in which the speaker operates the director's pen to write on the blackboard. In the blackboard writing mode, the speaker can write on the blackboard with the director's pen and direct the blackboard screen at the same time.

[0071] There is no limitation on the method of determining the director mode in which the director pen is located. For example, multiple mode selection buttons can be set in the director pen, and each mode selection button uniquely corresponds to a director mode. In response to the speaker triggering the mode selection button operation, the director mode corresponding to the mode selection button triggered by the operation can be determined as the director mode in which the director pen is located. Among them, the mode selection button can be a button used to trigger the selection of the director mode. The number of mode selection buttons is not limited here, and can be the same as the number of director modes, or less than the number of director modes.

[0072] For another example, in response to the speaker triggering the screen switching button of the director's pen, it is confirmed that the directing mode of the director's pen is the manual directing mode.

[0073] For another example, if the speaker fails to respond to the operation of the screen switching button of the director pen within the set time, it is confirmed that the director pen is in the automatic director mode. The set time can be determined according to actual needs.

[0074] For another example, in response to the speaker operating the director's pen to write on the blackboard, it is confirmed that the director's mode of the director's pen is the blackboard writing mode.

[0075] By setting different directing modes for the director pen and allowing the speaker to participate in the directing process, the accuracy of directing can be improved.

[0076] S120, determining the directing event of the directing pen in the directing mode.

[0077] The directing event can be determined by the directing module of the director pen, indicating how to implement the directing event in the directing mode of the director pen. For example, the directing event can indicate the screen that needs to be switched to for directing.

[0078] The method of determining the directing event of the directing pen in the directing mode is not limited, specifically:

[0079] In the manual directing mode, the directing event may indicate that in response to the presenter triggering the screen switching button of the director's pen, the current directing screen is switched to the screen corresponding to the triggered screen switching button.

[0080] In the automatic directing mode, the directing event can indicate automatic switching to the screen that needs to be directed. For example, according to the algorithm built into the directing pen, the current directed screen can be automatically switched to the screen that needs to be directed corresponding to the set condition when the set condition is met. Among them, the method for determining the set condition and the screen that needs to be directed corresponding to the set condition is not limited, for example, it can be determined in advance by means such as model learning.

[0081] For example, in a teaching scenario, the lecturer holds a director's pen to give a lecture. The position of the director's pen in the classroom can be regarded as the lecturer's position. The setting condition can be that the lecturer is on the podium. The picture that needs to be directed corresponding to the setting condition can be a picture including the podium. The director event can indicate that when the lecturer is on the podium, the current directed picture should be switched to the picture including the podium.

[0082] In the blackboard writing mode, the director event may indicate that in response to the presenter operating the director's pen to write on the blackboard, the current director's screen is switched to a screen including the blackboard writing.

[0083] This step can determine the directing events that are closer to the actual application needs in the different directing modes of the director pen, so as to make the directing content more accurate.

[0084] S130: Transmit the directing event to a recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to the media data collected by the media collection device based on the directing event.

[0085] The method of transmitting the director event to the recording and broadcasting host is not limited. For example, the director pen can be equipped with a communication unit that can communicate with the recording and broadcasting host, and the communication unit can enable the director pen and the recording and broadcasting host to achieve wireless communication, so the director pen can transmit the director event to the recording and broadcasting host. Among them, the technical means for achieving wireless communication is not limited, such as Bluetooth, etc.

[0086] After the recording and broadcasting host receives the directing event transmitted by the director pen, the directing event transmitted by the director pen can be directly used as the final directing event to achieve directing; or the recording and broadcasting host can combine the directing event transmitted by the director pen, and in the directing module included in the recording and broadcasting host, the final directing event is confirmed according to the algorithm built into the recording and broadcasting host to achieve directing, and the confirmed final directing event can be the same as or different from the directing event transmitted by the director pen, and there is no specific limitation. Among them, the final directing event can be the directing event that is actually used for directing.

[0087] In one embodiment, in the manual directing mode and the blackboard writing mode, the final directing event confirmed by the recording and broadcasting host may be the same as the directing event transmitted by the director pen.

[0088] In one embodiment, in the automatic directing mode, the final directing event confirmed by the recording and broadcasting host may be the same as or different from the directing event transmitted by the directing pen.

[0089] After the recording and broadcasting host confirms the final directing event, the recording and broadcasting host can confirm the screen that needs to be directed based on the final directing event, and obtain the screen that needs to be directed from the media acquisition device. The screen obtained from the media acquisition device is part or all of the media data collected by the media acquisition device. The method in which the recording and broadcasting host obtains the screen that needs to be directed from the media acquisition device is not limited. For example, the media acquisition device can transmit all the collected screens to the recording and broadcasting host, and carry the identification corresponding to the screen when transmitting the screen. The recording and broadcasting host can determine the screen that needs to be directed based on the identification of the screen that needs to be directed.

[0090] When the recording and broadcasting host confirms the screen that needs to be directed according to the final directed broadcast event, the screen can be recorded and stored. By recording and storing different directed broadcast screens, media content corresponding to the media data collected by the media acquisition device can be generated. The media content can be the content directed and recorded in the media data collected by the media acquisition device.

[0091] Transmitting the director events to the recording and broadcasting host can enable the recording and broadcasting host to confirm the director events actually used for directing based on the director events transmitted by the director pen, and record and store the director's screen according to the confirmed director events. By combining the director pen and the recording and broadcasting host to determine the director events and generate media content, the risk of erroneous switching of the director's screen is reduced, making the final media content more accurate.

[0092] The embodiment of the present invention provides a directing method, device, directing pen, directing system and storage medium. The directing method is applied to the directing pen, and the method includes: determining the directing mode of the directing pen; determining the directing event of the directing pen in the directing mode; transmitting the directing event to the recording and broadcasting host, so that the recording and broadcasting host can generate the media content corresponding to the media data collected by the media acquisition device based on the directing event. The above technical scheme allows the user who uses the directing pen to participate in the directing process through the directing pen, and based on the directing event of the directing pen in the corresponding directing mode, the recording and broadcasting host generates the media content corresponding to the directing event, so that the required media content can be directed and recorded in time, thereby improving the accuracy of the directed content.

[0093] Embodiment 2

[0094] This embodiment is based on the above-mentioned embodiment 1, and further refines the determination of the directing events of the directing pen in the directing mode under different directing modes.

[0095] Figure 2a is a flowchart of a broadcast directing method provided according to Embodiment 2 of the present invention. Figure 2a The directing mode involved is the automatic directing mode, such as Figure 2a As shown, the method includes:

[0096] S201, determining that the directing mode of the director pen is the automatic directing mode.

[0097] S202. Determine, based on an event determination model, a directing event corresponding to the position information of the directing pen in the automatic directing mode.

[0098] The location information of the director's pen may be information indicating the location of the director's pen. A sensor for realizing positioning may be provided in the director's pen, such as a sensor for realizing positioning based on ultra-wideband technology (Ultra Wide Band, UWB). The location information of the director's pen may be determined by the sensor.

[0099] The event determination model may be a model for determining the directing event, and the event determination model may be a model obtained by training a machine learning algorithm. The present invention does not limit the model structure of the event determination model, such as the event determination model may be obtained by training a neural network model, and the neural network model may be a convolutional neural network (CNN) model, a generative adversarial network (GAN) model, or a recurrent neural network (RNN) model.

[0100] The method of determining the director event corresponding to the position information of the director pen in the automatic director mode based on the event determination model is not limited. For example, when the position information of the director pen meets the set matching conditions, the position information of the director pen can be input into the event determination model, and the corresponding director event can be output through the event determination model. For another example, the position information of the director pen obtained in real time can be directly input into the event determination model, and through the event determination model, if it is determined that the input position information meets the set matching conditions, the corresponding director event is output.

[0101] Among them, the matching condition can be set that the position information of the director's pen matches the calibrated position information, that is, the position information of the director's pen is consistent with the calibrated position information, and the present invention is not limited to this.

[0102] The calibrated position information may be the position information of the director's pen calibrated in advance. The calibrated position information indicates that there is a director event of switching the director's screen at the position corresponding to the calibrated position information. The method for determining the calibrated position information is not limited, such as being determined in advance based on the user triggering the director's pen in the manual director mode and the position information of the director's pen when triggered.

[0103] In one embodiment, the determining the directing event corresponding to the position information of the directing pen in the automatic directing mode based on the event determination model includes:

[0104] In the case where the position information of the director pen matches the calibrated position information associated with the director image switching, the position information is input into the event determination model to obtain the director event of the director pen in the director mode; or

[0105] The position information of the director pen is input into the event determination model to obtain the directing event of the director pen in the directing mode.

[0106] Exemplarily, in a teaching scenario, multiple teachers (i.e., lecturers) may use a director's pen to direct during class. Before multiple teachers use the director's pen to direct, the location information of the director's pen can be matched in advance with the map of the classroom where the director's pen is located, that is, the spatial coordinates of the director's pen at different positions in the classroom are determined according to the map of the classroom where the director's pen is located. When multiple teachers use the director's pen to teach, if the position of the director's pen in the classroom is at the podium (corresponding position information), more than half of the teachers switch the director's screen through the manual directing mode. If more than half of the teachers trigger the screen switching button in the director's pen to switch the director's screen to a screen including the podium, the spatial coordinates of the director's pen on the podium can be recorded as a calibrated position information, and the directing event corresponding to the calibrated position information is to switch the director's screen to a screen including the podium.

[0107] Furthermore, the calibrated position information can be stored in the director's pen so that when the user subsequently uses the director's pen, it can be determined whether the position information of the director's pen matches the calibrated position information associated with the director's image switching.

[0108] Through the above method, multiple calibrated position information and corresponding directing events can be determined. The determined multiple calibrated position information and corresponding directing events form a directing event library. Among them, the directing event library can be a database for storing calibrated position information and corresponding directing events.

[0109] The event determination model is trained based on the director event library. For the trained event determination model, when the input of the event determination model is the position information matching the calibrated position information, the corresponding director event can be output.

[0110] The position information of the director's pen matches the calibrated position information associated with the director's image switching. It can be understood that the position information of the director's pen is consistent with the calibrated position information. At this time, the position information of the director's pen can be input into the event determination model, and the event determination model can output the director event corresponding to the position information of the director's pen.

[0111] Taking the calibration location information in the following scenario as an example, an exemplary description of the application of the event determination model is given:

[0112] The calibration scenario is: the calibration position information indicates that the director's pen is at the podium, and the director's event corresponding to the calibration position information is to switch the director's screen to a screen including the podium.

[0113] Based on the above calibration scenario, the application of the event determination model is: when the position information of the director's pen indicates that the director's pen is at the podium in the classroom, determine that the position information of the director's pen matches the calibration position information, and input the position information of the director's pen into the event determination model. The event determination model can output the corresponding director event, which is to switch the director's screen to a screen including the podium.

[0114] Figure 2b FIG. 1 is a schematic diagram of directing in an automatic directing mode according to Embodiment 2 of the present invention. Figure 2b The application of the event determination model in the above calibration scenario is specifically described:

[0115] When the position information of the director pen 1 indicates that the director pen 1 is at the podium 2 in the classroom, the position information of the director pen 1 is input into the event determination model, and the event determination model can output a director event, which is to switch the director's screen to a screen including the podium. The director pen 1 can transmit the determined director event to the recording and broadcasting host 3, and the screen including the podium collected by the media acquisition device 4 can be displayed in the recording and broadcasting host 3.

[0116] The following describes inputting the position information of the director pen into the event determination model to obtain the directing event of the director pen in the directing mode:

[0117] Specifically, the real-time acquired position information of the director pen can be directly input into the event determination model. Through the event determination model, if it is determined that the input position information matches the calibrated position information in the model, the corresponding director event is output; if it is determined that the input position information does not match the calibrated position information in the model, the director event is not output.

[0118] By inputting the position information into the event determination model, the director event of the director pen in the director mode is obtained. When the director pen is at the position indicated by the position information, the corresponding director event can be automatically determined, realizing the association between the position information and the director event, making the directing in the automatic directing mode more accurate. Since the position information of the director pen is taken into account when determining the director event, when it is necessary to switch the director's screen to the screen including the speaker at any time, the screen that the media acquisition device needs to collect can be determined by the position information, and the problem of wrong screen switching will not occur.

[0119] In one embodiment, the inputting the position information into the event determination model to obtain the directing event of the director pen in the directing mode includes:

[0120] The position information and the behavior information of the director pen are input into the event determination model to obtain the directing event of the director pen in the directing mode.

[0121] The behavior information of the director's pen may be information about behaviors related to the director's pen, and there is no limitation on the behavior information.

[0122] For example, behavioral information can be information that the user triggers the director's pen to write.

[0123] For example, the behavior information may be information about a button on the director's pen that the user triggers (such as any button on the director's pen).

[0124] For another example, behavior information can be information obtained by means of image recognition, and the image used for image recognition can be an image related to the environment in which the director's pen is located. The method for obtaining the image used for image recognition is not limited, such as obtaining it through an image acquisition device. Among them, the information obtained by means of image recognition can be information obtained by the director's pen obtaining images captured by the image acquisition device and performing image recognition; it can also be information obtained by the recording and broadcasting host obtaining images captured by the image acquisition device and transmitting them to the director's pen after performing image recognition, and there is no specific limitation.

[0125] Based on the above embodiments, this embodiment adds behavioral information of the director's pen to improve the accuracy of the event determination model in determining the director's event.

[0126] Take the example that the behavior information can be the information when the user triggers the director's pen to write: in a teaching scenario, when multiple teachers are using the director's pen to teach, if the director's pen is located at the podium in the classroom (corresponding position information), and the teacher triggers the director's pen to write on the blackboard (corresponding behavior information), more than half of the teachers switched the director's screen through the manual directing mode. For example, if the director's screen is switched to a screen including blackboard writing, the spatial coordinates of the director's pen on the podium can be recorded as a calibrated position information. The director's event corresponding to the calibrated position information is to switch the director's screen to a screen including blackboard writing.

[0127] For example, in a teaching scenario, the calibration position information may also be that the director's pen is on the left side of the podium; the corresponding behavior information indicates that the teacher has triggered a button on the director's pen; and the corresponding director's event is to switch the director's screen to a panoramic screen of the students.

[0128] Among them, the teacher triggers the button of the director's pen, for example, the teacher can trigger the screen switching button corresponding to the student's panoramic screen. At this time, the director's pen in the automatic directing mode is assisted by manual buttons to realize semi-automatic directing under the automatic directing model. The corresponding directing events can be controlled by manual buttons, such as switching the director's screen to the student's panoramic screen.

[0129] Exemplarily, in a teaching scenario, the calibration position information may also be that the director's pen is in a set position in the classroom, and the set position is a position that is less than a set distance from a certain student; the corresponding behavior information indicates that image recognition is used to confirm that both the teacher and the student are in a standing state; and the corresponding director event is to switch the director's screen to a close-up of the student.

[0130] Through the above method, multiple calibrated position information and the behavior information and directing events of the director pen corresponding to each calibrated position information can be determined. The determined multiple calibrated position information and the behavior information and directing events of the director pen corresponding to each calibrated position information are formed into a directing event library.

[0131] The event determination model is trained based on the director event library. For the trained event determination model, when the input of the event determination model is the position information matching the calibrated position information and the behavior information of the director pen, the corresponding director event can be output.

[0132] Taking the calibration location information in the following scenario as an example, an exemplary description of the application of the event determination model is given:

[0133] The calibration scenario is: the calibration position information indicates that the director's pen is at the set position in the classroom, the corresponding behavior information indicates that image recognition is used to confirm that the teacher and the student are both in a standing position, and the corresponding director event is to switch the director's screen to a close-up of the student.

[0134] Based on the above calibration scenario, the application of the event determination model is: when the position information of the director's pen indicates that the director's pen is at the set position in the classroom, and the behavior information indicates that the teacher and the students are both standing by means of image recognition, the position information and behavior information of the director's pen are input into the event determination model, and the event determination model can output the corresponding director event, which is to switch the director's screen to a close-up of the student.

[0135] Figure 2c FIG. 2 is a schematic diagram of directing in another automatic directing mode according to Embodiment 2 of the present invention. Figure 2c The application of the event determination model in the above calibration scenario is specifically described:

[0136] When the position information of the director pen 1 indicates that the director pen 1 is at the set position (i.e., the distance between the teacher 5 and the student 6 is less than the set distance), and the behavior information indicates that the teacher 5 and the student 6 are both in a standing state by means of image recognition, the position information and behavior information of the director pen are input into the event determination model, and the event determination model can output the corresponding director event, which is to switch the director's screen to a close-up of the student. The director pen 1 can transmit the determined director event to the recording and broadcasting host 3, and the close-up of the student collected by the media acquisition device 4 can be displayed in the recording and broadcasting host 3.

[0137] By inputting the position information and the behavior information of the director pen into the event determination model, the director pen's directing event in the directing mode is obtained. When the director pen is at the position indicated by the position information and responds to the behavior indicated by the behavior information, the corresponding directing event can be automatically determined. By associating the position information and behavior information with the directing event, the presenter does not need to intervene too much in the directing process, which can save labor costs while making the directing in the automatic directing mode more accurate, thereby improving the efficiency of directing in the automatic directing mode.

[0138] S203: Transmit the directing event to a recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to the media data collected by the media collection device based on the directing event.

[0139] In one embodiment, in the automatic directing mode, the final directing event confirmed by the recording and broadcasting host may be the same as the directing event transmitted by the directing pen. For example, when the directing event transmitted by the directing pen to the recording and broadcasting host is to switch the directing screen to a screen including the podium, the directing module in the recording and broadcasting host may directly determine the received directing event as the final directing event. The recording and broadcasting host obtains the screen of the podium collected by the media acquisition device and generates corresponding media content.

[0140] In one embodiment, in the automatic directing mode, the final directing event confirmed by the recording and broadcasting host may be different from the directing event transmitted by the directing pen. For example, the recording and broadcasting host analyzes the directing event transmitted by the directing pen in the local directing module of the recording and broadcasting host to determine the final directing event.

[0141] In one embodiment, the event determination model is trained based on a director event library;

[0142] Among them, the director event library is formed by the director events corresponding to the manual directing mode and the data associated with the director pen when the director events are generated, and the data associated with the director pen includes one or more of the location information of the director pen and the behavior information of the director pen.

[0143] In the manual directing mode, multiple directing events and the position information of the directing pen and / or the behavior information of the directing pen when each directing event is generated can be recorded in the directing event library, and the event determination model is continuously trained through the directing event library, so that when the input of the event determination model is the position information of the directing pen and / or the behavior information of the directing pen, the event determination model can output the corresponding directing event. Among them, the directing event library can be a database for storing directing events and the corresponding position information and / or behavior information of the directing pen.

[0144] In one embodiment, the event determination model is continuously trained through the director event library, which can be carried out in the director pen; or the director event library can be transmitted to an electronic device (such as a computer or laptop computer, etc.), and the training is carried out in the electronic device. After the training is completed, the director pen obtains the event determination model trained by the electronic device; or the director event library can be transmitted to the recording and broadcasting host, and the training is carried out in the recording and broadcasting host. After the training is completed, the director pen can obtain the event determination model trained by the recording and broadcasting host, or the trained event determination model can be saved to the recording and broadcasting host, and the recording and broadcasting host generates a director event, without specific limitation.

[0145] The event determination model is trained through the data recorded in the manual directing mode. When the event determination model is used to output directing events in the automatic directing mode, the output results can be more in line with the actual application needs, making the directing in the automatic directing mode more accurate. Accordingly, for the media content finally generated by the recording and broadcasting host, the expected directing effect can be achieved without processing the media content (such as editing, etc.).

[0146] Figure 3a is a flowchart of another directing method provided according to Embodiment 2 of the present invention. Figure 3a The directing mode involved is the manual directing mode, such as Figure 3a As shown, the method includes:

[0147] S301, determining that the directing mode of the director pen is the manual directing mode.

[0148] S302: In response to the presenter's triggering operation on a button on the director's pen, determining a directing event corresponding to the triggered button of the director's pen in the director mode.

[0149] The buttons on the director's pen may be the screen switching buttons involved in the above embodiments, and each screen switching button is used to trigger switching to the corresponding director's screen. The triggering operation for the button may be the operation of the presenter pressing the screen switching button.

[0150] In response to the presenter's triggering operation on a button on the director's pen, the screen corresponding to the button triggered by the triggering operation can be determined, and the director event is to switch the current director's screen to the screen corresponding to the button triggered by the triggering operation.

[0151] For example, in a teaching scenario, when the teacher is instructing all students to read a text, the teacher has the need to switch the director's screen to a screen that includes a panoramic view of the students. At this time, in response to the teacher triggering the screen switch button corresponding to the panoramic view of the students in the director's pen, it can be determined that the director event is to switch the current director's screen to a screen that includes a panoramic view of the students.

[0152] Figure 3b FIG. 1 is a schematic diagram of directing in a manual directing mode according to Embodiment 2 of the present invention. Figure 3b The manual broadcasting in the above teaching scenario is explained in detail:

[0153] like Figure 3b As shown, the director pen 1 has multiple screen switching buttons. In response to the teacher triggering the screen switching button corresponding to the student panoramic screen in the director pen 1, the director event is determined to be switching the current director screen to a screen including the student panoramic view. The director pen 1 can transmit the determined director event to the recording and broadcasting host 3, and the student panoramic screen collected by the media acquisition device 4 can be displayed in the recording and broadcasting host 3.

[0154] Figure 4 is a schematic diagram of a director pen provided according to Embodiment 2 of the present invention, Figure 4 The director pen shown is Figure 3b Further description of the director pen 1 shown. Figure 4 As shown, five different screen switching buttons (such as screen switching button 41) are provided on the director pen, and each screen switching button can be used to trigger the switching of the corresponding screen. For example, different screen switching buttons can trigger switching to a full screen including the teacher, a close-up screen of the teacher, a full screen of the students, a close-up screen of the students, and a screen of blackboard writing.

[0155] Directing can be achieved by the presenter triggering the buttons on the director's pen. The accuracy of the content can be guaranteed without the need for professional directors to operate.

[0156] S303: Transmit the directing event to a recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to the media data collected by the media collection device based on the directing event.

[0157] In one embodiment, in the manual directing mode, the final directing event confirmed by the recording and broadcasting host may be the same as the directing event transmitted by the directing pen. For example, when the directing event transmitted by the directing pen to the recording and broadcasting host is to switch the directing screen to a screen including the student panorama, the directing module in the recording and broadcasting host may directly determine the received directing event as the final directing event. The recording and broadcasting host obtains the screen including the student panorama collected by the media acquisition device and generates corresponding media content.

[0158] In one embodiment, the broadcast directing method provided in this embodiment further includes:

[0159] When an event corresponding to the marked position of the media content occurs, director indication information is displayed, where the director indication information indicates the director event that needs to be triggered.

[0160] The calibrated position of the media content may be a position that is pre-calibrated in the media content according to actual application needs, and the calibrated position may be a position where the directing effect needs to be improved.

[0161] The event corresponding to the marked position of the media content may be the event indicated by the media content at the marked position.

[0162] The director indication information may be information indicating that a director event needs to be triggered to improve the director effect when an event corresponding to a marked position occurs during the director process.

[0163] The marked position of the media content, the event corresponding to the marked position of the media content, and the director's instruction information are exemplarily described:

[0164] For example, a teacher (i.e., the lecturer) can direct and record teaching videos multiple times to make the presentation of teaching videos better. After directing and recording the teaching video for the first time, the teacher can watch the recorded teaching video (i.e., the media content). When watching the media content, if the media content at the time stamp of 5s presents a panoramic director's picture of the lecturer when he is speaking at the podium, and it is expected that the media content at the time stamp of 5s should present a close-up director's picture of the lecturer when he is speaking at the podium, then the media content can be calibrated at the time stamp of 5s and director instruction information can be generated. When directing and recording are performed again in the future, if the lecturer is speaking at the podium at the 5s timestamp, the director instruction information can be used to indicate the need to trigger the switching of the director's picture, such as indicating the need to switch the director's picture to a close-up picture of the lecturer.

[0165] In the above example, the marked position of the media content is the position of the media content with a timestamp of 5s. The event corresponding to the marked position of the media content is that at the marked position with a timestamp of 5s, the media content presents the speaker speaking at the podium. The director's instruction information is information indicating that the director's screen switching needs to be triggered, such as indicating that the director's screen needs to be switched to a close-up of the speaker.

[0166] Among them, there is no limitation on the means of calibration, and it can be to calibrate only the timestamp, or to add calibration information. The calibration information can be information that instructs the speaker on how to direct the broadcast when the event corresponding to the 5s timestamp occurs when directing again, such as information indicating which screen switch button to click, such as a screen switch button that indicates switching the screen to a close-up of the speaker.

[0167] When an event corresponding to the marked position of the media content occurs, the manner of displaying the director's instruction information is not limited. For example, the director's instruction information can be displayed in the form of text on a screen such as a Figure 4 The director pen shown includes a display screen 42.

[0168] Exemplary, combined Figure 2b The display of the above-mentioned director instruction information is specifically described as follows:

[0169] Assumptions Figure 2b The teaching scenario shown is: when the timestamp of the media content displayed in the recording and broadcasting host 3 is 5s (corresponding to the marked position of the media content), the teacher speaks at the podium (corresponding to the event at the marked position). At this time, the director's instruction information can be displayed in the director's pen 1. Specifically, it can be displayed in the following manner: Figure 4 The director pen shown (i.e. Figure 2b The partial enlarged view of the director pen 1 shown in the figure) includes a display screen 42 that displays director instruction information, and the displayed director instruction information may be: "Click the screen switch button corresponding to the close-up screen of the speaker."

[0170] By displaying the director's indication information, when an event corresponding to the marked position of the media content occurs, the director's event to be triggered can be indicated so that the director's content can be adjusted in time, which can better achieve the expected director's effect and improve the director's efficiency.

[0171] Figure 5a is a flowchart of another directing method provided according to Embodiment 2 of the present invention. Figure 5a The directing mode involved is the blackboard mode, such as Figure 5a As shown, the method includes:

[0172] S501, determining that the directing mode of the director pen is blackboard writing mode.

[0173] S502: Determine the behavior information of the director pen.

[0174] The behavior information of the director's pen may be information about the user's operation on the director's pen, such as information about the user triggering the director's pen to write, without specific limitation.

[0175] There is no limitation on the method of determining the behavioral information of the director's pen. For example, the built-in sensor of the director's pen can detect the action of the user triggering the director's pen to write. Combined with the built-in algorithm for behavior detection in the director's pen, the writing trajectory of the director's pen can be processed and analyzed, and then the user's behavior of triggering the director's pen to write can be determined, that is, the behavioral information of the director's pen is determined.

[0176] In one embodiment, the behavior information of the director pen may be an instruction for the user to trigger the following Figure 4 The information written by the stylus tip 43 included in the director pen shown.

[0177] S503: Determine a director event corresponding to the behavior information, where the director event includes a control message instructing the recording and broadcasting host to generate media content including target media data, where the target media data is media data collected by a media collection device corresponding to the control message.

[0178] Among them, the control message can be a message instructing the control recording and broadcasting host to generate media content including target media data, and the target media data can be data associated with the behavior information of the director's pen. For example, if the behavior information of the director's pen is information that the user triggers the director's pen to write, then the target media data can include the content triggered by the user to write, without specific limitation.

[0179] In one embodiment, the target media data is the media data collected by the media collection device corresponding to the control message. For example, one or more media collection devices can be pre-set to collect the screen when the user triggers the director's pen to write. When the control message instructs the recording and broadcasting host to generate content including user-triggered writing, the screen when the user triggers the director's pen to write can be collected through the above-set media collection device, and the collected screen is transmitted to the recording and broadcasting host, and the above-collected screen is the target media data.

[0180] In one embodiment, the control message may be determined as a director event corresponding to the behavior information.

[0181] S504: Transmit the directing event to a recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to the media data collected by the media collection device based on the directing event.

[0182] The director event containing the control message is transmitted to the recording and broadcasting host. At the same time, the recording and broadcasting host can communicate with the media acquisition device, so that the media acquisition device acquires the picture including the target media data, and at the same time, the recording and broadcasting host generates the media content including the target media data.

[0183] Figure 5b 2 is a schematic diagram of directing in a blackboard writing mode according to the second embodiment of the present invention. Figure 5b As shown, taking the teaching scenario as an example, the following description is given:

[0184] When the teacher triggers the stylus tip of Director Pen 1 (i.e. Figure 4 When the touch pen tip 43 shown in the figure is used for blackboard writing, the built-in sensor of the director's pen 1 can detect the action of the teacher triggering the director's pen 1 to write, and combined with the built-in algorithm for behavior detection of the director's pen 1, the writing trajectory of the director's pen 1 is processed and analyzed to determine the behavior information of the director's pen 1.

[0185] The directing event corresponding to the behavior information is determined, where the directing event includes a control message for instructing the recording and broadcasting host 3 to generate a screen including blackboard writing.

[0186] The director pen 1 transmits the control message to the recording and broadcasting host 3. Based on the control message, the recording and broadcasting host 3 can display the blackboard screen in the recording and broadcasting host 3 by collecting the screen through the media collection device 4 pre-set for collecting the blackboard screen.

[0187] In one embodiment, in the blackboard writing mode, the final director event confirmed by the recording and broadcasting host can be the same as the director event transmitted by the director pen. If the director event transmitted by the director pen to the recording and broadcasting host is a message instructing the recording and broadcasting host to generate media content including target media data, and the target media data includes the content triggered by the user, the director module in the recording and broadcasting host can directly determine the received director event as the final director event. The recording and broadcasting host obtains the screen including the user-triggered writing collected by the media acquisition device and generates the corresponding media content.

[0188] By determining the behavior information of the director pen, determining the director event corresponding to the behavior information, the director event includes a control message, and transmitting the director event including the control message to the recording and broadcasting host to control the recording and broadcasting host and the media acquisition device to perform corresponding operations. When the user triggers the director pen to write, the screen written by the user can be directed in time to make the generated media content more accurate.

[0189] The technical solution of the embodiment of the present invention is to determine the directing events of the director pen in different ways under different directing modes, and to determine the directing events in the automatic directing mode in combination with the position information of the director pen, so that the determined directing events are strongly correlated with the position information of the director pen; in the manual directing mode, directing can be achieved by the presenter triggering the buttons on the director pen; in the blackboard mode, directing events including control messages are transmitted to the recording and broadcasting host to control the recording and broadcasting host and the media acquisition device to perform corresponding operations; directing is achieved by the above technical solution, which can improve the accuracy of the directed content, better achieve the expected directing effect, and improve the efficiency of directing.

[0190] In one embodiment, some functions of the director pen are exemplarily described. Figure 6 is a schematic diagram of another director pen provided according to the second embodiment of the present invention, Figure 6 The director pen shown is Figure 4 The director pen shown is a different perspective of the same director pen. Figure 6 As shown, the director's pen includes a switch button 61, which can be used to control the opening or closing of the director's pen in response to the triggering of the switch button 61; the director's pen includes a recording and broadcasting function control button 62, which can control the recording and broadcasting host to start recording in response to a single click of the recording and broadcasting function control button 62, control the recording and broadcasting host to pause recording in response to a second single click of the recording and broadcasting function control button 62, and control the recording and broadcasting host to end recording in response to a long press of the recording and broadcasting function control button 62; the director's pen includes a function selection switch 63, which can control the presentation during the recording and broadcasting process or the volume of the Bluetooth speaker in response to the triggering of the function selection switch 63; the director's pen includes an adjustment button 64, which can turn the pages of the presentation or adjust the volume of the Bluetooth speaker in response to the triggering of the adjustment button 64; the director's pen includes a laser button 65, which can emit a red laser in response to the triggering of the laser button 65.

[0191] Embodiment 3

[0192] Figure 7 This is a flow chart of a broadcast directing method provided according to Embodiment 3 of the present invention. This embodiment is applicable to the case where broadcast directing is implemented through a recording and broadcasting host. This method can be executed by a broadcast directing device, which can be implemented in the form of software and / or hardware and integrated in the recording and broadcasting host. For details not yet provided in this embodiment, please refer to the above embodiments, and no further description will be given here.

[0193] like Figure 7 As shown, the directing method includes:

[0194] S710: Determine the directing mode of the director pen.

[0195] There are two ways to determine the director mode of the director pen:

[0196] The directing mode of the director pen is determined by the director pen, and the determined directing mode is transmitted to the recording and broadcasting host, so that the recording and broadcasting host determines the directing mode of the director pen.

[0197] The interactive interface is displayed by the recording and broadcasting host, and selection controls corresponding to various directing modes of the director pen can be displayed in the interactive interface. By responding to the user triggering any selection control in the interactive interface, the directing mode corresponding to the selection control triggered by the user can be determined as the directing mode in which the director pen is located. Among them, the interactive interface can be an interface displayed in the recording and broadcasting host for interacting with the user.

[0198] S720: Determine the directing event of the director pen in the directing mode.

[0199] There are two ways to determine the directing event of the directing pen in the directing mode:

[0200] The director event in the director mode is determined by the director pen, and the determined director event is transmitted to the recording and broadcasting host, and then the final director event is determined by the recording and broadcasting host. After the recording and broadcasting host receives the director event transmitted by the director pen, the director event transmitted by the director pen can be directly used as the final director event to achieve directing; or the recording and broadcasting host can combine the director event transmitted by the director pen, and in the director module included in the recording and broadcasting host, the final director event is confirmed according to the algorithm built into the recording and broadcasting host to achieve directing. The confirmed final director event can be the same or different from the director event transmitted by the director pen, and there is no specific limitation. Among them, the final director event can be the director event that is actually used for directing.

[0201] In the director module included in the recording and broadcasting host, the director event of the director pen in the director mode is determined according to the event determination model built into the recording and broadcasting host. When determining the director event based on the event determination model, the position information of the director pen and / or the behavior information of the director pen can be combined, and the specific details are not limited.

[0202] S730: Generate media content corresponding to the media data collected by the media collection device based on the director event.

[0203] The recording and broadcasting host can confirm the screen that needs to be directed according to the directing event, and obtain the screen that needs to be directed from the media acquisition device. After obtaining the screen that needs to be directed, the screen can be recorded and stored. By recording and storing different directed screens, media content corresponding to the media data collected by the media acquisition device can be generated.

[0204] The embodiment of the present invention provides a directing method, which is applied to a recording and broadcasting host, and the method includes: determining the directing mode of the director pen; determining the directing event of the director pen in the directing mode; and generating media content corresponding to the media data collected by the media acquisition device based on the directing event. The above technical solution generates media content corresponding to the directing event through the combination of the recording and broadcasting host and the director pen, and can direct and record the required media content in a timely manner, thereby improving the accuracy of the directed content.

[0205] Embodiment 4

[0206] Figure 8 is a structural schematic diagram of a broadcast director device provided according to a fourth embodiment of the present invention. This embodiment is applicable to situations where broadcast director is implemented by a broadcast director pen, such as Figure 8 As shown, the specific structure of the device includes:

[0207] The first directing mode determination module 81 is used to determine the directing mode of the directing pen;

[0208] A first directing module 82, used to determine a directing event of the directing pen in the directing mode;

[0209] The data transmission module 83 is used to transmit the directing event to the recording and broadcasting host, so that the recording and broadcasting host can generate media content corresponding to the media data collected by the media collection device based on the directing event.

[0210] The director device provided in this embodiment determines the director mode of the director pen through the first director mode determination module; determines the director event of the director pen in the director mode through the first director module; transmits the director event to the recording and broadcasting host through the data transmission module, so that the recording and broadcasting host can generate the media content corresponding to the media data collected by the media acquisition device based on the director event. The above technical scheme allows the presenter to participate in the directing process through the director pen, and based on the director event of the director pen in the corresponding director mode, combined with the recording and broadcasting host to generate the media content corresponding to the director event, the required media content can be directed and recorded in time, thereby improving the accuracy of the content of the director.

[0211] Furthermore, the directing mode includes an automatic directing mode, and the first directing module 82 is specifically used for:

[0212] The directing event corresponding to the position information of the directing pen in the automatic directing mode is determined based on the event determination model.

[0213] Furthermore, the first broadcast guiding module 82 is specifically configured to:

[0214] In the case where the position information of the director pen matches the calibrated position information associated with the director image switching, the position information is input into the event determination model to obtain the director event of the director pen in the director mode; or

[0215] The position information of the director pen is input into the event determination model to obtain the directing event of the director pen in the directing mode.

[0216] Furthermore, the first broadcast guiding module 82 is specifically configured to:

[0217] The position information and the behavior information of the director pen are input into the event determination model to obtain the directing event of the director pen in the directing mode.

[0218] Furthermore, the event determination model is obtained by training based on the director event library;

[0219] Among them, the director event library is formed by the director events corresponding to the manual directing mode and the data associated with the director pen when the director events are generated, and the data associated with the director pen includes one or more of the location information of the director pen and the behavior information of the director pen.

[0220] Furthermore, the directing mode includes a manual directing mode, and the first directing module 82 is specifically used for:

[0221] In response to the presenter's triggering operation on a button on the director's pen, a directing event corresponding to the triggered button of the director's pen in the director mode is determined.

[0222] Furthermore, the device also includes:

[0223] The display module is used to display director indication information when an event corresponding to the marked position of the media content occurs, and the director indication information indicates the director event that needs to be triggered.

[0224] Furthermore, the directing mode includes a blackboard writing mode, and the first directing module 82 is specifically used for:

[0225] Determining behavior information of the director pen;

[0226] A broadcast director event corresponding to the behavior information is determined, wherein the broadcast director event includes a control message instructing a recording and broadcasting host to generate media content including target media data, and the target media data is media data collected by a media collection device corresponding to the control message.

[0227] The directing device provided in the embodiment of the present invention can execute the directing method provided in the first embodiment or the second embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0228] Embodiment 5

[0229] Fig. 9 is a structural diagram of a broadcast director device provided according to Embodiment 5 of the present invention. This embodiment is applicable to situations where broadcast director is implemented through a recording and broadcasting host, such as Fig. 9 As shown, the specific structure of the device includes:

[0230] A second directing mode determination module 91 is used to determine the directing mode of the directing pen;

[0231] The second directing module 92 is used to determine the directing event of the directing pen in the directing mode;

[0232] The media content generation module 93 is used to generate media content corresponding to the media data collected by the media collection device based on the director event.

[0233] The director device provided in this embodiment determines the director mode of the director pen through the second director mode determination module; determines the director event of the director pen in the director mode through the second director module; and generates the media content corresponding to the media data collected by the media acquisition device based on the director event through the media content generation module. The above technical solution generates the media content corresponding to the director event through the combination of the recording and broadcasting host and the director pen, and can timely direct and record the required media content, thereby improving the accuracy of the director content.

[0234] The directing device provided in the embodiment of the present invention can execute the directing method provided in the third embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0235] Embodiment 6

[0236] Fig.10 Schematic diagram of the structure of the director pen for implementing the director method of the embodiment of the present invention. Fig.10 As shown, the director pen includes at least one processor 11, a positioning module 12, a communication module 13 and a memory connected to the at least one processor 11 in communication, and the positioning module 12 and the communication module 13 are connected to the processor 11 respectively; wherein,

[0237] The memory stores a computer program executable by the at least one processor 11, and the computer program is executed by the at least one processor 11 so that the at least one processor 11 can perform the directing method according to the embodiment of the present invention;

[0238] The positioning module 12 is used to determine the position information of the director pen, and the communication module 13 is used to communicate with the recording and broadcasting host.

[0239] Among them, the positioning module 12 included in the director's pen is used to determine the position information of the director's pen. For example, the positioning module 12 can be set with a sensor that realizes positioning based on UWB technology, and the position information of the director's pen can be determined through the sensor.

[0240] The communication module 13 included in the director pen can be used to communicate with the recording and broadcasting host. The communication module 13 can be, for example, a network card, a modem, a wireless communication transceiver, Bluetooth, etc. The communication module 13 allows the director pen to exchange information / data with the recording and broadcasting host through a computer network such as the Internet and / or various telecommunication networks. For example, the director pen can be connected to the recording and broadcasting host through the built-in Bluetooth function of the communication module 13 to achieve two-way data transmission and remote control, including transmitting different teaching notes, director screen switching schemes, and the location information of the director pen to the recording and broadcasting host, and receiving commands and control signals initiated by the recording and broadcasting host.

[0241] The processor 11 included in the director pen can be various general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 11 executes the various methods and processes described above, such as the directing method.

[0242] The director pen includes a memory connected to at least one processor 11, such as a read-only memory (ROM) 14, a random access memory (RAM) 15, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 14 or the computer program loaded from the storage unit 16 to the random access memory (RAM) 15. In RAM 15, various programs and data required for the operation of the director pen can also be stored. The processor 11, ROM 14 and RAM 15 are connected to each other through a bus 17. The input / output (I / O) interface 18 is also connected to the bus 17. Among them, the storage unit 16 can be a disk.

[0243] In one embodiment, the director pen further includes: one or more of the following:

[0244] Laser module 19, input module 20, output module 21, identification module 22, power management module 23;

[0245] The laser module 19 is used to emit laser;

[0246] The input module 20 is used to respond to the trigger operation of the button on the director pen;

[0247] The output module 21 is used to output the position information of the director pen and the working status of the director pen;

[0248] The identification module 22 is used to realize the pairing connection between the director pen and the recording and broadcasting host;

[0249] The power management module 23 is used to supply power to the director pen.

[0250] Multiple components in the director pen are connected to the I / O interface 18, including: a laser module 19, an input module 20, an output module 21, an identification module 22 and a power management module 23.

[0251] The laser module 19 is used to emit laser light. For example, when a teacher uses the director pen to give a classroom demonstration, the laser light emitted by the laser module 19 will point to the teaching content indicated by the teacher, thereby providing clear and accurate instructions.

[0252] The input module 20 can be different buttons for responding to the trigger operation of the buttons on the director's pen; the input module 20 can also be a charging port for charging the director's pen.

[0253] The output module 21 is used to output the location information of the director pen and the working status of the director pen. The output module 21 can be various types of displays, speakers, liquid crystal display screens, etc. For example, the location information of the director pen can be displayed through the liquid crystal display screen. The working status of the director pen can also be displayed through the liquid crystal display screen. The working status can be the state of the director pen when it is working, such as real-time director screen, battery power of the director pen, charging status of the director pen, connection status and signal strength between the director pen and the recording and broadcasting host, etc.

[0254] The identification module 22 is used to realize the pairing connection between the director pen and the recording and broadcasting host. The identification module 22 can be a near field communication (NFC) tag, and the NFC tag can be used to realize the pairing of the director pen and the recording and broadcasting host.

[0255] The power management module 23 may be an integrated circuit responsible for managing the battery of the director pen. The DC voltage output by the battery or charger may be processed by the power management module 23 to provide a stable power supply for the director pen. The power management module 23 may generally include multiple modules such as a battery manager, a DC-DC converter, a charging manager, and a battery protection module to monitor, switch, and control the power status.

[0256] In some embodiments, the directing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 16. In some embodiments, part or all of the computer program may be loaded and / or installed on the directing pen via the ROM 14 and / or the communication module 13. When the computer program is loaded into the RAM 15 and executed by the processor 11, one or more steps of the directing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the directing method in any other appropriate manner (e.g., by means of firmware).

[0257] Fig.11 is a structural schematic diagram of another directing pen for implementing the directing method of the embodiment of the present invention. In a teaching scenario, Fig.11 The director pen shown in the figure is used to exemplify the structure of the director pen, as follows:

[0258] Power management module: The power management module can be an integrated circuit responsible for managing the battery of the director pen. The power management module can process the DC voltage output by the battery or charger to provide a stable power supply.

[0259] Near Field Communication (NFC) identification module (i.e. identification module): NFC tags can be used to pair the director pen with the recording and broadcasting host. For example, before starting a class, the teacher can automatically pair the director pen with the recording and broadcasting host with an NFC tag, and use the NFC tag for identity authentication and authorization to ensure the security and legality of teaching and recording.

[0260] Key module (ie, input module): the key module may include the screen switching key, switch key, recording and broadcasting function control key, function selection switch, adjustment key and laser key involved in the above-mentioned embodiments.

[0261] LCD display module (i.e. output module): It is used to display the real-time director screen and the teacher's location information, and to help with operations such as teaching recording or monitoring of the teaching process. The LCD display module can also be used to: display the battery power and charging status of the director pen, so that users can understand the power consumption of the device at any time and charge it in time; display the connection status and signal strength between the director pen and the recording and broadcasting host to help users understand the communication status between the devices; display the recording and directing status of the director pen, as well as the prompt information when the director switches and the recording is paused, so that users can operate and adjust; display the selection and adjustment information of the director screen, such as the screen size, lens focal length, exposure, focus, etc., to help users adjust the screen effect; display the location information of teachers and students, as well as the operation information of auxiliary tools such as electronic whiteboards, so that users can record and monitor teaching activities in an all-round way.

[0262] Storage module (i.e., memory or storage unit): used to store location information, such as storing the location information of the director's pen at different time points, including longitude, latitude, altitude and posture, etc. These location information can help the director's pen determine the changes in the teacher's position and provide location information as an auxiliary explanation of the director's data; used to store calibrated position information. Before using the director's pen, the director's pen needs to be matched with the specified map, and the calibrated location information needs to be saved in the storage module to provide accurate calibration and location information for subsequent video recording; used to store director data for subsequent director strategy and director behavior analysis.

[0263] Laser light module (i.e. laser module): used to indicate the location and confidence of teaching content. When the teacher uses the director pen for classroom demonstration, the laser emits red light to point to the teaching content indicated by the teacher, thus providing clear and accurate instructions. The working principle of laser emission of red light is that when the teacher uses the director pen, its laser light module will emit a beam of visible red light to the front, which is used to mark the location and area indicated by the teacher.

[0264] UWB module (i.e. positioning module): used to achieve high-precision indoor positioning and location recognition, including: High-precision indoor navigation and positioning: In conjunction with the geographic positioning system service, the UWB module can achieve high-precision indoor navigation and positioning, allowing the director's pen to be more freely positioned indoors, achieving more accurate and efficient director recording. Position recognition and tracking in the classroom: By installing multiple UWB nodes in the classroom, the real-time recognition and tracking of the director's pen's position and posture can be achieved, thereby helping teachers better control the teaching process and effect.

[0265] MCU module: It can be used as the central processing unit (i.e. processor) and wireless networking processor (i.e. communication module) of the director pen, and establish a Bluetooth connection with the recording and broadcasting host or Bluetooth speaker to achieve data transmission and remote control. Among them, the central processing unit can realize various calculation and control functions of the director pen, such as teacher position calculation, director strategy processing, recording and broadcasting host control, etc.; the wireless networking processor can connect to the recording and broadcasting host through the built-in Bluetooth function to achieve two-way data transmission and remote control, including the transmission of different teaching notes, director screen switching schemes, teacher position and other information to the recording and broadcasting host, as well as the reception of commands and control signals initiated by the recording and broadcasting host.

[0266] In general, MCU is a very important component of the director pen. It can upload information such as the teacher's location, director strategy, and recording and broadcasting host control to the recording and broadcasting host, realize functions such as director screen switching, and greatly improve the efficiency and quality of the teaching process. Through the use of Bluetooth technology, the MCU module can also achieve wireless networking, which is convenient for teachers to perform real-time push, remote control and other operations.

[0267] Fig.12 Schematic diagram of the structure of the recording and broadcasting host implementing the broadcasting method of the embodiment of the present invention. Fig.12 As shown, the recording and broadcasting host includes at least one processor 121, and a memory connected to the at least one processor 121, such as a read-only memory (ROM) 122, a random access memory (RAM) 123, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 121 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 122 or the computer program loaded from the storage unit 128 to the random access memory (RAM) 123. In RAM 123, various programs and data required for the operation of the recording and broadcasting host can also be stored. The processor 121, ROM 122 and RAM 123 are connected to each other via a bus 124. An input / output (I / O) interface 125 is also connected to the bus 124.

[0268] Multiple components in the recording and broadcasting host are connected to the I / O interface 125, including: an input unit 126, such as a keyboard, a mouse, buttons, etc.; an output unit 127, such as various types of displays, speakers, liquid crystal display screens, etc.; a storage unit 128, such as a disk, etc.; and a communication unit 129, such as a network card, a modem, a wireless communication transceiver, Bluetooth, etc. The communication unit 129 allows the recording and broadcasting host to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0269] The processor 121 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 121 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 121 performs the various methods and processes described above, such as the directing method.

[0270] In some embodiments, the directing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 128. In some embodiments, part or all of the computer program may be loaded and / or installed on the recording and broadcasting host via ROM 122 and / or communication unit 129. When the computer program is loaded into RAM 123 and executed by processor 121, one or more steps of the directing method described above may be performed. Alternatively, in other embodiments, processor 121 may be configured to execute the directing method in any other appropriate manner (e.g., by means of firmware).

[0271] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0272] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0273] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0274] To provide interaction with a user, the systems and techniques described herein may be implemented on a recording and broadcasting host having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the recording and broadcasting host. Other types of devices may also be used to provide interaction with a user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0275] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0276] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0277] Embodiment 7

[0278] Fig.13 It is a structural schematic diagram of a director system provided according to Embodiment 7 of the present invention, wherein the director system includes multiple media acquisition devices and a recording and broadcasting host, and a director pen provided by the present invention, wherein the multiple media acquisition devices are used to acquire media data within a collection area, the director pen is used to transmit director events to the recording and broadcasting host, and the recording and broadcasting host is used to generate media content corresponding to the media data collected by the media acquisition devices based on the director events.

[0279] like Fig.13As shown, the director pen is connected to the recording and broadcasting host, and multiple media acquisition devices are connected to the director pen and the recording and broadcasting host respectively. Among them, the director pen is used to transmit the director event to the recording and broadcasting host. After the recording and broadcasting host receives the director event transmitted by the director pen, the director event transmitted by the director pen can be directly used as the final director event to achieve directing; or the recording and broadcasting host can combine the director event transmitted by the director pen, and in the director module included in the recording and broadcasting host, the final director event is confirmed according to the algorithm built into the recording and broadcasting host to achieve directing.

[0280] After the recording and broadcasting host confirms the final directing event, the recording and broadcasting host can confirm the pictures that need to be directed based on the final directing event, and obtain the pictures that need to be directed from the media acquisition device. For example, the media acquisition device can transmit all the collected pictures to the recording and broadcasting host, and carry the identification corresponding to the picture when transmitting the picture. The recording and broadcasting host can determine the pictures that need to be directed based on the identification of the pictures to be directed.

[0281] The director system provided by the embodiment of the present invention determines the director event through the director pen, and generates the media content corresponding to the director event in combination with the recording host and the media acquisition device. The required media content can be directed and recorded in time, thereby improving the accuracy of the directed content.

[0282] Embodiment 8

[0283] Fig.14 It is a structural schematic diagram of a director system provided according to Embodiment 8 of the present invention, the director system includes a director pen, multiple media acquisition devices and a recording and broadcasting host provided by the present invention, the multiple media acquisition devices are used to obtain media data in a collection area, the recording and broadcasting host is used to determine the director event corresponding to the director pen, and generate media content corresponding to the media data collected by the media acquisition device based on the director event, the director pen is used to transmit the data associated with the director pen required for the recording and broadcasting host to determine the director event to the recording and broadcasting host.

[0284] like Fig.14 As shown, the director's pen is communicatively connected to the recording and broadcasting host, and multiple media acquisition devices are communicatively connected to the director's pen and the recording and broadcasting host respectively.

[0285] The director pen is used to transmit the data associated with the director pen required by the recording and broadcasting host to determine the director event to the recording and broadcasting host. The data associated with the director pen required by the recording and broadcasting host to determine the director event may be one or more of the location information of the director pen and the behavior information of the director pen.

[0286] After the recording and broadcasting host receives the location information and / or behavior information transmitted by the director's pen, the director module included in the recording and broadcasting host determines the director event corresponding to the director's pen based on the event determination model built into the recording and broadcasting host for determining the director's event, combined with the location information of the director's pen and / or the behavior information of the director's pen.

[0287] After the recording and broadcasting host determines the directing event corresponding to the director pen, the recording and broadcasting host can generate the media content corresponding to the media data collected by the media acquisition device based on the directing event. Specifically, the recording and broadcasting host can confirm the picture that needs to be directed according to the directing event, and obtain the picture that needs to be directed from the media acquisition device. After obtaining the picture that needs to be directed, the picture can be recorded and stored. By recording and storing different directed pictures, the media content corresponding to the media data collected by the media acquisition device can be generated.

[0288] A director system provided by an embodiment of the present invention determines the director event corresponding to the director pen based on the data associated with the director pen required for determining the director event through a recording host, and generates media content corresponding to the director event in combination with a media acquisition device. The required media content can be directed and recorded in a timely manner, thereby improving the accuracy of the director content.

[0289] Embodiment 9

[0290] Fig.15 1 is a schematic diagram of the structure of a broadcast director system provided according to Embodiment 9 of the present invention. In this embodiment, the structure of the broadcast director system involved in the above embodiment is exemplarily described in a teaching scenario, as follows:

[0291] The director system includes: multiple media acquisition devices (such as teacher cameras, student cameras, personal computers (PCs) and touch screens), director pens and recording and broadcasting hosts. The director pen is connected to the recording and broadcasting host for communication, and multiple media acquisition devices are connected to the director pen and the recording and broadcasting host for communication, respectively.

[0292] Among them, the teacher's camera or the student's camera can shoot multiple different pictures, and each picture can generate a unique corresponding director code (i.e., the identification of the picture). When the teacher's camera or the student's camera transmits the captured picture to the recording and broadcasting host, it can carry the director code corresponding to the picture. After the director pen transmits the determined directing event to the recording and broadcasting host, or transmits the location information and / or behavior information of the director pen to the recording and broadcasting host, the recording and broadcasting host confirms the picture that needs to be directed, and obtains the picture that needs to be directed through the director code of the confirmed picture and generates the corresponding media content.

[0293] Through the following content Fig.15 The director pen included in the director system shown is described as follows:

[0294] Precise positioning module: The director's pen is equipped with a high-precision positioning sensor, which can accurately locate and track the teacher's position, thereby effectively capturing and recording the teacher's teaching process. The positioning module processes the teacher's position information in real time, such as the position information of the director's pen.

[0295] Director mode determination module and director module: The director pen has built-in intelligent algorithms and adaptive control systems. It can add the logic requirement of actively initiating director image switching in the "automatic" or "manual" director strategy (i.e., director event) according to the teacher's position, behavior, and teaching content, so as to adjust the acquisition director strategy of the recording host, thereby achieving the best live broadcast and recording effects. When the teacher moves, the director pen can provide the teacher with accurate location information, and then link the camera to accurately track the teacher's position. At the same time, the recording host automatically switches to a suitable mobile acquisition lens. Among them, configuring the director strategy can be configuring the director strategy in the director software (which can be configured in the director pen), such as manual director and automatic director, etc.; adding the logic of director screen switching can be that when the teacher needs to switch the director screen, pressing the button in the button module can trigger the switch to the corresponding director screen. At this time, the director pen will send the command of switching and adding the screen to the director software and implement the operation.

[0296] The data transmission module is used to realize data interaction with the recording and broadcasting host.

[0297] Recording and broadcasting host control module: The director pen can communicate with the recording and broadcasting host to achieve remote control and adjustment of the recording and broadcasting host. Through the buttons of the director pen, the teacher can adjust the acquisition strategy and recording parameters of the recording and broadcasting host at any time to achieve the best recording effect. At the same time, the director pen can also realize real-time monitoring of the recording and broadcasting host, so as to adjust the problems that arise during the recording process in a timely manner.

[0298] The teaching behavior analysis module can analyze the teacher's teaching behavior. For example, when the teacher writes on the blackboard with a director's pen, the trajectory information of the director's pen is processed and analyzed to identify the teacher's behavior of writing on the blackboard.

[0299] Blackboard recognition module: When the teacher uses the director pen to write, the built-in sensor of the director pen can recognize the teacher's action of writing on the blackboard. With the help of the teaching behavior analysis module, the trajectory information of the director pen can be processed and analyzed to identify the teacher's behavior of writing on the blackboard. If the teacher is detected writing on the blackboard, a control message will be sent to the camera and the recording and broadcasting host. When the camera and the recording and broadcasting host receive the control message, the director software will immediately switch the director screen according to the priority of the blackboard to display the process of the teacher writing on the blackboard and the recognized blackboard data. At this time, the director screen will switch to the blackboard mode and display the image or text of the blackboard. When the teacher stops writing on the blackboard, the director software will receive the message sent by the teaching behavior analysis module again, and switch the director screen in time, exit the blackboard mode, and return to the normal director mode (such as manual director mode or automatic director mode).

[0300] Director strategy feedback module: used to analyze the effects of director strategies in real time, and output feedback information and suggestions to help director operators adjust and improve director strategies. At the same time, it analyzes and summarizes the experience in the directing process, establishes a director strategy library and applies it to the learning of director strategies, so as to improve director capabilities and teaching effects.

[0301] During the directing process, the teacher can actively initiate directing needs based on the actual teaching scenario. For example, when the teacher mentions an important knowledge point during the teaching process and hopes to present it to the students through the directing screen, the directing screen can be switched by controlling the director's pen. At this time, the directing event provided by the teacher has the highest priority.

[0302] In one embodiment, the sensor built into the director pen can record the teacher's position and behavior, as well as the director's directing requirements initiated by the teacher in real time. The recorded information includes the content written by the teacher through the director pen, the teacher's position and direction, and the director's directing requirements initiated by the teacher.

[0303] In teaching activities, the corresponding directing events can be recorded in combination with the teacher's position and behavior, and the event determination model can be generated through big data learning. For the generated event determination model, the directing strategy can be continuously optimized and learned through machine learning algorithms to improve the accuracy and execution effect of the event determination model.

[0304] In one embodiment, when the director software automatically recognizes the director demand initiated by the teacher, the event determination model can be used to automatically call the appropriate director strategy to achieve the corresponding screen switching. After the event determination model is continuously trained, for the director demand that appears in high-frequency positions, the director module can automatically coordinate the recording and broadcasting host and the camera to perform the corresponding screen switching.

[0305] In one embodiment, the teacher can provide feedback and make adjustments based on the directing effect. If the directing effect needs to be adjusted and optimized, the directing requirement can be initiated again, and the switching effect of the directing screen can be achieved by controlling the directing pen.

[0306] By recording the position and behavior of the director pen and training and optimizing the big data learning model (i.e., event determination model), personalized directing needs in teaching scenarios can be realized, better meeting the teaching needs of teachers and improving teaching effectiveness and efficiency. At the same time, this is also an application and innovation of artificial intelligence in the field of education and teaching.

[0307] By using the director's pen of the embodiment of the present invention, when recording a micro-class or a high-quality course, a teacher can achieve precise director control of the entire recording by himself; the director's pen has simple functions, is easy to use, and conforms to the user's operating habits; the director's pen is equipped with multiple buttons, which can realize different functions, facilitate teaching operations, and meet the requirements of teaching scenarios; the use of UWB sensors can achieve high-precision positioning and director's screen indication, ensure the accurate correspondence between the user (i.e., the user) and the teaching content, and help the teacher to indicate the teaching content more accurately; the user can use the director's pen to adjust the lens or select the area when explaining, and the liquid crystal display module of the director's pen can display the director's information and the teacher's position in real time to better meet the teaching needs; the director's pen is equipped with an identification module and a storage module, which can realize identity authentication and authorization, and ensure the security and legality of teaching and recording; as a supplement to a multi-modal directing strategy, the director's pen can be used to direct based on image recognition methods, combined with the position information of the director's pen, which can effectively improve the directing effect and accuracy, so that the directing screen in the teaching process is more in line with actual needs.

[0308] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0309] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A broadcast directing method, characterized in that: Applied to a director pen, the method includes: Determine the directing mode the director pen is in; Determine a directing event of the directing pen in the directing mode; The directing event is transmitted to the recording and broadcasting host, so that the recording and broadcasting host generates media content corresponding to the media data collected by the media collection device based on the directing event.

2. The method according to claim 1, characterized in that The directing mode includes an automatic directing mode, and determining the directing event of the directing pen in the directing mode includes: The directing event corresponding to the position information of the directing pen in the automatic directing mode is determined based on the event determination model.

3. The method according to claim 2, characterized in that The determining of the directing event corresponding to the position information of the directing pen in the automatic directing mode based on the event determination model includes: In the case where the position information of the director pen matches the calibrated position information associated with the director image switching, the position information is input into the event determination model to obtain the director event of the director pen in the director mode; or The position information of the director pen is input into the event determination model to obtain the directing event of the director pen in the directing mode.

4. The method according to claim 3, characterized in that The step of inputting the position information into an event determination model to obtain a directing event of the directing pen in the directing mode includes: The position information and the behavior information of the director pen are input into the event determination model to obtain the directing event of the director pen in the directing mode.

5. The method according to any one of claims 2 to 4, characterized in that: The event determination model is obtained by training based on the director event library; Among them, the director event library is formed by the director events corresponding to the manual directing mode and the data associated with the director pen when the director events are generated, and the data associated with the director pen includes one or more of the location information of the director pen and the behavior information of the director pen.

6. The method according to claim 1, characterized in that The directing mode includes a manual directing mode, and determining the directing event of the directing pen in the directing mode includes: In response to the presenter's triggering operation on a button on the director's pen, a directing event corresponding to the triggered button of the director's pen in the director mode is determined.

7. The method according to claim 1, characterized in that Also includes: When an event corresponding to the marked position of the media content occurs, director indication information is displayed, where the director indication information indicates the director event that needs to be triggered.

8. The method according to claim 1, characterized in that The directing mode includes a blackboard writing mode, and determining the directing event of the directing pen in the directing mode includes: Determining behavior information of the director pen; A broadcast director event corresponding to the behavior information is determined, wherein the broadcast director event includes a control message instructing a recording and broadcasting host to generate media content including target media data, wherein the target media data is media data collected by a media collection device corresponding to the control message.

9. A broadcast directing method, characterized in that: Applied to a recording and broadcasting host, the method includes: Determine the directing mode the director pen is in; Determine a directing event of the directing pen in the directing mode; Media content corresponding to the media data collected by the media collection device is generated based on the director event.

10. A broadcasting device, characterized in that: include: A first directing mode determination module, used to determine the directing mode of the directing pen; A first directing module, used for determining a directing event of the directing pen in the directing mode; The data transmission module is used to transmit the director event to the recording and broadcasting host, so that the recording and broadcasting host can generate media content corresponding to the media data collected by the media collection device based on the director event.

11. A broadcasting device, characterized in that: include: A second directing mode determination module is used to determine the directing mode of the directing pen; A second directing module, used for determining a directing event of the directing pen in the directing mode; The media content generation module is used to generate media content corresponding to the media data collected by the media collection device based on the director event.

12. A director pen, characterized in that: include: A positioning module, a communication module, at least one processor and a memory connected to the at least one processor in communication, wherein the positioning module and the communication module are connected to the processor respectively; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the directing method according to any one of claims 1 to 8; The positioning module is used to determine the location information of the director pen, and the communication module is used to communicate with the recording and broadcasting host.

13. The broadcast director pen according to claim 12, characterized in that: Also includes: one or more of the following: Laser module, input module, output module, identification module, power management module; The laser module is used to emit laser; The input module is used to respond to the trigger operation of the button on the director pen; The output module is used to output the position information of the director pen and the working status of the director pen; The identification module is used to realize the pairing connection between the director pen and the recording and broadcasting host; The power management module is used to supply power to the director pen.

14. A recording and broadcasting host, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the directing method described in claim 9.

15. A broadcast director system, characterized in that: It comprises a director pen as described in claim 12 or 13, multiple media acquisition devices and a recording and broadcasting host, the multiple media acquisition devices are used to obtain media data in a collection area, the director pen is used to transmit director events to the recording and broadcasting host, and the recording and broadcasting host is used to generate media content corresponding to the media data collected by the media acquisition devices based on the director events.

16. A broadcast director system, characterized in that: It includes a director pen, multiple media acquisition devices and a recording and broadcasting host as described in claim 14, the multiple media acquisition devices are used to obtain media data in a collection area, the recording and broadcasting host is used to determine the director event corresponding to the director pen, and generate media content corresponding to the media data collected by the media acquisition devices based on the director event, and the director pen is used to transmit the data associated with the director pen required for the recording and broadcasting host to determine the director event to the recording and broadcasting host.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is used to enable a processor to implement the directing method described in any one of claims 1 to 8, or to implement the directing method described in claim 9 when executed.

Images