Digital multimedia exhibition hall control method, terminal, equipment and storage medium

Abstract

The invention discloses a digital multimedia exhibition hall control method, a terminal, equipment and a storage medium, and the method comprises the steps: periodically obtaining a current monitoring video through people stream portrait recognition equipment according to a preset collection period in a projection process; face recognition processing is carried out on each video frame in the current monitoring video in sequence, a crowd trend recognition result is obtained, and a block group number of a target block group where the current crowd is located is recorded in the crowd trend recognition result; based on the crowd trend identification result, generating a control instruction for the driving device; and sending a control instruction to the driving device, so that the driving device drives the mobile projector and the audio playing device to move to a position corresponding to the target block group. According to the scheme, the problem of poor experience of exhibition viewers in related technologies can be solved.

Description

Technical Field

[0001] The present application relates to the technical field of digital multimedia exhibition halls, and in particular to a control method, terminal, device and storage medium for a digital multimedia exhibition hall. Background Art

[0002] The exhibition hall provides a good platform for product and cultural display. Excellent exhibition hall design can give full play to the advantages of the target exhibition hall. The design of the exhibition hall should meet the traditional basic exhibition design requirements, so that the exhibits in the exhibition hall can be better displayed. At the same time, the design of the exhibition hall also needs to provide visitors with a good viewing experience.

[0003] At present, in addition to traditional exhibition halls, digital multimedia exhibition halls have become an important carrier for cultural, artistic and corporate displays. Traditional exhibition methods often rely on static displays, while digital multimedia exhibition halls combine multimedia elements such as images, audio, and video to display exhibits more vividly for visitors.

[0004] However, even in digital multimedia exhibition halls, the explanation of exhibits mostly relies on fixed text descriptions or fixed-point virtual tour guides, which has poor interactivity and affects the experience of visitors. Summary of the invention

[0005] In order to improve the experience of visitors, the present application provides a control method, terminal, device and storage medium for a digital multimedia exhibition hall.

[0006] In a first aspect, an embodiment of the present application provides a control method for a digital multimedia exhibition hall, the method is based on a control terminal in a digital multimedia exhibition hall system, the digital multimedia exhibition hall system also includes a fixed projector, a mobile projector, an audio playback device, a crowd and portrait recognition device connected to the control terminal by signal, and a driving device for driving the mobile projector and the audio playback device to move, the method comprising:

[0007] During the projection process, according to a preset acquisition cycle, the current monitoring video is periodically acquired through the crowd and portrait recognition device;

[0008] Performing portrait recognition processing on each video frame in the current surveillance video in turn to obtain a crowd movement recognition result, wherein the crowd movement recognition result records the block group number of the target block group where the current crowd is located;

[0009] Based on the crowd movement recognition result, generating a control instruction for the driving device;

[0010] The control instruction is sent to a driving device, so that the driving device drives the mobile projector and the audio playback device to move to a position corresponding to the target block group.

[0011] In some embodiments, before the current monitoring video is periodically acquired through the crowd and portrait recognition device according to a preset acquisition cycle, the method further includes:

[0012] After receiving the projection request instruction carrying the target exhibit number, the target exhibit material corresponding to the target exhibit number is selected from the pre-stored exhibit material library, and the target tour guide image material is selected from the pre-stored tour guide material library, wherein the target exhibit material includes the target image material and the target tour guide voice material;

[0013] Sending the target image material to the fixed projector, and controlling the fixed projector to start projection;

[0014] Sending the target interpreter image material to the mobile projector to control the mobile projector to start projection;

[0015] The target explanation voice material is sent to the audio playback device to control the audio playback device to play.

[0016] In some embodiments, a standard exhibition hall picture is pre-stored in the control terminal, and the standard exhibition hall picture is pre-divided into a plurality of block groups, each of which includes at least three position blocks. The human portrait recognition process is performed on each video frame in the current monitoring video in turn to obtain a crowd movement recognition result, including:

[0017] Extracting all N video frames arranged in time from the current surveillance video;

[0018] Performing portrait recognition processing on each of the video frames in turn to determine the location block where the current crowd is located in each of the video frames;

[0019] If the position blocks where the current crowd is located in all the video frames belong to the first block group, the first block group is used as the target block group;

[0020] Generating a crowd movement recognition result carrying the block group number of the target block group;

[0021] If the position blocks where the current crowd is located in the first X video frames belong to the first block group, and the position blocks where the current crowd is located in the last Y video frames belong to the second block group, the first block group is used as the starting block group, and the second block group is used as the target block group, wherein X+Y≤N;

[0022] A crowd movement recognition result carrying the block group numbers of both the starting block group and the target block group is generated.

[0023] In some embodiments, the generating of control instructions for the driving device based on the crowd movement recognition result includes:

[0024] When the crowd movement recognition result only includes the block group number of the target block group, the generated instruction content is a control instruction to keep still;

[0025] When the crowd movement recognition result includes the block group numbers of both the starting block group and the target block group, the moving path of the driving device is obtained based on the difference between the block group numbers of the two;

[0026] A control command is generated to cause the drive device to operate according to the movement path.

[0027] In some embodiments, each of the video materials of the explainer in the explainer material library includes a static image, a first dynamic image whose movement direction is a first direction, and a second dynamic image whose movement direction is a second direction;

[0028] While sending the control instruction to the driving device, it also includes:

[0029] When the instruction content of the control instruction is to keep still, the static image in the target lecturer image material is sent to the mobile projector for projection;

[0030] When the control instruction is a control instruction for causing the driving device to operate along the moving path, based on the movement direction of the moving path, the first dynamic image or the second dynamic image in the target tour guide image material is sent to the mobile projector for projection.

[0031] In some embodiments, the digital multimedia exhibition hall system further includes a lighting system, the exhibit materials recorded in the exhibit material library are classified into several exhibit types, and the control terminal records lighting control schemes corresponding to the exhibit types one by one;

[0032] After receiving the projection request instruction carrying the target exhibit number, while selecting the target exhibit material corresponding to the target exhibit number from the pre-stored exhibit material library, it also includes:

[0033] Retrieving a target lighting control solution corresponding to the material type of the target exhibit material;

[0034] The operation of the lighting system is controlled according to the target lighting control scheme.

[0035] In some embodiments, in the guide material library, different guide image materials have different clothing features, and the clothing features correspond one by one to the exhibit types;

[0036] When selecting a target tour guide image material from the pre-stored tour guide material library, the clothing features of the selected target tour guide image material correspond to the exhibit type of the target exhibit material.

[0037] In a second aspect, an embodiment of the present application provides a control terminal for a digital multimedia exhibition hall, wherein the control terminal is included in a digital multimedia exhibition hall system, wherein the digital multimedia exhibition hall system further includes a fixed projector, a mobile projector, an audio playback device, a crowd portrait recognition device, and a driving device for driving the mobile projector and the audio playback device to move, which are connected to the control terminal by signals. The control terminal includes:

[0038] A monitoring video acquisition module is used to periodically acquire the current monitoring video through the crowd and portrait recognition device according to a preset acquisition cycle during the projection process;

[0039] An image processing module is used to perform portrait recognition processing on each video frame in the current monitoring video in turn to obtain a crowd movement recognition result, wherein the crowd movement recognition result records the block group number of the target block group where the current crowd is located;

[0040] A control instruction generation module, used for generating a control instruction for the driving device based on the crowd movement recognition result;

[0041] The instruction sending module is used to send the control instruction to the driving device, so that the driving device drives the mobile projector and the audio playing device to move to a position corresponding to the target block group.

[0042] In a third aspect, an embodiment of the present application provides a control device, the control device comprising a processor and a memory, the memory storing a computer program, and the processor implementing the control method of the digital multimedia exhibition hall as described in the first aspect when executing the computer program.

[0043] In a fourth aspect, an embodiment of the present application provides a storage medium having a program stored thereon, and when the program is executed by a processor, it is used to implement the control method of the digital multimedia exhibition hall as described in the first aspect.

[0044] The technical solution of this application has at least the following advantages:

[0045] 1. During the projection process, the video material of the guide projected by the mobile projector and the audio material of the guide played by the audio playback device will move with the movement of the crowd, thereby improving the audio-visual effect obtained by the visitors in the crowd and improving the interactive experience of the visitors. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0047] Figure 1 is a schematic diagram of a digital multimedia exhibition hall system provided by an exemplary embodiment of the present application;

[0048] Figure 2 is a flow chart of a control method for a digital multimedia exhibition hall provided by an exemplary embodiment of the present application;

[0049] Figure 3 is a schematic diagram for reflecting the block group division method provided by an exemplary embodiment of the present application;

[0050] Figure 4 is a structural block diagram of a control terminal provided by an exemplary embodiment of the present application;

[0051] Figure 5 It is a structural block diagram of a control device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0052] The following will be combined with the accompanying drawings to clearly and completely describe the technical solutions in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0053] In the description of the present application, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0054] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, it can also be the internal connection of two components, it can be a wireless connection, or it can be a wired connection. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0055] In addition, the technical features involved in the different embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0056] The present application provides a control method for a digital multimedia exhibition hall. The method is based on a control terminal in a digital multimedia exhibition hall system. Figure 1 The digital multimedia exhibition hall system also includes a fixed projector, a mobile projector, a crowd portrait recognition device, an audio playback device for the mobile projector, and a driving device for driving the mobile projector and the audio playback device. The control terminal stores an exhibit material library and a guide material library. The exhibit material library contains a number of exhibit materials with exhibit numbers added, and each exhibit material includes an image material and an explanation voice material. The guide material library contains a number of guide image materials. The exhibition hall is also equipped with an exhibit display screen and an explanation image display screen. The exhibit display screen can be an arc screen and is installed on the wall of the exhibition hall. The fixed projector is set opposite the exhibit display screen and is used to project the image material of the displayed item onto the exhibit display screen. The image material includes 3D video, animation, etc. In order to improve the display effect, a plurality of fixed projectors can be arranged in an arc array, and multi-channel projection technology is used to project the complete image material onto the arc exhibit display screen. The explanation image display screen can be configured in a location such as the center of the exhibition hall, and will not interfere with the exhibit display screen. A guide rail can be arranged in the upper area of ​​the explanation image display screen, a driving device can be configured on the guide rail, and a mobile projector is fixedly installed on the driving device. During the movement of the mobile projector, it will always face an area on the explanation image display screen. The crowd portrait recognition device can include multiple cameras distributed in the exhibition hall, which are used to identify images of people and facial images in the exhibition hall. The fixed projector, mobile projector, audio playback device, driving device and crowd portrait recognition device are all connected to the control terminal for signal interaction with the control terminal and operate under the instruction of the control terminal.

[0057] Among them, refer to Figure 2 ,The control method of the digital multimedia exhibition hall includes the following contents:

[0058] S10: During the projection process, according to a preset acquisition cycle, the current monitoring video is periodically acquired through a crowd and portrait recognition device.

[0059] For example, during the projection task performed by the fixed projector and the mobile projector, the crowd and portrait recognition equipment will collect real-time surveillance video of the personnel area in the exhibition hall and transmit it to the control terminal. The control terminal will identify the real-time surveillance video in the current period as the current surveillance video according to a preset collection period, such as once every 3 seconds, once every 5 seconds, etc.

[0060] S20: Performing portrait recognition processing on each video frame in the current monitoring video in turn to obtain a crowd movement recognition result, in which the crowd movement recognition result records the block group number of the target block group where the current crowd is located.

[0061] In the control terminal, a standard exhibition hall picture showing the pedestrian area in the exhibition hall can be pre-stored, and the standard exhibition hall picture is pre-divided into several block groups according to the expansion direction of the explanation image display screen, and each block group is then divided into at least three position blocks according to the expansion direction of the explanation image display screen. Figure 3 As shown, in Figure 3 In the figure, A1, A2, A3, B1, B2, and B3 are respectively a position block, and A1, A2, and A3 belong to a block group, and B1, B2, and B3 belong to another adjacent block group. It should be noted that the size and acquisition cycle of each position block are coordinated so that the normal walking visitors can move within two adjacent position blocks in one cycle at most. At the same time, for each block group, the control terminal records the position status of the drive device, so that a control instruction can be generated that can accurately control the drive device to move the mobile projector to the block group.

[0062] Exemplarily, the control terminal extracts each video frame in the current surveillance video, and performs portrait recognition processing on each video frame in sequence along the timeline, thereby obtaining a crowd movement recognition result that reflects the area where most people in the crowd in the exhibition hall are currently located. The crowd movement recognition result records the block group number of the target block group where the current crowd is located.

[0063] S30: Generate control instructions for the driving device based on the crowd movement recognition result.

[0064] Exemplarily, the control terminal may generate control instructions for the driving device according to the crowd movement recognition result.

[0065] S40: Sending a control instruction to the driving device so that the driving device drives the mobile projector and the audio playback device to move to a position corresponding to the target block group.

[0066] Exemplarily, the control terminal sends a control instruction to the driving device, so that the driving device executes the control instruction and drives the mobile projector and the audio playback device to move to a position corresponding to the target block group.

[0067] By adopting the above scheme, the video material of the tour guide projected by the mobile projector and the audio material of the tour guide played by the audio playback device will move with the movement of the crowd, thereby improving the audio-visual effect obtained by the visitors in the crowd and improving the interactive experience of the visitors.

[0068] Furthermore, in some embodiments, before the above S10, the following processing is also included to start the projection process:

[0069] S01: After receiving a projection request instruction carrying a target exhibit number, a target exhibit material corresponding to the target exhibit number is selected from a pre-stored exhibit material library, and a target tour guide image material is selected from a pre-stored tour guide material library.

[0070] Among them, the target exhibit materials include target image materials and target explanation voice materials.

[0071] For example, when exhibits need to be displayed, the manager can select the target exhibits to be displayed through the interactive device connected to the control terminal. After the selection is completed, the interactive device can automatically identify the target exhibit number and then send a projection request instruction carrying the target exhibit number to the control terminal. After receiving the projection request instruction, the control terminal selects the target exhibit material from the preset exhibit material library according to the target exhibit number, and selects the target tour guide image material from the pre-stored tour guide material library. After that, the control terminal can execute S02 to S04 at the same time.

[0072] S02: Send the target image material to the fixed projector, and control the fixed projector to start projection.

[0073] Exemplarily, the control terminal sends the target image material to the fixed projector, and controls the fixed projector to start projection, so that the target image material can be projected onto the exhibit display screen for visitors to appreciate.

[0074] S03: Send the target tour guide image material to the mobile projector to control the mobile projector to start projection.

[0075] Exemplarily, the control terminal sends the target lecturer image material to the mobile projector, and controls the mobile projector to start projection, thereby projecting the target lecturer image material onto the lecture image display screen. It should be noted that initially, the projection projector is in a preset position.

[0076] S04: Send the target explanation voice material to the audio playback device to control the audio playback device to play.

[0077] Exemplarily, the control terminal sends the target explanation voice material to the audio playback device, and controls the audio playback device to play the target explanation voice material.

[0078] Furthermore, in some embodiments, the above S20 may include the following processing:

[0079] S201: extracting all N video frames arranged in timeline from the current surveillance video.

[0080] Exemplarily, the control terminal extracts all N video frames arranged on the time axis from the current monitoring video.

[0081] S202: Performing portrait recognition processing on each video frame in turn to determine the location block where the current crowd is located in each video frame.

[0082] Exemplarily, the control terminal performs portrait recognition processing on each video frame in turn, thereby respectively identifying the position block where the current crowd in each video frame is located. Among them, for any video frame, when multiple position blocks recognize portrait features, the position block with the most recognized portrait features is used as the position block where the current crowd in the video frame is located.

[0083] S203: If the position blocks where the current crowd is located in all video frames belong to the first block group, the first block group is used as the target block group.

[0084] Exemplarily, if the position blocks where the current crowd is located in all video frames belong to the same block group, that is, the first block group, the control terminal will use the first block group as the target block group.

[0085] S204: Generate a crowd movement recognition result carrying the block group number of the target block group.

[0086] Exemplarily, after S203 , a crowd movement recognition result carrying the block group number of the target block group is generated.

[0087] S205: If the position block where the current crowd is located in the first X video frames belongs to the first block group, and the position block where the current crowd is located in the next Y video frames belongs to the second block group, the first block group is used as the starting block group, and the second block group is used as the target block group, wherein X+Y≤N.

[0088] Exemplarily, the position block where the current crowd is located in the current X video frames belongs to the first block group, and the position block where the current crowd is located in the next Y video frames belongs to the second block group, then the first block group is used as the starting position block, and the second block group is used as the target block group, wherein X+Y≤N. When the above situation occurs, it means that the crowd has moved in the current cycle, and the starting point of the movement is the position block in the first block group, and the end point is the position block in the second block group. Since in the previous steps, the size of each position block and the acquisition cycle are coordinated and set, so that the normal walking visitors can move within a cycle for at most two adjacent position blocks. Therefore, when entering the next acquisition cycle, the visitors are still in the second block group, and are located in the position block in the second group block adjacent to the first group block. At the same time, when the starting point and the end point are determined, the movement direction of the crowd is also determined.

[0089] S206: Generate a crowd movement recognition result carrying the block numbers of both the starting position block and the target position block.

[0090] Exemplarily, after S205 , the control terminal generates a crowd movement recognition result carrying the block group numbers of both the starting block group and the target block group.

[0091] Furthermore, in some embodiments, the above S30 may include the following processing:

[0092] S301: When the crowd movement recognition result only includes the block group number of the target block group, a control instruction is generated with the instruction content being to remain motionless.

[0093] Exemplarily, when the crowd movement recognition result only includes the block group number of the target block group, it means that the crowd stays in the target block group, so the control terminal generates a control instruction with the instruction content of staying still.

[0094] S302: When the crowd movement recognition result includes the block group numbers of both the starting block group and the target block group, a moving path of the driving device is obtained based on the difference between the block group numbers.

[0095] Among them, S302 and S301 are executed alternatively.

[0096] Exemplarily, when the crowd movement recognition result includes the block group numbers of both the starting block group and the target block group, it means that the crowd has moved from the last position block of the starting block group (i.e., the position block adjacent to the target block group) to the first position block of the target block group (i.e., the position block adjacent to the starting block group) in the current cycle. At this time, the control terminal obtains the moving path of the driving device according to the difference in the block group numbers of the two, wherein when the difference is 1, a moving path with a moving direction of the first direction is generated, and when the difference is -1, a moving path with a moving direction of the second direction is generated.

[0097] S303: Generate a control instruction for causing the driving device to operate according to the moving path.

[0098] Exemplarily, after S302 , the control terminal generates a control instruction for causing the driving device to operate according to the moving path.

[0099] Furthermore, in some embodiments, each of the video materials of the tour guide in the tour guide material library includes a static image, a first dynamic image with a first moving direction, and a second dynamic image with a second moving direction, and the difference between the three mainly lies in the different movements of the tour guide. On this basis, while executing the above S40, the control terminal also performs the following processing:

[0100] When the instruction content of the control instruction is to keep still, the static image in the target lecturer image material is sent to the mobile projector for projection.

[0101] Exemplarily, after generating a control instruction with the instruction content of "stay still", the control terminal will move the projector to send a static image in the target tour guide's image material for projection.

[0102] When the control instruction is a control instruction for causing the driving device to operate according to the moving path, based on the moving direction of the moving path, the first dynamic image or the second dynamic image in the target commentator image material is sent to the mobile projector for projection.

[0103] Exemplarily, when a control instruction is generated for causing the driving device to operate along a moving path, and the moving direction of the moving path is a first direction, the control terminal will send a first dynamic image in the target lecturer image material to the mobile projector. When a control instruction is generated for causing the driving device to operate along a moving path, and the moving direction of the moving path is a second direction, the control terminal will send a second dynamic image in the target lecturer image material to the mobile projector.

[0104] Furthermore, in some embodiments, the digital multimedia exhibition hall system also includes a lighting system, and the exhibit materials recorded in the exhibit material library are classified into several exhibit types, and the control terminal records a lighting control scheme corresponding to the exhibit type. For example, the exhibit types may include various types of cultural relics, various types of scientific and technological equipment, etc. Using different lighting control schemes according to different exhibit types can effectively improve the experience of visitors. In this case, while executing the above S01, the control terminal can also perform the following processing:

[0105] Retrieve a target lighting control solution corresponding to the material type of the target exhibit material.

[0106] Exemplarily, the control terminal will call the corresponding target lighting control solution according to the material type of the retrieved target exhibit material.

[0107] Control the operation of the lighting system according to the target lighting control plan.

[0108] Exemplarily, the control terminal controls the operation of the lighting system according to the target lighting control scheme.

[0109] Furthermore, in some embodiments, in the guide material library, different guide image materials have different clothing features, and the clothing features correspond to the exhibit types one by one. On this basis, when the control terminal selects the target guide image material from the pre-stored guide material library, the clothing features of the selected target guide image material correspond to the exhibit type of the target exhibit material, thereby further improving the experience of the visitors.

[0110] The present application also discloses a control terminal for a digital multimedia exhibition hall, wherein the control terminal is included in a digital multimedia exhibition hall system, and the digital multimedia exhibition hall system also includes a fixed projector, a mobile projector, an audio playback device, a crowd and portrait recognition device, and a driving device for driving the mobile projector and the audio playback device to move, which are connected to the control terminal by signal. Figure 4 As shown, the control terminal includes:

[0111] The monitoring video acquisition module is used to periodically acquire the current monitoring video through the crowd and portrait recognition device according to the preset acquisition cycle during the projection process;

[0112] The image processing module is used to perform portrait recognition processing on each video frame in the current monitoring video in turn to obtain a crowd movement recognition result, in which the crowd movement recognition result records the block group number of the target block group where the current crowd is located;

[0113] A control instruction generation module, used for generating control instructions for a driving device based on crowd movement recognition results;

[0114] The instruction sending module is used to send a control instruction to the driving device, so that the driving device drives the mobile projector and the audio playing device to move to a position corresponding to the target block group.

[0115] refer to Figure 5 The present application also provides a control device, which includes a processor and a memory.

[0116] The processor may include one or more processing cores. The processor uses various interfaces and lines to connect the various parts of the entire device, and executes various functions of the device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory, and calling data stored in the memory. Optionally, the processor can be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor can integrate one or a combination of a central processing unit (CPU) and a modem. Among them, the CPU mainly processes the operating system and application programs; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor, but may be implemented separately through a chip.

[0117] Optionally, the processor implements the control method of the digital multimedia exhibition hall provided by each of the above method embodiments when executing the program instructions in the memory.

[0118] The memory may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory includes a non-transitory computer-readable storage medium. The memory may be used to store instructions, programs, codes, code sets, or instruction sets. The memory may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data created according to the use of the device, etc.

[0119] Optionally, the present application also provides a storage medium, which stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the control method of the digital multimedia exhibition hall provided in the above method embodiment.

[0120] Obviously, the above embodiments are merely examples for the purpose of clear explanation, and are not intended to limit the implementation methods. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the implementation methods here. The obvious changes or modifications derived therefrom are still within the scope of protection created by this application.

Claims

1. A control method for a digital multimedia exhibition hall, characterized in that: The method is based on a control terminal in a digital multimedia exhibition hall system, and the digital multimedia exhibition hall system also includes a fixed projector, a mobile projector, an audio playback device, a crowd and portrait recognition device, and a driving device for driving the mobile projector and the audio playback device to move, which are connected to the control terminal by signal. The method includes: During the projection process, according to a preset acquisition cycle, the current monitoring video is periodically acquired through the crowd and portrait recognition device; Performing portrait recognition processing on each video frame in the current surveillance video in turn to obtain a crowd movement recognition result, wherein the crowd movement recognition result records the block group number of the target block group where the current crowd is located; Based on the crowd movement recognition result, generating a control instruction for the driving device; The control instruction is sent to a driving device, so that the driving device drives the mobile projector and the audio playback device to move to a position corresponding to the target block group.

2. The method according to claim 1, characterized in that Before periodically acquiring the current monitoring video through the crowd and portrait recognition device according to the preset collection cycle, the method further includes: After receiving the projection request instruction carrying the target exhibit number, the target exhibit material corresponding to the target exhibit number is selected from the pre-stored exhibit material library, and the target tour guide image material is selected from the pre-stored tour guide material library, wherein the target exhibit material includes the target image material and the target tour guide voice material; Sending the target image material to the fixed projector, and controlling the fixed projector to start projection; Sending the target interpreter image material to the mobile projector to control the mobile projector to start projection; The target explanation voice material is sent to the audio playback device to control the audio playback device to play.

3. The method according to claim 2, characterized in that A standard exhibition hall picture is pre-stored in the control terminal, and the standard exhibition hall picture is pre-divided into a plurality of block groups, each of which includes at least three position blocks. The human portrait recognition process is performed on each video frame in the current monitoring video in turn to obtain a crowd movement recognition result, including: Extracting all N video frames arranged in time from the current surveillance video; Performing portrait recognition processing on each of the video frames in turn to determine the location block where the current crowd is located in each of the video frames; If the position blocks where the current crowd is located in all the video frames belong to the first block group, the first block group is used as the target block group; Generating a crowd movement recognition result carrying the block group number of the target block group; If the position blocks where the current crowd is located in the first X video frames belong to the first block group, and the position blocks where the current crowd is located in the last Y video frames belong to the second block group, the first block group is used as the starting block group, and the second block group is used as the target block group, wherein X+Y≤N; A crowd movement recognition result carrying the block group numbers of both the starting block group and the target block group is generated.

4. The method according to claim 3, characterized in that: The generating a control instruction for the driving device based on the crowd movement recognition result includes: When the crowd movement recognition result only includes the block group number of the target block group, the generated instruction content is a control instruction to keep still; When the crowd movement recognition result includes the block group numbers of both the starting block group and the target block group, the moving path of the driving device is obtained based on the difference between the block group numbers of the two. A control command is generated to cause the drive device to operate according to the movement path.

5. The method according to claim 4, characterized in that Each of the video materials of the tour guide in the tour guide material library includes a static image, a first dynamic image whose movement direction is a first direction, and a second dynamic image whose movement direction is a second direction; While sending the control instruction to the driving device, it also includes: When the instruction content of the control instruction is to keep still, the static image in the target lecturer image material is sent to the mobile projector for projection; When the control instruction is a control instruction for causing the driving device to operate along the moving path, based on the movement direction of the moving path, the first dynamic image or the second dynamic image in the target tour guide image material is sent to the mobile projector for projection.

6. The method according to claim 2, characterized in that The digital multimedia exhibition hall system also includes a lighting system. The exhibit materials recorded in the exhibit material library are classified into several exhibit types, and the control terminal records lighting control schemes corresponding to the exhibit types one by one. After receiving the projection request instruction carrying the target exhibit number, selecting the target exhibit material corresponding to the target exhibit number from the pre-stored exhibit material library also includes: Retrieving a target lighting control solution corresponding to the material type of the target exhibit material; The operation of the lighting system is controlled according to the target lighting control scheme.

7. The method according to claim 6, characterized in that In the guide material library, different guide image materials have different clothing features, and the clothing features correspond one by one to the exhibit types; When selecting a target tour guide image material from the pre-stored tour guide material library, the clothing features of the selected target tour guide image material correspond to the exhibit type of the target exhibit material.

8. A control terminal for a digital multimedia exhibition hall, characterized in that: The control terminal is included in a digital multimedia exhibition hall system, which also includes a fixed projector, a mobile projector, an audio playback device, a crowd and portrait recognition device, and a driving device for driving the mobile projector and the audio playback device to move, which are connected to the control terminal by signal. The control terminal includes: A monitoring video acquisition module is used to periodically acquire the current monitoring video through the crowd and portrait recognition device according to a preset acquisition cycle during the projection process; An image processing module is used to perform portrait recognition processing on each video frame in the current monitoring video in turn to obtain a crowd movement recognition result, wherein the crowd movement recognition result records the block group number of the target block group where the current crowd is located; A control instruction generation module, used for generating a control instruction for the driving device based on the crowd movement recognition result; The instruction sending module is used to send the control instruction to the driving device, so that the driving device drives the mobile projector and the audio playing device to move to a position corresponding to the target block group.

9. A control device, characterized in that: The control device comprises a processor and a memory, wherein the memory stores a computer program, and when the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A storage medium having a program stored thereon, wherein when the program is executed by a processor, the program is used to implement the method according to any one of claims 1 to 7.

Images