Multimedia Information Output Control Method, Control Device, System, and Storage Medium

Abstract

The present application relates to a multimedia information output control method, a control device, a system, and a storage medium. By obtaining the included angle formed between the body orientation of the person appearing in front of the target device and the target device, wherein the target device includes a display screen and / or a speaker, and the target device is used for outputting multimedia information; determining whether the included angle is not less than a preset included angle threshold; in the case where it is determined that the included angle is not less than the preset included angle threshold, adjusting the operating state of the target device from a first state to a second state, which solves the problem of the contradiction between the screen operation energy consumption and the display effect in the related art, and while saving the operation energy consumption of the display screen, also ensures a reasonable display effect.

Description

Technical Field

[0001] The present application relates to the technical field of information processing, and in particular, to a method, a control device, a system, and a storage medium for controlling multimedia information output. Background Art

[0002] With the diversification of marketing means in bank branches, various types of business screens have emerged in bank branches, such as advertising screens, information release screens, check-in screens, wealth management screens, and interactive game screens. Currently, the control of screens in bank branches generally adopts a relatively simple method, that is, turning on and off the screens at fixed time periods. Since the operating energy consumption of a single screen is relatively high and the number of screens in each branch is large, the overall power consumption is relatively large. However, if the screens are forced to be turned off or dimmed during business hours, the display effect of the screens will be poor.

[0003] Regarding the problem of the contradiction between the operating energy consumption and the display effect of the screens in the related art, no effective solution has been proposed yet. Summary of the Invention

[0004] In this embodiment, a method, a control device, a system, and a storage medium for controlling multimedia information output are provided to solve the problem of the contradiction between the operating energy consumption and the display effect of the screens in the related art.

[0005] In a first aspect, in this embodiment, a method for controlling multimedia information output is provided, including:

[0006] Obtaining an included angle formed between the body orientation of a person appearing in front of a target device and the target device, where the target device includes a display screen and / or a speaker, and the target device is used for outputting multimedia information;

[0007] Determining whether the included angle is not less than a preset included angle threshold;

[0008] In the case where it is determined that the included angle is not less than the preset included angle threshold, adjusting the operating state of the target device from a first state to a second state.

[0009] In some embodiments, a camera is disposed around the target device. Before obtaining the included angle formed between the body orientation of a person appearing in front of the target device and the target device, the method further includes:

[0010] Obtaining a video stream obtained by the camera shooting the scene in front of the target device;

[0011] Performing video analysis on the video stream to determine the body orientation of a person appearing in front of the target device.

[0012] In some of these embodiments, the video stream includes multiple frames of real-time images. Performing video analysis on the video stream to determine the body orientation of the person appearing in front of the target device includes:

[0013] Tracking the body parts of the person in each frame of real-time image to obtain the physical appearance characteristics and postural characteristics of the person, where the body parts of the person include at least one of the following: head, upper limbs, lower limbs;

[0014] Determining the body orientation of the person according to the physical appearance characteristics and postural characteristics of the person.

[0015] In some of these embodiments, after determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, the method further includes:

[0016] Detecting the distance between the person and the target device;

[0017] Adjusting the display brightness and / or speaker volume of the target device according to the distance.

[0018] In some of these embodiments, a camera is provided around the target device. Detecting the distance between the person and the target device includes:

[0019] Obtaining the real-time image obtained by the camera shooting the scene in front of the target device;

[0020] Performing video analysis on the real-time image to determine the distance between the person appearing in front of the target device and the target device.

[0021] In some of these embodiments, a detection module is provided around the target device. Detecting the distance between the person and the target device includes:

[0022] Controlling the detection module to send a test signal to the front of the target device, and calculating the time difference between the sending and receiving of the test signal in the case of receiving the reflected test signal;

[0023] Determining the first distance between the detection module and the person according to the propagation speed of the test signal and the time difference;

[0024] Determining the distance between the person and the target device according to the first distance; or, obtaining the second distance between the detection module and the target device, and determining the distance between the person and the target device according to the first distance and the second distance.

[0025] In some of these embodiments, it is characterized in that, when it is detected that the included angle formed between the body orientations of multiple persons and the target device is not less than the preset included angle threshold, adjusting the display brightness and / or speaker volume of the target device according to the distance includes:

[0026] Obtain multiple distance intervals, and determine the distribution of the multiple persons in the multiple distance intervals according to the distances of the respective persons relative to the target device;

[0027] Adjust the display brightness and / or speaker volume of the target device according to the distribution of the multiple persons in the multiple distance intervals.

[0028] In some of these embodiments, a camera is disposed around the target device. After determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, the method further includes:

[0029] Obtain a real-time image obtained by the camera shooting the scene in front of the target device;

[0030] Divide multiple sub-regions in the real-time image, and determine the distribution of the multiple persons in the multiple sub-regions;

[0031] Adjust the display brightness and / or speaker volume of the target device according to the distribution of the multiple persons in the multiple sub-regions.

[0032] In some of these embodiments, a camera is disposed around the target device. After determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, the method further includes:

[0033] Obtain a real-time image obtained by the camera shooting the scene in front of the target device, and obtain the face features of the person according to the real-time image;

[0034] According to the face features of the person, obtain target multimedia information from a pre-stored database, and play the target multimedia information on the target device, where the database stores associated face features and multimedia information.

[0035] In some of these embodiments, the database further stores the behavior features of the person, and the behavior features include the attention duration and / or attention times of the person to each item of multimedia information. Obtaining target multimedia information from a pre-stored database according to the face features of the person includes:

[0036] Obtain the behavior characteristics of the person from the database according to the facial characteristics of the person;

[0037] Obtain the target multimedia information from the database according to the behavior characteristics.

[0038] In some embodiments, a camera is disposed around the target device. Before determining whether the included angle is not less than a preset included angle threshold, the method further includes:

[0039] Obtain a real-time image obtained by the camera photographing the scene in front of the target device;

[0040] Divide a plurality of sub-regions in the real-time image, and determine the sub-region where the person is located;

[0041] Obtain a preset included angle threshold corresponding to the sub-region according to the sub-region where the person is located.

[0042] In some embodiments, the first state includes that the brightness of the target device is less than a preset brightness threshold. Correspondingly, the second state includes that the brightness of the target device is not less than the preset brightness threshold; and / or,

[0043] The first state includes that the multimedia information of the target device is in a stopped playback state. Correspondingly, the second state includes that the multimedia information of the target device is in a started playback state.

[0044] In a second aspect, a control device is provided in this embodiment, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the multimedia information output control method described in the first aspect above.

[0045] In some embodiments, the control device further includes: a camera and a detection module; wherein, the camera is connected to the memory and the processor, and the detection module is used to detect the distance from the target object to itself.

[0046] In a third aspect, a multimedia information output system is provided in this embodiment, including: a target device and the control device described in the second aspect above. The target device is connected to the control device, and the target device includes a display screen and / or a speaker. The target device is used to output multimedia information under the control of the control device.

[0047] In a fourth aspect, a storage medium is provided in this embodiment, on which a computer program is stored. When the program is executed by a processor, the steps of the multimedia information output control method described in the first aspect above are implemented.

[0048] Compared with the related art, in the multimedia information output control method, control device, system and storage medium provided in this embodiment, by obtaining the included angle formed between the body orientation of the person appearing in front of the target device and the target device, where the target device includes a display screen and / or a speaker, and the target device is used to output multimedia information; determining whether the included angle is not less than a preset included angle threshold; and in the case where it is determined that the included angle is not less than the preset included angle threshold, adjusting the operating state of the target device from the first state to the second state, the problem of the contradiction between the screen operation energy consumption and the display effect in the related art is solved, and while saving the operating energy consumption of the display screen, a reasonable display effect is also ensured.

[0049] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more concise and understandable. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments and descriptions thereof of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the drawings:

[0051] Figure 1 is a flowchart of a multimedia information output control method according to an embodiment of the present application;

[0052] Figure 2 is a schematic diagram of the included angle formed between the body orientation and the target device according to an embodiment of the present application;

[0053] Figure 3 is a schematic diagram of the calculation principle of the included angle formed between the body orientation and the target device according to an embodiment of the present application;

[0054] Figure 4 is a schematic diagram of sub-region division in a real-time image according to an embodiment of the present application;

[0055] Figure 5 is a schematic diagram of the principle of setting a preset included angle threshold according to an embodiment of the present application;

[0056] Figure 6 is a hardware structure block diagram of a monitoring device for a multimedia information output control method according to an embodiment of the present application;

[0057] Figure 7 is a schematic diagram of the application of a multimedia information output system in a bank branch according to an embodiment of the present application;

[0058] Figure 8 is a business flowchart of a multimedia information output system according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0059] To more clearly understand the purpose, technical solution and advantages of the present application, the present application will be described and explained below with reference to the accompanying drawings and embodiments.

[0060] Unless otherwise defined, the technical terms or scientific terms involved in the present application shall have the general meaning understood by those with ordinary skills in the technical field to which the present application belongs. In the present application, words such as "a", "an", "one kind", "the", "these" and the like do not indicate a limitation in quantity, and they can be singular or plural. The terms "including", "comprising", "having" and any variants thereof involved in the present application are intended to cover non-exclusive inclusion; for example, a process, method, system, product or device including a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent in these processes, methods, products or devices. The terms "connected", "coupled" and the like involved in the present application do not limit to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "plurality" involved in the present application means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, and B exists alone. Usually, the character " / " indicates that the objects associated before and after are in an "or" relationship. The terms "first", "second", "third" and the like involved in the present application are only used to distinguish similar objects and do not represent a specific order for the objects.

[0061] The traditional method for adjusting the brightness of a display screen is to detect whether there are people through different human sensors, and then use a controller PLC to implement the logic control for the overall energy saving of the billboard. It has the following defects: the system design is relatively complex in terms of hardware; the logic of the detection and induction sensor is relatively simple, and it is impossible to control the brightness of the display screen and push content for users who are really interested. For example, when the face is turned away in front of the display screen, the display screen will also be turned on, which cannot be finely controlled and cannot achieve the purpose of energy saving.

[0062] Therefore, in this embodiment, a method for controlling multimedia information output is provided. Figure 1 is a flowchart of the method for controlling multimedia information output in this embodiment, as Figure 1 shown, this process includes the following steps:

[0063] Step S101, obtain the included angle formed between the body orientation of the person who appears in front of the target device and the target device, where the target device includes a display screen and / or a speaker, and the target device is used to output multimedia information.

[0064] In this embodiment, the target device can be a display screen, a speaker, or an electronic device integrating a display screen and a speaker. The multimedia information includes but is not limited to images, texts, audios, and videos. The body orientation can be the face orientation, the torso orientation, or the orientation of the entire human body (when the face orientation and the torso orientation are the same).

[0065] Figure 2 is a schematic diagram of the included angle formed by the body orientation and the target device in this embodiment. As Figure 2 shown, the target device stands vertically on the ground, a horizontal reference line parallel to the ground is set, and a person stands in front of the target device. The included angles formed by different body orientations and the horizontal reference line are ∠A, ∠B, ∠C, and ∠D respectively.

[0066] Step S102, determine whether the included angle is not less than a preset included angle threshold.

[0067] Regarding the setting of the preset included angle threshold, reference can be continued to Figure 2 , regarding the current position of the person as a point, pointing this point along the horizontal direction to the edge of the target device, and the included angle formed by the direction from this point to the edge of the target device and the horizontal line is ∠B, then the corresponding preset included angle threshold can be set to the size of ∠B. Of course, there can be other ways to set the preset included angle threshold, which will not be elaborated here.

[0068] Step S103, when it is determined that the included angle is not less than the preset included angle threshold, adjust the operating state of the target device from the first state to the second state.

[0069] If the included angle formed by the current body orientation and the target device is not less than the preset included angle threshold, it means that the person is interested in the multimedia information output by the target device, so the operating state of the target device is adjusted.

[0070] On the contrary, if the included angle formed by the current body orientation and the target device is less than the preset included angle threshold, it means that the person is not interested in the multimedia information output by the target device, so the current operating state of the target device is maintained.

[0071] In some embodiments, the first state includes that the brightness of the target device is less than a preset brightness threshold. Correspondingly, the second state includes that the brightness of the target device is not less than the preset brightness threshold.

[0072] In some embodiments, the first state includes that the multimedia information of the target device is in a stopped playback state. Correspondingly, the second state includes that the multimedia information of the target device is in a started playback state.

[0073] In some embodiments, adjusting the operating state of the target device from the first state to the second state includes: increasing the brightness of the display screen and the decibel of the speaker.

[0074] In the above steps S101 to S103, the included angle between the body orientation and the target device is used to represent whether the person is interested in the multimedia information output by the target device, so as to adjust the operating state of the target device. When the person shows interest in the multimedia information output by the target device, the brightness of the display screen is increased and / or the decibel of the speaker is increased. When the person shows no interest in the multimedia information output by the target device, the status quo is maintained. Through the above steps, the problem of the contradiction between the operating energy consumption and the display effect of the display screen in the related technology is solved. While saving the operating energy consumption of the display screen, a reasonable display effect is also ensured.

[0075] In an embodiment of the present application, the body orientation of the person appearing in front of the target device can be determined in the following manner. Cameras are arranged around the target device. Before obtaining the included angle between the body orientation of the person appearing in front of the target device and the target device, a video stream obtained by the camera shooting the scene in front of the target device is obtained; the video stream is subjected to video analysis to determine the body orientation of the person appearing in front of the target device.

[0076] In this embodiment, the camera can be installed at any one of the front, rear, upper, lower, left, and right positions of the target device, as long as the camera can capture the person in front of the target device.

[0077] Compared with the traditional display screen brightness adjustment method, the relative position relationship between the person and the target device can be obtained more accurately through video stream analysis. Even when the person has their back to the target device, the current operating state of the target device will be maintained, so as to control the operating state of the target device for the users who are really interested and achieve the purpose of energy saving.

[0078] Further, the video stream includes multiple frames of real-time images. When performing video analysis on the video stream to determine the body orientation of the person appearing in front of the target device, the body parts of the person can be tracked in each frame of real-time image to obtain the physical appearance characteristics and postural characteristics of the person. Among them, the body parts of the person include at least one of the following: head, upper limb, lower limb; the body orientation of the person is determined according to the physical appearance characteristics and postural characteristics of the person.

[0079] Among them, the physical appearance characteristics include human facial information, and the postural characteristics include human skeleton information. The two-dimensional image of the human body can be matched to the three-dimensional human skeleton, and finally a continuous and smooth motion curve is obtained through interpolation to determine the motion direction of the human body. Combining the human facial information and the motion direction, the body orientation of the person is determined.

[0080] In this embodiment, a monitoring area can be set in front of the target device. When it is detected that a person enters the monitoring area, target tracking is started, that is, based on each frame of real-time image, the person's head, shoulders, and walking gait are tracked to obtain the person's physical features, postural features, and moving direction, and the body orientation of the person is determined according to the person's physical features, postural features, and moving direction.

[0081] In an embodiment of the present application, the physical imaging plane of the camera is parallel to the target device. After determining the body orientation of the person, the included angle between the body orientation and the target device can be determined in the following manner. Figure 3 It is a schematic diagram of the calculation principle of the included angle between the body orientation and the target device in this embodiment, as Figure 3 shown, the coordinate system of the camera is o-x-y-z, and the coordinate system of the physical imaging plane is o’-x’-y’-z’. Assume that the position of the person is point P. When the camera takes a picture of the person, since the physical imaging plane of the camera is parallel to the target device, the included angle between the body orientation and the o’x’ axis can be determined first through the physical imaging plane, and this included angle is the included angle between the body orientation and the target device.

[0082] In an embodiment of the present application, after determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, the distance between the person and the target device will also be detected; the display brightness and / or speaker volume of the target device will be adjusted according to the distance.

[0083] The association relationship between the distance and the adjustment direction can be preset. If the distance is closer, the display brightness and / or speaker volume will be adjusted higher. If the distance is farther, the display brightness and / or speaker volume will be adjusted lower. With such a setting, the effect of further refined control of the target device is achieved.

[0084] Regarding the detection of the distance between the person and the target device, the present application provides two types of methods. One is based on video analysis, and the other is based on physical detection. The following embodiments will introduce these two types of methods in detail.

[0085] In some embodiments, cameras are arranged around the target device. Detecting the distance between the person and the target device includes: obtaining the real-time image obtained by the camera shooting the scene in front of the target device; performing video analysis on the real-time image to determine the distance between the person appearing in front of the target device and the target device.

[0086] In some embodiments, a detection module is provided around the target device. Detecting the distance between a person and the target device includes: controlling the detection module to send a test signal to the front of the target device, and calculating the time difference between the transmission and reception of the test signal when the reflected test signal is received; determining the first distance between the detection module and the person according to the propagation speed and time difference of the test signal. Determining the distance between the person and the target device according to the first distance; or, obtaining the second distance between the detection module and the target device, and determining the distance between the person and the target device according to the first distance and the second distance.

[0087] In this embodiment, the distance between the person and the target device can be determined only according to the first distance, or according to the first distance and the second distance. Among them, the distance between the person and the target device can be the horizontal distance between the person and the target device, or the shortest distance between the person and the target device. If the detection module is installed on the target device, the first distance between the detection module and the person is the distance between the person and the target device; if the detection module is installed in front of the target device, the distance between the person and the target device is the sum of the first distance and the second distance; if the detection module is installed behind the target device, the distance between the person and the target device is the difference between the first distance and the second distance. Among them, the detection module is a device capable of emitting a test signal including any one of ultrasonic waves, infrared rays, and radio frequency signals, such as an ultrasonic rangefinder, an infrared rangefinder, and a radio frequency rangefinder.

[0088] In some application scenarios, there may be multiple people in front of the target device. At this time, it would be unreasonable to adjust the target device only according to the distance between one of the people and the target device.

[0089] For this reason, in an embodiment of the present application, when it is detected that the included angle between the body orientations of multiple people and the target device is not less than a preset angle threshold, adjusting the display brightness and / or speaker volume of the target device according to the distance includes: obtaining multiple distance intervals, and determining the distribution of multiple people in the multiple distance intervals according to the distances of the people relative to the target device; adjusting the display brightness and / or speaker volume of the target device according to the distribution of multiple people in the multiple distance intervals.

[0090] In this embodiment, first, the distances between each person and the target device are determined. Then, according to the distances between each person and the target device and multiple distance intervals, the distribution of multiple persons in multiple distance intervals is counted, and the display brightness and / or speaker volume of the target device are adjusted according to the distance interval with the largest number of distributed persons. It should be noted that when counting the distribution of multiple persons in multiple distance intervals, the persons to be counted should meet the prerequisite condition that the angle formed between the body orientation and the target device is not less than a preset angle threshold. Only in this way can the persons interested in the multimedia information output by the target device be counted. The association relationship between each distance interval and the adjustment direction can be set in advance. The closer the distance interval is to the target device, the higher the display brightness and / or speaker volume are adjusted. The farther the distance interval is from the target device, the lower the display brightness and / or speaker volume are adjusted.

[0091] Regarding the adjustment of the display brightness and / or speaker volume of the target device, it can also be achieved by the following method. In some embodiments, cameras are arranged around the target device. After determining that the angle is not less than the preset angle threshold and adjusting the operating state of the target device from the first state to the second state, the real-time image obtained by the camera shooting the scene in front of the target device is acquired; multiple sub-regions are divided in the real-time image, and the distribution of multiple persons in multiple sub-regions is determined; the display brightness and / or speaker volume of the target device are adjusted according to the distribution of multiple persons in multiple sub-regions.

[0092] In this embodiment, the visible area in front of the target device is divided according to the distance from the target device to obtain multiple sub-regions. After acquiring the real-time image, instead of calculating the distances of each person relative to the target device, the sub-regions where the persons are located are directly identified in the real-time image, and the display brightness and / or speaker volume of the target device are adjusted according to the distribution of multiple persons in multiple sub-regions. The sub-region division in the real-time image is as Figure 4 shown. The association relationship between each sub-region and the adjustment direction can be set in advance. The closer the sub-region is to the target device, the higher the display brightness and / or speaker volume are adjusted. The farther the sub-region is from the target device, the lower the display brightness and / or speaker volume are adjusted. Figure 4 Only one way of sub-region division is given. In some of these embodiments, the sub-region division can also be presented in the form of a nine-square grid.

[0093] In some of these embodiments, a camera is provided around the target device. After determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, a real-time image obtained by the camera capturing the scene in front of the target device will also be acquired, and the facial features of the person will be obtained based on the real-time image; based on the facial features of the person, target multimedia information will be obtained from a pre-stored database, and the target multimedia information will be played on the target device, where the database stores associated facial features and multimedia information.

[0094] The database stores historical attention records of each person on the multimedia information played on the target device, and these historical attention records are associated and stored with the facial features of the person. With such a setting, the attention of different people on the multimedia information can be recorded according to the facial features, which is convenient for playing the multimedia information that a single person is interested in before the person approaches the target device.

[0095] Further, in some embodiments, the database also stores the behavior characteristics of the person, and the behavior characteristics include the attention duration and / or the number of attention times of the person on each item of multimedia information. When obtaining the target multimedia information from the pre-stored database according to the facial features of the person, the behavior characteristics of the person can be obtained from the database according to the facial features of the person; and the target multimedia information can be obtained from the database according to the behavior characteristics.

[0096] A person may pay attention to multiple items of multimedia information in front of the target device, and the attention durations of each item of multimedia information are different. The multimedia information with the longest attention duration can be selected for playing according to the attention duration of the person on the multimedia information; the multimedia information with the most attention times can also be selected for playing according to the number of attention times of the person on the multimedia information; or the multimedia information with the highest comprehensive interest degree can be selected for playing by comprehensively considering the attention duration and the number of attention times of the person on the multimedia information.

[0097] The foregoing content gives one embodiment of the setting of the preset included angle threshold. In some of these embodiments, the preset included angle threshold can also be set according to the following method.

[0098] In some embodiments, a camera is provided around the target device. Before determining whether the included angle is not less than the preset included angle threshold, a real-time image obtained by the camera capturing the scene in front of the target device will also be acquired; multiple sub-regions will be divided in the real-time image, and the sub-region where the person is located will be determined; and the preset included angle threshold corresponding to the sub-region will be obtained according to the sub-region where the person is located.

[0099] Figure 5 It is a schematic diagram of the principle of setting the preset included angle threshold in this embodiment. As Figure 5As shown in the figure, the area in front of the target device is divided into sub-areas presented in a 9-grid form. Taking the center point of each sub-area as the ideal position for the person, it can be seen that the included angle between the center point of each sub-area and the edge of the target device is different. If the center point of each sub-area is directed along the horizontal direction towards the edge of the target device, and the included angle between the direction of the center point pointing to the edge of the target device and the horizontal line is used as the preset included angle threshold, it can be understood that when the person is in different sub-areas, the critical value for determining whether the person is interested in the multimedia information is also different. For example, for area 2 and area 3, when the person is in area 2, the included angle between the person's body orientation and the target device may need to be greater than 45 degrees to be determined as interested in the multimedia information, while when the person is in area 3, the included angle between the person's body orientation and the target device may only need to be greater than 30 degrees to be determined as interested in the multimedia information. Therefore, by setting different preset included angle thresholds due to the different positions of the person, it is possible to more accurately determine whether the person is interested in the multimedia information.

[0100] Combined with the multimedia information output control method of the above embodiments, in this embodiment, a control device is further provided, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the multimedia information output control method of any of the above embodiments.

[0101] The control device can be a terminal, a computer, or a similar computing device. Taking the terminal as an example, Figure 6 is the hardware structure block diagram of the monitoring device of the multimedia information output control method according to an embodiment of the present application. As Figure 6 shown, the terminal may include one or more ( Figure 6 only one is shown in the figure) processors 602 and a memory 604 for storing data. Among them, the processor 602 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA. The above terminal may further include a transmission device 606 for communication functions and an input / output device 608. Those of ordinary skill in the art can understand that Figure 6 the structure shown is only schematic and does not limit the structure of the above terminal. For example, the terminal may further include more or fewer components than those shown in Figure 6 , or have a different configuration from that shown in Figure 6 .

[0102] The memory 604 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the multimedia information output control method in this embodiment. The processor 602 executes various functional applications and data processing by running the computer program stored in the memory 604, that is, the above-mentioned method is implemented. The memory 604 may include a high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memories. In some instances, the memory 604 may further include a memory remotely located relative to the processor 602, and these remote memories can be connected to the terminal through a network. Examples of the above-mentioned network include but are not limited to the Internet, enterprise intranet, local area network, mobile communication network, and their combinations.

[0103] The transmission device 606 is used to receive or send data via a network. The above-mentioned network includes the wireless network provided by the communication provider of the terminal. In one instance, the transmission device 606 includes a network adapter (abbreviated as NIC), which can be connected to other network devices through a base station and thus can communicate with the Internet. In one instance, the transmission device 606 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0104] In some embodiments, the control device further includes: a camera and a detection module; wherein, the camera is connected to the memory and the processor, and the detection module is used to detect the distance from the target object to itself.

[0105] In this embodiment, a multimedia information output system is further provided, including: a target device and the control device of any of the above embodiments. The target device is connected to the control device, and the target device includes a display screen and / or a speaker. The target device is used to output multimedia information under the control of the control device.

[0106] The application of the multimedia information output system will be introduced below through preferred embodiments. Figure 7 It is a schematic diagram of the application of the multimedia information output system in a bank branch of an embodiment of the present application, as Figure 7As shown in the figure, the system includes an advertising screen and a monitoring device, and the advertising screen and the monitoring device are communicatively connected. Among them, the monitoring device integrates a camera, a memory, and a processor. The height of the monitoring device from the ground is 5 meters, and the height of the monitoring device from the upper edge of the advertising screen is 1 to 1.5 meters. The monitoring device can be installed around the advertising screen, such as any one of the front, rear, upper, lower, left, and right positions, as long as it meets the requirement that the monitoring device can capture the monitoring area in front of the advertising screen. The monitoring device is responsible for human detection in the monitoring area, establishing the relationship between the brightness change of the advertising screen and the sub-areas according to the division of the monitoring area, so as to achieve the best viewing effect and energy-saving control. The advertising screen is used to receive the control signaling of the monitoring device and control the brightness of the screen.

[0107] Figure 8 is the service flow chart of this multimedia information output system. As Figure 8 shown, this process includes the following steps:

[0108] Step S801, the monitoring device powers on and completes the sub-area division modeling of the monitoring area;

[0109] Step S802, the monitoring device confirms the body orientation according to the physical appearance characteristics and body posture characteristics of the person;

[0110] Step S803, the monitoring device determines whether the angle formed between the body orientation and the target device reaches a preset angle threshold; if so, execute Step S804; if not, end the process;

[0111] Step S804, turn on the advertising screen, adjust the brightness according to the distance, and in the case of multiple people, adjust the brightness with the number of people as the sub-area, and end the process.

[0112] In this preferred embodiment, after the monitoring device in the bank branch powers on, it establishes the segmentation modeling of the sub-areas of the video images in the area according to the monitoring range. When the monitoring device detects that a person enters the monitoring area, it confirms the body orientation of the person according to the physical appearance and body posture characteristics of the person, and determines whether the angle between the body orientation of the person and the advertising screen is within the preset angle threshold. If it is satisfied, the advertising screen is turned on, and the sub-area where the person is located is determined according to the distance between the person and the advertising screen, so as to adjust the brightness of the advertising screen. For the case where a single person enters the monitoring area, the monitoring device detects the face characteristics of the person and obtains the length of time the person watches the advertisement from the database, so as to facilitate the display of content that the person is interested in before the single person enters the large screen. If there are multiple people watching in the area at the same time, and the angle between the body orientation of the person and the advertising screen is within the preset angle threshold, the sub-area with the largest number of people is used to adjust the brightness to achieve the purpose of the best energy-saving control.

[0113] The multimedia information output system of this preferred embodiment is easy to install and deploy, can more precisely control the operating status of the advertising screen, and the hardware structure design of the monitoring device is simple, without the need to adopt too many sensors.

[0114] In addition, in combination with the multimedia information output control method provided in the above embodiments, a storage medium can also be provided to implement in this embodiment. A computer program is stored on the storage medium; when the computer program is executed by a processor, any one of the multimedia information output control methods in the above embodiments is implemented.

[0115] It should be understood that the specific embodiments described here are only used to explain this application, rather than to limit it. According to the embodiments provided in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.

[0116] Obviously, the drawings are only some examples or embodiments of this application. For those of ordinary skill in the art, this application can also be applied to other similar situations based on these drawings without creative work. Additionally, it can be understood that although the work done during this development process may be complex and time-consuming, for those of ordinary skill in the art, certain design, manufacturing, or production changes based on the technical content disclosed in this application are only conventional technical means and should not be regarded as insufficient disclosure of this application.

[0117] The term "embodiment" in this application means that the specific features, structures, or characteristics described in connection with the embodiment may be included in at least one embodiment of this application. The phrase appears in various positions in the specification does not necessarily mean the same embodiment, nor does it mean being independent or alternative to other embodiments and mutually exclusive. Those of ordinary skill in the art can clearly or implicitly understand that the embodiments described in this application can be combined with other embodiments without conflict.

[0118] The above-described embodiments only represent several implementation manners of this application, and their descriptions are relatively specific and detailed, but should not be construed as a limitation on the patent protection scope. It should be noted that for those of ordinary skill in the art, without departing from the concept of this application, several deformations and improvements can still be made, and these all belong to the protection scope of this application. Therefore, the protection scope of this application should be subject to the appended claims.

Claims

1. A method for controlling multimedia information output, characterized in that Including: Obtaining an angle formed between the body orientation of a person appearing in front of a target device and the target device, where the target device includes a display screen and / or a speaker, and the target device is used to output multimedia information; Judging whether the angle is not less than a preset angle threshold, where the preset angle threshold is determined according to an angle formed between a first direction and a horizontal reference line, and the first direction is a direction in which the position of the person points to the edge of the target device along the horizontal direction; In the case of judging that the angle is not less than the preset angle threshold, adjusting the operating state of the target device from a first state to a second state; A camera is arranged around the target device. Before obtaining the angle formed between the body orientation of a person appearing in front of the target device and the target device, the method further includes: Obtaining a video stream obtained by the camera shooting the scene in front of the target device, where the video stream includes multiple frames of real-time images; Tracking the body parts of the person in each frame of real-time image to obtain the physical appearance features and postural features of the person, where the body parts of the person include at least one of the following: head, upper limb, lower limb, the physical appearance features include human face information, and the postural features include human skeleton information; Matching a two-dimensional image of the human body to a three-dimensional human skeleton, obtaining a continuous and smooth motion curve through interpolation, and determining the motion direction of the human body; Determining the body orientation of the person according to the human face information and the motion direction.

2. The multimedia information output control method according to claim 1, characterized in that After adjusting the operating state of the target device from the first state to the second state in the case of judging that the angle is not less than the preset angle threshold, the method further includes: Detecting the distance between the person and the target device; Adjusting the display brightness and / or speaker volume of the target device according to the distance.

3. The multimedia information output control method according to claim 2, wherein A camera is arranged around the target device. Detecting the distance between the person and the target device includes: Obtaining a real-time image obtained by the camera shooting the scene in front of the target device; Performing video analysis on the real-time image to determine the distance between the person appearing in front of the target device and the target device.

4. The multimedia information output control method according to claim 2, characterized in that A detection module is arranged around the target device. Detecting the distance between the person and the target device includes: Controlling the detection module to send a test signal to the front of the target device, and in the case of receiving the reflected test signal, calculating the time difference between the sending and receiving of the test signal; Determining a first distance between the detection module and the person according to the propagation speed of the test signal and the time difference; Determining the distance between the person and the target device according to the first distance; or obtaining a second distance between the detection module and the target device, and determining the distance between the person and the target device according to the first distance and the second distance.

5. The multimedia information output control method according to any one of claims 2 to 4, characterized in that, In the case of detecting that the angles formed between the body orientations of multiple persons and the target device are not less than the preset angle threshold, adjusting the display brightness and / or speaker volume of the target device according to the distance includes: Obtain multiple distance intervals, and determine the distribution of the multiple persons in the multiple distance intervals according to the distances of the respective persons relative to the target device; Adjust the display brightness and / or speaker volume of the target device according to the distribution of the multiple persons in the multiple distance intervals.

6. The multimedia information output control method according to claim 1, wherein, A camera is provided around the target device. After determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, the method further includes: Obtain a real-time image obtained by the camera capturing the scene in front of the target device; Divide multiple sub-regions in the real-time image, and determine the distribution of multiple persons in the multiple sub-regions; Adjust the display brightness and / or speaker volume of the target device according to the distribution of the multiple persons in the multiple sub-regions.

7. The multimedia information output control method according to claim 1, wherein A camera is provided around the target device. After determining that the included angle is not less than the preset included angle threshold and adjusting the operating state of the target device from the first state to the second state, the method further includes: Obtain a real-time image obtained by the camera capturing the scene in front of the target device, and obtain the face features of the person according to the real-time image; According to the face features of the person, obtain target multimedia information from a pre-stored database, and project the target multimedia information onto the target device, where the database stores associated face features and multimedia information.

8. The multimedia information output control method according to claim 7, characterized in that, The database further stores the behavior features of the person, and the behavior features include the attention duration and / or attention times of the person to each item of multimedia information. Obtaining target multimedia information from a pre-stored database according to the face features of the person includes: Obtain the behavior features of the person from the database according to the face features of the person; Obtain the target multimedia information from the database according to the behavior features.

9. The multimedia information output control method according to claim 1, wherein A camera is provided around the target device. Before determining whether the included angle is not less than the preset included angle threshold, the method further includes: Obtain a real-time image obtained by the camera capturing the scene in front of the target device; Divide multiple sub-regions in the real-time image, and determine the sub-region where the person is located; Obtain the preset included angle threshold corresponding to the sub-region according to the sub-region where the person is located.

10. The multimedia information output control method according to claim 1, wherein The first state includes that the brightness of the target device is less than the preset brightness threshold. Correspondingly, the second state includes that the brightness of the target device is not less than the preset brightness threshold; and / or, The first state includes that the multimedia information of the target device is in a stopped playback state. Correspondingly, the second state includes that the multimedia information of the target device is in a started playback state.

11. A control device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is configured to run the computer program to execute the multimedia information output control method according to any one of claims 1 to 10.

12. The control device according to claim 11, characterized in that, Further includes: A camera and a detection module; wherein, the camera is connected to the memory and the processor, and the detection module is configured to detect the distance from a target object to itself.

13. A multimedia information output system, characterized in that, Comprising: A target device and the control device according to claim 11 or 12, the target device being connected to the control device, the target device including a display screen and / or a speaker, and the target device being configured to output multimedia information under the control of the control device.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, the steps of the multimedia information output control method according to any one of claims 1 to 10 are implemented.

Images