Display output control method and device for box-type exhibition stand

Abstract

The application discloses a display output control method and device of a box type exhibition stand. The method comprises the following steps: in response to a detection period, performing object recognition on image information collected by a plurality of depth image acquisition units, identifying a person in the image when there is a person in the image, and extracting biological feature information of the person; performing identity recognition based on the extracted biological feature information, and determining an exhibition personnel who meets exhibition identity information; determining a position of an intersection point of a line of sight of the exhibition personnel and a light-transmitting surface of the box type exhibition stand, determining a display area on the light-transmitting surface of the box type exhibition stand based on the position of the intersection point; determining a distance and an angle between a light-emitting element and the display area; based on the determined distance and angle, turning on the light-emitting element on an outer surface of an exhibition object, making the light-emitting element emit light at a set angle and intensity, and adjusting a color of the emitted light of the light-emitting element, so that the color of the emitted light matches a natural color of the outer surface of the exhibition object. The application improves the safety of exhibition.

Description

Technical Field

[0001] The embodiments of the present application relate to exhibition stand display technology, and more particularly to a display output control method and device for a box-type exhibition stand. Background Art

[0002] With the continuous development of the global economy, the communication between various parties is also increasing. The communication between enterprises often uses the display of products or commodities as the main means. By directly presenting the shape and operating characteristics of the products to the communication parties, the exhibitors can more conveniently obtain exhibit information and improve the communication efficiency of all parties. In many scenarios, especially when exhibits need to be displayed to specific objects, and the exhibitors are not restricted, it is necessary to restrict the display of exhibits so that they can only be displayed to specific objects. For example, for newly developed products, it may only be necessary to show them to close partners. As for the internal structure of the exhibits, such as major components, they need to be displayed through a separate booth or exhibition space, or displayed to exhibitors through means such as image explanations, which makes it inconvenient to display exhibits. Summary of the Invention

[0003] In view of this, an embodiment of the present application provides a display output control method and device for a box-type exhibition booth, which can present exhibits to specific exhibitors by arranging light-emitting elements on the exhibits and the main components inside the exhibits, and at the same time can present the main components or key components inside the exhibits.

[0004] According to a first aspect of an embodiment of the present application, a display output control method for a box-type exhibition stand is provided. An exhibition object is provided in the box-type exhibition stand, and at least one side of the box-type exhibition stand is a light-transmitting surface serving as a display output surface. A light-emitting element is provided on an outer surface of the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to a control unit. A plurality of depth image acquisition units are provided on the box-type exhibition stand. The method comprises:

[0005] In response to the arrival of the detection cycle, the image information collected by the multiple depth image acquisition units is subjected to object recognition, and when it is determined that there is a portrait in the image, the portrait in the image is recognized; biometric information in the portrait is extracted, and identity recognition is performed based on the extracted biometric information to determine the person who meets the presented identity information;

[0006] Determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face facing the translucent surface of the box-type booth, and determine the intersection of the presenter's line of sight and the translucent surface of the box-type booth based on the eye position and facial orientation of the presenter;

[0007] Determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections;

[0008] Based on the display area, the distance and angle between the light-emitting element and the display area are determined; based on the determined distance and angle, the light-emitting element on the outer surface of the exhibition object is turned on, so that the light-emitting element emits light at a set angle and intensity, and the color of the emitted light of the light-emitting element is adjusted so that the color of the emitted light matches the natural color of the outer surface of the exhibition object.

[0009] In some exemplary embodiments, a light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided on the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; and the method further includes:

[0010] In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0011] In some exemplary embodiments, the method further comprises:

[0012] In response to changes in the number of presenters in the image, or changes in the information about the intersection position of the presenters' line of sight and the light-transmitting surface of the box-type booth, the display area is re-determined on the light-transmitting surface based on the intersection position, the distance and angle between the light-emitting element and the display area are re-determined, and the output light angle of the light-emitting element is adjusted.

[0013] In some exemplary embodiments, the box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is provided on the posture adjustment structure; the method further includes:

[0014] In response to the posture adjustment structure driving the exhibition object to change its posture, recalibrate the position of the exhibition object in a set coordinate system, and determine the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface; and

[0015] The relative position relationship between the light-emitting element on the exhibition object and the projection hole is determined.

[0016] In some exemplary embodiments, the method further comprises:

[0017] Obtaining the surface type of the outer surface of the exhibition object, that is, determining whether the outer surface is one of a surface of revolution, a plane, or a curved surface; obtaining surface characteristics of the outer surface, the surface characteristics including at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface;

[0018] A continuous surface area with identical or similar surface characteristics is used as a planning area, and an element group is formed with two or more light-emitting elements. The element group is electrically connected to a control unit via a common light-emitting control circuit; the element group is used as a filling unit to fill and fix the light-emitting elements in the planning area to form the outer surface of the exhibition object.

[0019] In some exemplary embodiments, the method further comprises:

[0020] For surface areas without identical or similar surface characteristics, filling the outer surface of the exhibit object with a single or multiple light-emitting elements as units;

[0021] For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are set in other adjacent element groups and share the same light-emitting control circuit with other element groups.

[0022] According to a second aspect of an embodiment of the present application, a display output control device for a box-type exhibition stand is provided. The box-type exhibition stand has an exhibition object disposed therein, and at least one side of the box-type exhibition stand is a light-transmitting surface serving as a display output surface. A light-emitting element is disposed on an outer surface of the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to a control unit. The box-type exhibition stand is provided with multiple depth image acquisition units. The device includes:

[0023] The recognition unit is configured to, in response to the arrival of the detection cycle, perform object recognition on the image information collected by the multiple depth image collection units, and when it is determined that there is a portrait in the image, recognize the portrait in the image; extract biometric information from the portrait, perform identity recognition based on the extracted biometric information, and determine the person who meets the presented identity information;

[0024] A first determining unit is configured to determine the head position and facial orientation of the presenter based on depth information of the image, determine the eye position of the presenter's face facing the translucent surface of the box-type exhibition stand, and determine the position of the intersection of the presenter's line of sight and the translucent surface of the box-type exhibition stand based on the eye position and facial orientation of the presenter;

[0025] A second determining unit is configured to determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections;

[0026] a third determining unit, configured to determine a distance and an angle between the light-emitting element and the display area based on the display area;

[0027] The control unit is configured to activate the light-emitting element on the outer surface of the exhibition object based on the determined distance and angle, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the natural color of the outer surface of the exhibition object.

[0028] In some exemplary embodiments, a light-emitting element is provided on a set component of the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided on the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; and the control unit is further configured to:

[0029] In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0030] In some exemplary embodiments, the first determining unit is further configured to:

[0031] In response to changes in the number of presenters in the image, or changes in the information about the intersection position of the presenters' line of sight and the light-transmitting surface of the box-type booth, the display area is re-determined on the light-transmitting surface based on the intersection position, and the distance and angle between the light-emitting element and the display area are re-determined, triggering the control unit to adjust the output light angle of the light-emitting element.

[0032] In some exemplary embodiments, the box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is set on the posture adjustment structure; the first determining unit is further used to:

[0033] In response to the posture adjustment structure driving the exhibition object to change its posture, recalibrate the position of the exhibition object in a set coordinate system, and determine the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface; and

[0034] The relative position relationship between the light-emitting element on the exhibition object and the projection hole is determined.

[0035] In some exemplary embodiments, the apparatus further comprises:

[0036] an acquisition unit, configured to acquire a surface type of the outer surface of the exhibition object, i.e., determine whether the outer surface is one of a surface of revolution, a plane, or a curved surface; and acquire surface characteristics of the outer surface, wherein the surface characteristics include at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface;

[0037] The first determining unit is further configured to: select a continuous surface area having identical or similar surface characteristics as a planning area, form an element group with two or more light-emitting elements, and electrically connect the element group to a control unit via a common light-emitting control circuit; and use the element group as a filling unit to fill and fix the light-emitting elements in the planning area to form the outer surface of the exhibition object.

[0038] In some exemplary embodiments, the first determining unit is further configured to:

[0039] For surface areas without identical or similar surface characteristics, filling the outer surface of the exhibit object with a single or multiple light-emitting elements as units;

[0040] For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are set in other adjacent element groups and share the same light-emitting control circuit with other element groups.

[0041] According to a third aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the steps of the display output control method of the box-type exhibition stand are implemented.

[0042] According to a fourth aspect of the embodiments of the present application, there is provided an electronic device, including:

[0043] at least one processor; and

[0044] a memory communicatively connected to the at least one processor; wherein,

[0045] The memory stores instructions that can be executed by the at least one processor. The instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the display output control method of the box-type booth.

[0046] The technical solution of the embodiment of the present application is to automatically capture images of exhibitors by installing multiple depth image acquisition units on a box-type exhibition stand, identify human figures in the captured images, and determine the situation of the exhibitors in the images. Based on the identified faces of the exhibitors, the intersection between the line of sight of these exhibitors and the light-transmitting surface of the exhibitors is determined, thereby determining the display area on the light-transmitting surface. By controlling the light emission angle, light emission color, and light emission intensity of the light-emitting elements on the exhibitors, the exhibitors or their main components are displayed to specific exhibitors, thereby improving the exhibition quality of the exhibitors and ensuring that the exhibitors are displayed to specific exhibitors, thereby improving the safety of the display. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] To more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be derived from these drawings without inventive effort.

[0048] Figure 1 A schematic diagram showing a flow chart of a display output control method for a box-type exhibition stand according to an embodiment of the present application is shown;

[0049] Figure 2 A schematic diagram of the overall structure of a box-type exhibition stand according to an embodiment of the present application is shown;

[0050] Figure 3 A schematic diagram showing a structure in which light-emitting elements are provided on the outer surface of an exhibition object according to an embodiment of the present application;

[0051] Figure 4 This is a schematic diagram of the structure of the display output control device of the box-type exhibition stand according to an embodiment of the present application;

[0052] Figure 5 This is a schematic diagram of the composition structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0053] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0054] The essence of the technical solution of the embodiment of the present application is explained in detail below with reference to the accompanying drawings.

[0055] Figure 1 A flow chart of a display output control method for a box-type exhibition stand according to an embodiment of the present application is shown. Figure 1 As shown, the display output control method of the box-type exhibition stand in the embodiment of the present application includes the following steps:

[0056] Step 101, in response to the arrival of the detection cycle, object recognition is performed on the image information collected by multiple depth image acquisition units. When it is determined that there is a portrait in the image, the portrait in the image is identified; biometric information in the portrait is extracted, and identity recognition is performed based on the extracted biometric information to determine the person who meets the identity information for presentation.

[0057] In the embodiment of this application, Figure 2 The overall structure diagram of the box-type exhibition stand according to the embodiment of the present application is shown in FIG. Figure 2 As shown, an exhibition object 20 is provided in the box-type exhibition stand 10 of the embodiment of the present application, and at least one side of the box-type exhibition stand 10 is a light-transmitting surface, serving as a display output surface; Figure 2 The light-transmitting surface can be a single surface facing the user, or it can be two or more surfaces, depending on the specific structure of the box-type display stand 10 and the display requirements. In the embodiment of the present application, although the box-type display stand 10 is provided with a light-transmitting surface, because the exhibit object 20 is provided with a light-emitting element, the light-emitting element only emits light of a corresponding frequency band at a specific angle and area. Therefore, when the overall volume of the box-type display stand 10 is small and it is far away from the exhibitors, visitors in the non-light-emitting area cannot clearly obtain the appearance image information of the exhibit object 20.

[0058] In the embodiment of this application, Figure 3 The schematic diagram of the structure of the outer surface of the exhibition object 20 of the embodiment of the present application is shown as follows: Figure 3 As shown, the outer surface 21 of the exhibition object 20 is provided with a light emitting element 30, and the light emitting control circuit ( Figure 3 not shown) and the control unit ( Figure 3 (not shown) are electrically connected. Figure 2As shown, a plurality of depth image acquisition units 11 are provided on the box-type exhibition stand 10 of the embodiment of the present application. As an example, the depth image acquisition unit 11 can be a depth camera, a binocular camera, a 3D camera, etc. Taking the binocular camera as an example, its ranging principle is to continuously send light pulses to the target, receive the light returned from the object through the sensor, and determine the distance of the target object by detecting the flight time of the light pulses. In the embodiment of the present application, the coordinate system of the camera is calibrated, and the position information of the light-emitting element 30 and the light-transmitting surface on the exhibition object 20 in the box-type exhibition stand 10 in the camera coordinate system is determined. After determining the position information of the exhibitor, the relative position information in the coordinate system is used to determine the intersection position of the exhibitor's line of sight and the light-transmitting surface of the box-type exhibition stand. The 3D camera scans the target object point by point through a 3D laser sensor, and determines the position information of the target object by scanning feature points.

[0059] In the embodiment of the present application, the control unit can be a processor such as a chip, a CPU, or an MCU, which has the ability to perform object recognition based on the image information collected by the depth image acquisition unit, where the objects to be recognized include portraits, etc. The control unit can be a DSP, a programmable logic device (PLD, Programmable Logic Device), a complex programmable logic device (CPLD, Complex Programmable Logic Device), a field programmable gate array (FPGA, Field-Programmable Gate Array), a general-purpose processor, a controller, a microcontroller (MCU, Micro Controller Unit), a microprocessor (Microprocessor), or other electronic components. As an example, it can also be a dual-core or multi-core chip, etc. As an example, the processing chip can include chips such as Intel Core series, AMD Ryzen series, ARMCortex-A series. Processors such as STM32 series and PIC series can also be included.

[0060] As an example, the control unit performs face recognition based on the captured image using geometric feature matching. Specifically, the geometric feature matching method relies on the geometric features of the human face, such as the shape, size, and positional relationship of the eyes, nose, and mouth, to recognize the facial image. Based on the facial image of the identified object, the distance, angle, and ratio between features such as the eyes, nose, and mouth are measured to construct a feature vector describing the face, thereby determining the face in the image and the object to be identified.

[0061] By comparing the feature vectors of different faces, the identity of the subject to be identified can be determined. For faces in captured images, the face can be identified using the image's feature points. For captured facial images, the face can be identified based on, for example, image displacement between adjacent frames or multiple frames. Once the face is identified, facial feature recognition can be performed based on the facial image to determine the subject's identity.

[0062] As an example, in the embodiments of the present application, a template matching method can also be used to identify the identity of a person based on a face image. The template matching method constructs a standard face template, and then compares the face image to be identified with the template, and determines whether they belong to the same person by calculating the similarity between the two. Alternatively, face recognition can be performed by machine learning. The machine learning method can automatically learn facial features by training a large amount of face data and build an efficient classification model. In the embodiments of the present application, the machine learning method can adopt the machine learning method of support vector machine (SVM) and artificial neural network (ANN). SVM divides different categories of face data by finding the optimal hyperplane, while ANN learns and identifies facial features by simulating the connection mode of human brain neurons. Through the aforementioned specific methods, the person who meets the identity information of the person can be determined. The exhibitor here may be a relevant person who has been authorized in advance. For example, the identity of the exhibitor can be determined in advance through a photo of the exhibitor, so that when the exhibitor visits the exhibition object 20 in the box-type booth 10 of the embodiment of the present application, the object can be presented only to the authorized exhibitor, and other unauthorized visitors cannot obtain the structural details of the exhibition object 20.

[0063] Step 102: Determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face with the face facing the translucent surface of the box-type booth, and determine the intersection position of the presenter's line of sight and the translucent surface of the box-type booth based on the eye position and facial orientation of the presenter.

[0064] In the embodiment of the present application, the head position and facial orientation of the presenter are determined by detecting key facial points, and the orientation of the face in the portrait is determined by detecting key facial features, such as the positions of the eyes, nose, and mouth. For example, by analyzing the positions and connecting lines of the two eyes, it is possible to determine whether the face is facing the left or right. In addition, by the vector relationship between the nose and the two eyes, it is also possible to determine whether the face is facing forward, or whether there is an upward or downward movement of the head. By using the facial orientation of the presenter and the relative positional relationship between the determined presentation object and the light-transmitting surface of the box-type booth 10, the position of the intersection of the presenter's line of sight and the light-transmitting surface of the box-type booth is determined.

[0065] Step 103 : determining a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections.

[0066] In an embodiment of the present application, after determining the intersection position on the light-transmitting surface, a minimum area can be determined based on the intersection position, and the minimum area at least covers all the intersection positions. The display area can be a regular pattern or an irregular pattern. Its main purpose is to control the light-emitting element to emit light through the display area so that the exhibition staff can obtain image information of the exhibition object 20 and better obtain relevant information about the exhibition object 20.

[0067] In this embodiment of the present application, the display area is dynamically adjusted as the number of presenters and the number of presenters change. Specifically, in response to changes in the number of presenters in the image, or in the position of the intersection between the presenters' line of sight and the light-transmitting surface of the box-type display stand, the display area is redefined on the light-transmitting surface based on the intersection, the distance and angle between the light-emitting element 30 and the display area are redefined, and the angle of light emitted by the relevant light-emitting element 30 on the exhibit object 20 is adjusted.

[0068] Step 104 : determining the distance and angle between the light emitting element and the display area based on the display area.

[0069] In the embodiment of the present application, after the display area is determined, the distance and angle between each light emitting element 30 on the exhibition object 20 and the display area need to be determined. Specifically, the distance and angle between the light emitting element 30 and the display area can be determined by coordinate information in the coordinate system.

[0070] Step 105: Based on the determined distance and angle, turn on the light-emitting element on the outer surface of the exhibition object, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the natural color of the outer surface of the exhibition object.

[0071] In the embodiment of the present application, after determining the distance and angle between the light-emitting elements 30 and the display area, the relevant light-emitting elements 30 on the outer surface of the exhibit object 20 are activated based on the determined distance and angle. The angle and intensity of the emitted light from these light-emitting elements 30 are adjusted, and the color of the emitted light from these light-emitting elements 30 is adjusted to match the natural color of the outer surface of the exhibit object. By controlling the angle and intensity of the light-emitting elements 30 on the outer surface of the exhibit object 20, the shape information, such as the outline of the outer surface of the exhibit object 20, can be controlled and presented to the exhibitor through the display area. The external structure and other features of the exhibit object 20 can only be viewed by specific exhibitors, making it difficult for visitors outside the display area to obtain relevant information about the exhibit object 20. In the embodiment of the present application, the color of the emitted light of the light-emitting element 30 can be controlled to display different presentation states of the exhibition object 20 to the exhibition personnel. For example, the relevant states of the exhibition object 20 can be simulated according to the working state of the exhibition object 20. Taking the exhibition object 20 as an engine as an example, different colors such as red and light red can be used to represent the heating conditions of different parts of the exhibition object 20 according to the heating conditions of the engine during operation, so as to more clearly present the working state of the exhibition object 20.

[0072] In an embodiment of the present application, by providing a light-emitting element 30 on the exhibition object 20, it is also possible to present the main components within the exhibition object 20. That is, the components within the exhibition object 20 are obscured by the outer surface of the exhibition object 20, making it difficult to present them to visitors using conventional display methods. However, the present application provides a light-emitting element 30 on a designated component within the exhibition object 20, with the light-emitting control circuit of the light-emitting element 30 electrically connected to a control unit; a projection hole is provided on the side of the exhibition object 20 near the light-transmitting surface, or a projection hole is provided on the bottom of the exhibition object 20; and a reflector or reflector group is provided in the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area. In this way, the relevant shapes of the designated components within the exhibition object 20 can be displayed to the presenter. Specifically, in response to a display instruction for a set component, such as a cylinder, the light-emitting element 30 on the outer surface of the exhibition object 20 is controlled to be turned off, and the light-emitting element 30 on the set component is turned on. The angle of the emitted light of the light-emitting element 30 on the set component is controlled so that the emitted light of the light-emitting element 30 on the set component passes through the projection hole and is emitted to the display area through a reflector or a reflector group. The color of the emitted light of the light-emitting element 30 is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0073] In the embodiment of the present application, the box-type exhibition stand 10 may also be provided with a posture adjustment structure. This posture adjustment structure may be a telescopic adjustment shaft that can be adjusted in height along its axis and rotated to present different surfaces of the exhibit object. The posture adjustment structure may also be implemented in other structures to achieve posture adjustment of the exhibit object 20.

[0074] In the embodiment of the present application, an exhibition object 20 is mounted on a position adjustment structure. In response to the position adjustment structure driving the exhibition object 20 to change its position, the position of the exhibition object 20 in a predetermined coordinate system is recalibrated. The relative distance and angle between the light-emitting element 30 on the exhibition object 20 and the light-transmitting surface are determined. Furthermore, the relative positional relationship between the light-emitting element and the projection aperture on the outer surface of a predetermined component of the exhibition object 20 is determined. This ensures that the outer surface of the exhibition object 20 and the predetermined component can be displayed in the display area.

[0075] In an embodiment of the present application, in order to better control the light-emitting elements to present the display effect of the exhibition object 20, the surface type of the outer surface of the exhibition object 20 can also be obtained, that is, whether the outer surface is a surface of revolution, a flat surface, or a curved surface. After the surface characteristics of the outer surface are obtained, the light-emitting elements can be controlled in groups of light-emitting elements based on the surface characteristics of the outer surface to reduce the control complexity of the control unit. Of course, if cost and implementation difficulty are not considered, it is best to control the light-emitting elements one by one to achieve the best presentation effect of the exhibition object 20. The surface characteristics of the exhibition object 20 in the embodiment of the present application include at least one of surface flatness, surface tilt direction and tilt angle, color, and curvature of the surface. In an embodiment of the present application, a continuous surface area with the same or similar surface characteristics can be used as a planning area, and two or more light-emitting elements can be formed into an element group. The element group is electrically connected to the control unit via the same light-emitting control circuit. The element group is fixed as a filling unit to fill the planned area to form the light-emitting elements on the outer surface of the exhibition object.

[0076] In the embodiments of the present application, for surface areas with no identical or similar surface characteristics, the outer surface of the exhibit object is filled with a single or multiple light-emitting elements. For surface areas with partially identical or partially similar surface characteristics, the outer surface of the exhibit object is filled with a single or multiple light-emitting elements, or the single or multiple light-emitting elements are placed in other adjacent element groups and share the same light-emitting control circuit with other element groups. For example, for some light-emitting elements that only display different colors but have the same characteristics as the known element groups, such as the angle and distance of the emitted light, they can be classified into the known element group. By adjusting the light-emitting elements that display different colors to the color to be displayed, the angle and other adjustments can be made through the control unit and the known element group.

[0077] The embodiment of the present application automatically captures images of exhibitors by installing multiple depth image acquisition units on a box-type exhibition stand, identifies human figures in the captured images, and determines the situation of the exhibitors in the images. Based on the identified facial conditions of the exhibitors, the intersection between the line of sight of these exhibitors and the light-transmitting surface of the exhibitors is determined, thereby determining the display area on the light-transmitting surface. By controlling the light emission angle, light emission color, and light emission intensity of the light-emitting elements on the exhibitors, the exhibitors or their main components are displayed to specific exhibitors, thereby improving the exhibition quality of the exhibitors and ensuring that the exhibitors are displayed to specific exhibitors, thereby improving the safety of the display.

[0078] Figure 4 This is a schematic diagram of the structure of the display output control device of the box-type exhibition stand of the embodiment of the present application. The box-type exhibition stand is provided with an exhibition object, and at least one side of the box-type exhibition stand is a light-transmitting surface, which serves as a display output surface; a light-emitting element is provided on the outer surface of the exhibition object, and the light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a plurality of depth image acquisition units are provided on the box-type exhibition stand; Figure 4 As shown, the display output control device of the box-type exhibition stand in the embodiment of the present application includes:

[0079] The identification unit 40 is configured to, in response to the arrival of a detection cycle, perform object recognition on the image information collected by the multiple depth image acquisition units, and when it is determined that there is a portrait in the image, identify the portrait in the image; extract biometric information from the portrait, perform identity recognition based on the extracted biometric information, and determine the person who meets the presented identity information;

[0080] A first determining unit 41 is configured to determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face when the face is facing the translucent surface of the box-type exhibition stand, and determine the intersection of the presenter's line of sight and the translucent surface of the box-type exhibition stand based on the eye position and facial orientation of the presenter;

[0081] A second determining unit 42 is configured to determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections;

[0082] a third determining unit 43, configured to determine a distance and an angle between the light emitting element and the display area based on the display area;

[0083] The control unit 44 is configured to activate the light-emitting element on the outer surface of the exhibition object based on the determined distance and angle, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the natural color of the outer surface of the exhibition object.

[0084] In some exemplary embodiments, a light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided on the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; and the control unit 44 is further configured to:

[0085] In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0086] In some exemplary embodiments, the first determining unit 41 is further configured to:

[0087] In response to changes in the number of presenters in the image, or changes in the information about the intersection position of the presenters' line of sight and the light-transmitting surface of the box-type booth, the display area is re-determined on the light-transmitting surface based on the intersection position, and the distance and angle between the light-emitting element and the display area are re-determined, triggering the control unit 44 to adjust the output light angle of the light-emitting element.

[0088] In some exemplary embodiments, the box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is set on the posture adjustment structure; the first determining unit 41 is further used to:

[0089] In response to the posture adjustment structure driving the exhibition object to change its posture, recalibrate the position of the exhibition object in a set coordinate system, and determine the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface; and

[0090] The relative position relationship between the light-emitting element on the exhibition object and the projection hole is determined.

[0091] exist Figure 4 Based on the display output control device of the box-type exhibition stand shown in the figure, the display output control device of the box-type exhibition stand in the embodiment of the present application further includes:

[0092] Get unit ( Figure 4(not shown) for obtaining the surface type of the outer surface of the exhibition object, that is, determining whether the outer surface is one of a surface of revolution, a plane, or a curved surface; obtaining surface characteristics of the outer surface, the surface characteristics including at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface;

[0093] The first determining unit 41 is further configured to: select a continuous surface area having identical or similar surface characteristics as a planning area, form an element group with two or more light-emitting elements, and electrically connect the element group to a control unit via a common light-emitting control circuit; and use the element group as a filling unit to fill and fix the light-emitting elements in the planning area to form the outer surface of the exhibition object.

[0094] In some exemplary embodiments, the first determining unit 41 is further configured to:

[0095] For surface areas without identical or similar surface characteristics, filling the outer surface of the exhibit object with a single or multiple light-emitting elements as units;

[0096] For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are set in other adjacent element groups and share the same light-emitting control circuit with other element groups.

[0097] In an exemplary embodiment, the aforementioned units may be implemented by one or more central processing units (CPU), graphics processing units (GPU), application-specific integrated circuits (ASIC), DSPs, programmable logic devices (PLD), complex programmable logic devices (CPLD), field-programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components.

[0098] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0099] Figure 5This is a schematic diagram of the structure of the electronic device according to the embodiment of the present application. Figure 5 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0100] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0101] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0102] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0103] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0104] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0105] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0106] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800. The sensor assembly 814 can also detect changes in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and temperature changes of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0107] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0108] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the steps of the display output control method of the box-type booth of the above-mentioned embodiment.

[0109] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as memory 804 including instructions. The instructions are executable by processor 820 of electronic device 800 to perform the steps of the display output control method for a box-type display stand according to the above embodiment. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, or optical data storage device.

[0110] The embodiment of the present application further describes a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the display output control method of the box-type exhibition stand of the embodiment are implemented.

[0111] It should be understood that “one embodiment” or “an embodiment” mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, “in one embodiment” or “in an embodiment” appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0112] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0113] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is merely a logical functional division. In actual implementation, other division methods may be used, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not exist.

[0114] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0115] The above description is merely an embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A method for controlling display output of a box-type exhibition stand, wherein an exhibition object is arranged in the box-type exhibition stand, and at least one side of the box-type exhibition stand is a light-transmitting surface serving as a display output surface; characterized in that: The outer surface of the exhibition object is provided with a light-emitting element, and the light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a plurality of depth image acquisition units are provided on the box-type exhibition stand; the method includes: In response to the arrival of the detection cycle, the image information collected by the multiple depth image acquisition units is subjected to object recognition, and when it is determined that there is a portrait in the image, the portrait in the image is recognized; biometric information in the portrait is extracted, and identity recognition is performed based on the extracted biometric information to determine the person who meets the presented identity information; Determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face facing the translucent surface of the box-type booth, and determine the intersection of the presenter's line of sight and the translucent surface of the box-type booth based on the eye position and facial orientation of the presenter; Determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections; Based on the display area, the distance and angle between the light-emitting element and the display area are determined; based on the determined distance and angle, the light-emitting element on the outer surface of the exhibition object is turned on, so that the light-emitting element emits light at a set angle and intensity, and the color of the emitted light of the light-emitting element is adjusted so that the color of the emitted light matches the natural color of the outer surface of the exhibition object.

2. The method according to claim 1, characterized in that A light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided on the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; the method further includes: In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

3. The method according to claim 1, characterized in that The method further comprises: In response to changes in the number of presenters in the image, or changes in the information about the intersection position of the presenters' line of sight and the light-transmitting surface of the box-type booth, the display area is re-determined on the light-transmitting surface based on the intersection position, the distance and angle between the light-emitting element and the display area are re-determined, and the output light angle of the light-emitting element is adjusted.

4. The method according to claim 2, characterized in that The box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is set on the posture adjustment structure; the method further includes: In response to the posture adjustment structure driving the exhibition object to change its posture, recalibrate the position of the exhibition object in a set coordinate system, and determine the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface; and The relative position relationship between the light-emitting element on the exhibition object and the projection hole is determined.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Obtaining the surface type of the outer surface of the exhibition object, that is, determining whether the outer surface is a flat surface or a curved surface; obtaining surface characteristics of the outer surface, the surface characteristics including at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface; A continuous surface area with identical or similar surface characteristics is used as a planning area, and an element group is formed with two or more light-emitting elements. The element group is electrically connected to a control unit via a common light-emitting control circuit; the element group is used as a filling unit to fill and fix the light-emitting elements in the planning area to form the outer surface of the exhibition object.

6. The method according to claim 5, characterized in that The method further comprises: For surface areas without identical or similar surface characteristics, filling the outer surface of the exhibit object with a single or multiple light-emitting elements as units; For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are set in other adjacent element groups and share the same light-emitting control circuit with other element groups.

7. A display output control device for a box-type exhibition stand, wherein an exhibition object is placed in the box-type exhibition stand, and at least one side of the box-type exhibition stand is a light-transmitting surface, serving as a display output surface; characterized in that: The outer surface of the exhibition object is provided with a light-emitting element, and the light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a plurality of depth image acquisition units are provided on the box-type exhibition stand; the device includes: The recognition unit is configured to, in response to the arrival of the detection cycle, perform object recognition on the image information collected by the multiple depth image collection units, and when it is determined that there is a portrait in the image, recognize the portrait in the image; extract biometric information from the portrait, perform identity recognition based on the extracted biometric information, and determine the person who meets the presented identity information; A first determining unit is configured to determine the head position and facial orientation of the presenter based on depth information of the image, determine the eye position of the presenter's face facing the translucent surface of the box-type exhibition stand, and determine the position of the intersection of the presenter's line of sight and the translucent surface of the box-type exhibition stand based on the eye position and facial orientation of the presenter; A second determining unit is configured to determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections; a third determining unit, configured to determine a distance and an angle between the light-emitting element and the display area based on the display area; The control unit is configured to activate the light-emitting element on the outer surface of the exhibition object based on the determined distance and angle, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the natural color of the outer surface of the exhibition object.

8. The device according to claim 7, characterized in that A light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided on the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; and the control unit is further configured to: In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

9. The device according to claim 7, characterized in that The first determining unit is further configured to: In response to changes in the number of presenters in the image, or changes in the information about the intersection position of the presenters' line of sight and the light-transmitting surface of the box-type booth, the display area is re-determined on the light-transmitting surface based on the intersection position, and the distance and angle between the light-emitting element and the display area are re-determined, triggering the control unit to adjust the output light angle of the light-emitting element.

10. The device according to claim 8, characterized in that The box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is set on the posture adjustment structure; the first determination unit is further used to: In response to the posture adjustment structure driving the exhibition object to change its posture, recalibrate the position of the exhibition object in a set coordinate system, and determine the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface; as well as The relative position relationship between the light-emitting element on the exhibition object and the projection hole is determined.

Images