Display output control method and device of box type exhibition stand

Abstract

The invention discloses a display output control method and device of a box type exhibition stand. The method comprises the following steps: in response to arrival of a detection period, carrying out object recognition on image information acquired by a plurality of depth image acquisition units, and when it is determined that a human image exists in the image, recognizing the human image in the image; extracting biological characteristic information in the portrait, performing identity recognition based on the extracted biological characteristic information, and determining exhibition presenting persons conforming to the exhibition presenting identity information; determining the intersection position of the sight line of the exhibition person and the light-transmitting surface of the box-type exhibition stand, and determining an exhibition area on the light-transmitting surface of the box-type exhibition stand based on the intersection position; determining a distance and an angle between the light-emitting element and the display area; and based on the determined distance and angle, turning on a light-emitting element on the outer surface of the exhibition object to enable the light-emitting element to emit light at a set angle and intensity, and adjusting the color of emergent light of the light-emitting element to enable the color of the emergent light to be matched with the natural color of the outer surface of the exhibition object. According to the invention, the display safety is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to exhibition stand display technology, and more particularly to a display output control method and device for a box-type exhibition stand. Background Art

[0002] With the continuous development of the global economy, the communication between all parties is also increasing. The communication between enterprises often uses the display of products or commodities as the main means. By directly presenting the product shape and operating characteristics to the communication party, the exhibitors can more conveniently obtain the exhibit information and improve the communication efficiency of all parties. In many scenarios, especially when exhibits need to be displayed to specific objects, and the exhibitors are not restricted, it is necessary to restrict the display of exhibits so that they can only be displayed to specific objects. For example, for newly developed products, they may only need to be displayed to close partners. As for the internal structure of the exhibits, such as major components, they need to be displayed through a separate booth or exhibition space, or displayed to exhibitors through image explanations and other means, which makes the display of exhibits inconvenient. Summary of the invention

[0003] In view of this, an embodiment of the present application provides a display output control method and device for a box-type booth, which can present exhibits to specific exhibitors by arranging light-emitting elements on the exhibits and the main components inside the exhibits, and at the same time can present the main components or key components inside the exhibits.

[0004] According to a first aspect of an embodiment of the present application, a display output control method for a box-type booth is provided, wherein an exhibition object is arranged in the box-type booth, and at least one side of the box-type booth is a light-transmitting surface, which serves as a display output surface; a light-emitting element is arranged on the outer surface of the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to a control unit; a plurality of depth image acquisition units are arranged on the box-type booth; and the method comprises:

[0005] In response to the arrival of the detection cycle, the image information collected by the multiple depth image acquisition units is subjected to object recognition, and when it is determined that there is a portrait in the image, the portrait in the image is recognized; the biometric information in the portrait is extracted, and identity recognition is performed based on the extracted biometric information to determine the person who meets the identity information for presentation;

[0006] Determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face with the face facing the light-transmitting surface of the box-type booth, and determine the intersection position of the presenter's line of sight and the light-transmitting surface of the box-type booth based on the eye position and facial orientation of the presenter;

[0007] Determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections;

[0008] Based on the display area, the distance and angle between the light-emitting element and the display area are determined; based on the determined distance and angle, the light-emitting element on the outer surface of the exhibition object is turned on, so that the light-emitting element emits light at a set angle and intensity, and the color of the emitted light of the light-emitting element is adjusted so that the color of the emitted light matches the original color of the outer surface of the exhibition object.

[0009] In some exemplary embodiments, a light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided at the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole, so that the light path of the projection hole can be reflected toward the display area; the method further includes:

[0010] In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0011] In some exemplary embodiments, the method further comprises:

[0012] In response to changes in the number of presenters in the image, or changes in information about the position of the intersection between the presenters' lines of sight and the light-transmitting surface of the box-type exhibition stand, the display area is redetermined on the light-transmitting surface based on the intersection position, the distance and angle between the light-emitting element and the display area are redetermined, and the output light angle of the light-emitting element is adjusted.

[0013] In some exemplary embodiments, a posture adjustment structure is provided in the box-type exhibition stand, and the exhibition object is provided on the posture adjustment structure; the method further includes:

[0014] In response to the posture adjustment structure driving the exhibition object to change its posture, the position of the exhibition object in the set coordinate system is recalibrated, and the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface are determined; and

[0015] The relative position relationship between the light emitting element on the exhibition object and the projection hole is determined.

[0016] In some exemplary embodiments, the method further comprises:

[0017] Acquire the surface type of the outer surface of the exhibition object, that is, determine whether the outer surface is one of a rotational surface, a plane or a curved surface; acquire the surface characteristics of the outer surface, the surface characteristics at least including at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface;

[0018] A continuous surface area with the same or similar surface characteristics is used as a planning area, and an element group is formed by two or more light-emitting elements. The element group is electrically connected to a control unit through a same light-emitting control circuit; the element group is used as a filling unit to fill and fix in the planning area to form the light-emitting elements on the outer surface of the exhibition object.

[0019] In some exemplary embodiments, the method further comprises:

[0020] For surface areas without the same or similar surface characteristics, fill the outer surface of the exhibition object with a single or multiple light-emitting elements as units;

[0021] For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are arranged in other adjacent element groups and share the same light-emitting control circuit with other element groups.

[0022] According to a second aspect of an embodiment of the present application, a display output control device for a box-type booth is provided, wherein an exhibition object is arranged in the box-type booth, and at least one side of the box-type booth is a light-transmitting surface, which serves as a display output surface; a light-emitting element is arranged on the outer surface of the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to a control unit; a plurality of depth image acquisition units are arranged on the box-type booth; the device comprises:

[0023] The recognition unit is used to perform object recognition on the image information collected by the multiple depth image acquisition units in response to the arrival of the detection cycle, and when it is determined that there is a portrait in the image, recognize the portrait in the image; extract biometric information from the portrait, perform identity recognition based on the extracted biometric information, and determine the person who meets the identity information for presentation;

[0024] A first determination unit is used to determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face with the face facing the light-transmitting surface of the box-type exhibition stand, and determine the position of the intersection of the presenter's line of sight and the light-transmitting surface of the box-type exhibition stand based on the eye position and facial orientation of the presenter;

[0025] A second determining unit, configured to determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections;

[0026] A third determining unit, configured to determine a distance and an angle between the light emitting element and the display area based on the display area;

[0027] The control unit is used to turn on the light-emitting element on the outer surface of the exhibition object based on the determined distance and angle, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the original color of the outer surface of the exhibition object.

[0028] In some exemplary embodiments, a light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided at the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; and the control unit is further used to:

[0029] In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0030] In some exemplary embodiments, the first determining unit is further configured to:

[0031] In response to changes in the number of presenters in the image, or changes in information about the position of the intersection between the presenters' sight lines and the light-transmitting surface of the box-type exhibition stand, the display area is redetermined on the light-transmitting surface based on the intersection position, and the distance and angle between the light-emitting element and the display area are redetermined, triggering the control unit to adjust the output light angle of the light-emitting element.

[0032] In some exemplary embodiments, a posture adjustment structure is provided in the box-type exhibition stand, and the exhibition object is provided on the posture adjustment structure; and the first determining unit is further used for:

[0033] In response to the posture adjustment structure driving the exhibition object to change its posture, the position of the exhibition object in the set coordinate system is recalibrated, and the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface are determined; and

[0034] The relative position relationship between the light emitting element on the exhibition object and the projection hole is determined.

[0035] In some exemplary embodiments, the apparatus further comprises:

[0036] an acquisition unit, configured to acquire the surface type of the outer surface of the exhibition object, that is, to determine whether the outer surface is one of a rotational surface, a plane or a curved surface; and to acquire the surface characteristics of the outer surface, wherein the surface characteristics include at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface;

[0037] The first determination unit is further used to: take a continuous surface area with the same or similar surface characteristics as a planning area, form an element group with more than two light-emitting elements, and the element group is electrically connected to the control unit through the same light-emitting control circuit; and use the element group as a filling unit to fill the light-emitting elements fixed in the planning area to form the outer surface of the exhibition object.

[0038] In some exemplary embodiments, the first determining unit is further configured to:

[0039] For surface areas without the same or similar surface characteristics, fill the outer surface of the exhibition object with a single or multiple light-emitting elements as units;

[0040] For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are arranged in other adjacent element groups and share the same light-emitting control circuit with other element groups.

[0041] According to a third aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the display output control method of the box-type exhibition stand are implemented.

[0042] According to a fourth aspect of an embodiment of the present application, there is provided an electronic device, including:

[0043] at least one processor; and

[0044] a memory communicatively connected to the at least one processor; wherein,

[0045] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the steps of the display output control method of the box-type exhibition stand.

[0046] The technical solution of the embodiment of the present application is to automatically collect images of exhibitors by setting up multiple depth image acquisition units on the box-type exhibition stand, identify the portraits in the acquired images to determine the situation of the exhibitors in the images, and determine the intersection between the sight lines of these exhibitors and the light-transmitting surface of the exhibitors based on the identified faces of the exhibitors, so as to determine the display area on the light-transmitting surface. By controlling the light emission angle, light emission color and light emission intensity of the light-emitting elements on the exhibition objects, the exhibition objects or their main components are displayed to specific exhibitors to improve the exhibition quality of the exhibition objects, and to ensure that the exhibition objects are displayed to specific exhibitors, thereby improving the safety of the display. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 A schematic diagram showing a flow chart of a display output control method of a box-type exhibition stand according to an embodiment of the present application;

[0049] Figure 2 The overall structural diagram of the box-type exhibition stand according to the embodiment of the present application is shown;

[0050] Figure 3 A schematic diagram showing a structure in which a light-emitting element is arranged on the outer surface of an exhibition object according to an embodiment of the present application;

[0051] Figure 4 This is a schematic diagram of the structure of the display output control device of the box-type exhibition stand according to an embodiment of the present application;

[0052] Figure 5 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0053] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0054] The essence of the technical solution of the embodiment of the present application is explained in detail below with reference to the accompanying drawings.

[0055] Figure 1 A flow chart showing a method for controlling the display output of a box-type exhibition stand according to an embodiment of the present application is shown. Figure 1 As shown, the display output control method of the box-type exhibition stand in the embodiment of the present application includes the following steps:

[0056] Step 101, in response to the arrival of the detection cycle, object recognition is performed on the image information collected by multiple depth image acquisition units. When it is determined that there is a portrait in the image, the portrait in the image is recognized; biometric information in the portrait is extracted, and identity recognition is performed based on the extracted biometric information to determine the person who meets the identity information for presentation.

[0057] In the embodiment of the present application, Figure 2 The overall structure diagram of the box-type exhibition stand according to the embodiment of the present application is shown in FIG. Figure 2 As shown, an exhibition object 20 is arranged in the box-type exhibition stand 10 of the embodiment of the present application, and at least one side of the box-type exhibition stand 10 is a light-transmitting surface, which serves as a display output surface; Figure 2 The light-transmitting surface in the box-type exhibition stand 10 may be one surface facing the user, or may be two or more surfaces, which is set according to the specific structure and display needs of the box-type exhibition stand 10. In the embodiment of the present application, although the box-type exhibition stand 10 is provided with a light-transmitting surface, since the exhibition object 20 is provided with a light-emitting element, the light-emitting element only emits light of the corresponding frequency band to a specific angle and area. Therefore, when the overall volume of the box-type exhibition stand 10 is small and it is far away from the exhibitors, the visitors in the non-light-emitting area cannot clearly obtain the appearance image information of the exhibition object 20.

[0058] In the embodiment of the present application, Figure 3 The schematic diagram of the structure of the outer surface of the exhibition object 20 of the embodiment of the present application is provided with a light-emitting element, such as Figure 3 As shown, the outer surface 21 of the exhibition object 20 is provided with a light emitting element 30, and the light emitting control circuit ( Figure 3 not shown) and a control unit ( Figure 3 (not shown) are electrically connected. Figure 2As shown, a plurality of depth image acquisition units 11 are provided on the box-type exhibition stand 10 of the embodiment of the present application. As an example, the depth image acquisition unit 11 may be a depth camera, a binocular camera, a 3D camera, etc. Taking the binocular camera as an example, its ranging principle is to continuously send light pulses to the target, receive the light returned from the object through the sensor, and determine the distance of the target object by detecting the flight time of the light pulse. In the embodiment of the present application, the coordinate system of the camera is calibrated, and the position information of the light-emitting element 30 and the light-transmitting surface on the exhibition object 20 in the box-type exhibition stand 10 in the camera coordinate system is determined. After determining the position information of the exhibitor, the relative position information in the coordinate system is used to determine the intersection position of the exhibitor's line of sight and the light-transmitting surface of the box-type exhibition stand. The 3D camera scans the target object point by point through a 3D laser sensor, and determines the position information of the target object by scanning feature points.

[0059] In the embodiment of the present application, the control unit can be a processor such as a chip, a CPU, or an MCU, which has the ability to perform object recognition based on the image information collected by the depth image acquisition unit, where the objects to be recognized include portraits, etc. The control unit can be a DSP, a programmable logic device (PLD, Programmable Logic Device), a complex programmable logic device (CPLD, Complex Programmable Logic Device), a field programmable gate array (FPGA, Field-Programmable Gate Array), a general processor, a controller, a microcontroller (MCU, Micro Controller Unit), a microprocessor (Microprocessor), or other electronic components. As an example, it can also be a dual-core or multi-core chip, etc. As an example, the processing chip can include chips such as Intel Core series, AMD Ryzen series, ARMCortex-A series. Processors such as STM32 series and PIC series can also be included.

[0060] As an example, the control unit performs face recognition based on the captured image using geometric feature matching. Specifically, the geometric feature matching method relies on the geometric features of a person's face, such as the shape, size, and positional relationship of the eyes, nose, and mouth, to recognize the face image. Based on the facial image of the object to be recognized, the distance, angle, and ratio between features such as the eyes, nose, and mouth are measured to construct a feature vector describing the face, thereby determining the face in the image and the object to be recognized.

[0061] By comparing the feature vectors of different faces, the identity information of the object to be identified is obtained. For the face in the captured image, the face in the image can be determined by the feature points of the image. For the captured face image, it can be determined based on the image displacement between adjacent frames or multiple frames. After the face is determined, facial feature recognition can be performed based on the face image to determine the identity of the object to be identified.

[0062] As an example, in the embodiments of the present application, a template matching method can also be used to identify the identity of a person based on a face image. The template matching method constructs a standard face template, and then compares the face image to be identified with the template, and determines whether they belong to the same person by calculating the similarity between the two. Alternatively, face recognition can also be performed by machine learning. The machine learning method can automatically learn facial features by training a large amount of face data and build an efficient classification model. In the embodiments of the present application, the machine learning method can adopt the machine learning method of support vector machine (SVM) and artificial neural network (ANN). SVM divides different categories of face data by finding the optimal hyperplane, while ANN learns and identifies facial features by simulating the connection mode of human brain neurons. Through the aforementioned specific methods, the presentation personnel who meet the presentation identity information can be determined. The exhibitor here may be a relevant person who has been authorized in advance. For example, the identity of the exhibitor can be determined in advance through a photo of the exhibitor, so that when the exhibitor visits the exhibition object 20 in the box-type booth 10 of the embodiment of the present application, the object can be presented only to the authorized exhibitor, while other unauthorized visitors cannot obtain the structural details of the exhibition object 20.

[0063] Step 102, determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face with its face facing the translucent surface of the box-type booth, and determine the intersection position of the presenter's line of sight and the translucent surface of the box-type booth based on the eye position and facial orientation of the presenter.

[0064] In the embodiment of the present application, the head position and facial orientation of the presenter are determined by detecting key facial points, and the orientation of the face in the portrait is determined by detecting key feature points of the face, such as the positions of the eyes, nose, and mouth. For example, by analyzing the positions and connecting lines of the two eyes, it is possible to determine whether the face is facing the left or right. In addition, by the vector relationship between the nose and the two eyes, it is also possible to determine whether the face is facing forward, or whether there is an upward or downward movement of the head. By using the facial orientation of the presenter and the relative positional relationship between the determined presentation object and the light-transmitting surface of the box-type booth 10, the position of the intersection of the presenter's line of sight and the light-transmitting surface of the box-type booth is determined.

[0065] Step 103: determining a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections.

[0066] In the embodiment of the present application, after determining the intersection position on the light-transmitting surface, a minimum area can be determined based on the intersection position, and the minimum area at least covers all the intersection positions. The display area can be a regular pattern or an irregular pattern. Its main purpose is to control the light-emitting element to emit light through the display area so that the exhibitor can obtain the image information of the exhibition object 20 and better obtain the relevant information of the exhibition object 20.

[0067] In the embodiment of the present application, the display area is dynamically adjusted as the number of presenters and the number of presenters change. Specifically, in response to the change in the number of presenters in the image, or the change in the information of the intersection position between the presenter's line of sight and the light-transmitting surface of the box-type exhibition stand, the display area is re-determined on the light-transmitting surface based on the intersection position, the distance and angle between the light-emitting element 30 and the display area are re-determined, and the light emission angle of the relevant light-emitting element 30 on the exhibition object 20 is adjusted.

[0068] Step 104: Determine the distance and angle between the light emitting element and the display area based on the display area.

[0069] In the embodiment of the present application, after the display area is determined, the distance and angle between each light emitting element 30 on the exhibition object 20 and the display area need to be determined. Specifically, the distance and angle between the light emitting element 30 and the display area can be determined by coordinate information in the coordinate system.

[0070] Step 105, based on the determined distance and angle, turn on the light-emitting element on the outer surface of the exhibition object, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the original color of the outer surface of the exhibition object.

[0071] In the embodiment of the present application, after the distance and angle between the light emitting element 30 and the display area are determined, the relevant light emitting elements 30 on the outer surface of the exhibition object 20 are turned on based on the determined distance and angle, and the angle and intensity of the emitted light of these light emitting elements 30 are adjusted, and the color of the emitted light of the light emitting element 30 is adjusted so that the color of the emitted light matches the natural color of the outer surface of the exhibition object. By controlling the light emitting angle and intensity of the relevant light emitting elements 30 on the outer surface of the exhibition object 20, the shape information such as the outline of the outer surface of the exhibition object 20 can be controlled to be presented to the exhibition personnel through the display area. The appearance structure and other features of the exhibition object 20 can only be viewed by specific exhibition personnel, and it is difficult for visitors outside the sight of the non-display area to obtain relevant information about the exhibition object 20. In the embodiment of the present application, the color of the emitted light of the light-emitting element 30 can be controlled to display different presentation states of the exhibition object 20 to the presenter. For example, the relevant state of the exhibition object 20 can be simulated according to the working state of the exhibition object 20. Taking the exhibition object 20 as an engine as an example, different colors such as red and light red can be used to represent the heating conditions of different parts of the exhibition object 20 according to the heating conditions of the engine when working, so as to more clearly present the working state of the exhibition object 20.

[0072] In the embodiment of the present application, by setting a light-emitting element 30 on the exhibition object 20, the main components inside the exhibition object 20 can also be presented. That is, the components inside the exhibition object 20 are blocked by the outer surface of the exhibition object 20, and it is difficult to present them to visitors with general display means. However, in the present application, a light-emitting element 30 is set on the set components in the exhibition object 20, and the light-emitting control circuit of the light-emitting element 30 is electrically connected to the control unit; a projection hole is set on the side of the exhibition object 20 near the light-transmitting surface, or a projection hole is set at the bottom of the exhibition object 20; a reflector or a reflector group is set on the light path of the projection hole, so that the light path of the projection hole can be reflected toward the display area. In this way, the relevant shapes of the set components in the exhibition object 20 can be displayed to the presenter. Specifically, in response to a display instruction of a set component such as a cylinder, the light-emitting element 30 on the outer surface of the exhibition object 20 is controlled to be turned off, the light-emitting element 30 on the set component is turned on, and the emission angle of the light-emitting element 30 on the set component is controlled so that the emission light of the light-emitting element 30 on the set component penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emission light of the light-emitting element 30 is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0073] In the embodiment of the present application, a posture adjustment structure may be provided in the box-type exhibition stand 10. The posture adjustment structure may be a telescopic adjustment shaft, which may be height-adjustable along the axis of the telescopic adjustment shaft and may be rotated to present different surfaces of the exhibition object. The posture adjustment structure may also be other implementation structures to achieve posture adjustment of the exhibition object 20.

[0074] The exhibition object 20 of the embodiment of the present application is arranged on the posture adjustment structure; in response to the posture adjustment structure driving the exhibition object 20 to change its posture, the position of the exhibition object 20 in the set coordinate system is recalibrated, and the relative distance and relative angle between the light-emitting element 30 on the exhibition object 20 and the light-transmitting surface are determined; the relative position relationship between the light-emitting element on the outer surface of the set component on the exhibition object 20 and the projection hole is determined. This ensures that the outer surface of the exhibition object 20 and the set component can be displayed through the display area.

[0075] In the embodiment of the present application, in order to better control the light-emitting elements to present the display effect of the exhibition object 20, the surface type of the outer surface of the exhibition object 20 can also be obtained, that is, to determine whether the outer surface is a rotating surface, a plane or a curved surface, etc.; after the surface characteristics of the outer surface are obtained, the light-emitting elements can be controlled in the form of a light-emitting element group based on the surface characteristics of the outer surface to reduce the control complexity of the control unit. Of course, without considering the cost and difficulty of implementation, it is best to control the light-emitting elements one by one to achieve the best effect presentation of the exhibition object 20. The surface characteristics of the exhibition object 20 in the embodiment of the present application include at least one of the surface flatness, the surface inclination direction and inclination angle, the color, and the curvature of the surface; in the embodiment of the present application, a continuous surface area with the same or similar surface characteristics can be used as a planning area, and an element group is formed with more than two light-emitting elements, and the element group is electrically connected to the control unit through the same light-emitting control circuit; the element group is used as a filling unit to fill and fix in the planning area to form the light-emitting element of the outer surface of the exhibition object.

[0076] In the embodiment of the present application, for surface areas without identical or similar surface characteristics, a single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object; for surface areas with partially identical or partially similar surface characteristics, a single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or a single or multiple light-emitting elements are set in other adjacent element groups and share the same light-emitting control circuit with other element groups. For example, for some light-emitting elements that only display different colors but have the same characteristics as the known element groups in terms of the angle and distance of the emitted light, they can be classified into the known element group. By adjusting the light-emitting elements with different display colors to the color to be displayed, the angle and the like can be adjusted by the control unit and the known element group.

[0077] The embodiment of the present application automatically collects images of exhibitors by installing multiple depth image acquisition units on a box-type exhibition stand, identifies the portraits in the captured images, and determines the situation of the exhibitors in the images. Based on the identified faces of the exhibitors, the intersections between the sight lines of these exhibitors and the light-transmitting surfaces of the exhibitors are determined, thereby determining the display area on the light-transmitting surface. By controlling the light emission angle, light emission color, and light emission intensity of the light-emitting elements on the exhibitors, the exhibitors or their main components are displayed to specific exhibitors to improve the exhibition quality of the exhibitors, and to ensure that the exhibitors are displayed to specific exhibitors, thereby improving the safety of the display.

[0078] Figure 4 The present invention is a schematic diagram of the structure of the display output control device of the box-type booth of the embodiment of the present invention. An exhibition object is arranged in the box-type booth, and at least one side of the box-type booth is a light-transmitting surface, which serves as a display output surface. A light-emitting element is arranged on the outer surface of the exhibition object, and the light-emitting control circuit of the light-emitting element is electrically connected to the control unit. A plurality of depth image acquisition units are arranged on the box-type booth; Figure 4 As shown, the display output control device of the box-type exhibition stand in the embodiment of the present application includes:

[0079] The recognition unit 40 is used to perform object recognition on the image information collected by the multiple depth image acquisition units in response to the arrival of the detection cycle, and when it is determined that there is a portrait in the image, recognize the portrait in the image; extract biometric information from the portrait, perform identity recognition based on the extracted biometric information, and determine the person who meets the identity information for presentation;

[0080] The first determination unit 41 is used to determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the face of the presenter facing the light-transmitting surface of the box-type exhibition stand, and determine the intersection position of the presenter's line of sight and the light-transmitting surface of the box-type exhibition stand based on the eye position and facial orientation of the presenter;

[0081] A second determining unit 42, configured to determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections;

[0082] A third determining unit 43, configured to determine a distance and an angle between the light emitting element and the display area based on the display area;

[0083] The control unit 44 is used to turn on the light-emitting element on the outer surface of the exhibition object based on the determined distance and angle, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the original color of the outer surface of the exhibition object.

[0084] In some exemplary embodiments, a light-emitting element is provided on a set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided at the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole so that the light path of the projection hole can be reflected toward the display area; the control unit 44 is further used to:

[0085] In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

[0086] In some exemplary embodiments, the first determining unit 41 is further configured to:

[0087] In response to changes in the number of presenters in the image, or changes in the information about the position of the intersection between the presenters' sight lines and the light-transmitting surface of the box-type exhibition stand, the display area is redetermined on the light-transmitting surface based on the intersection position, and the distance and angle between the light-emitting element and the display area are redetermined, triggering the control unit 44 to adjust the output light angle of the light-emitting element.

[0088] In some exemplary embodiments, a posture adjustment structure is provided in the box-type exhibition stand, and the exhibition object is provided on the posture adjustment structure; the first determination unit 41 is further used to:

[0089] In response to the posture adjustment structure driving the exhibition object to change its posture, the position of the exhibition object in the set coordinate system is recalibrated, and the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface are determined; and

[0090] The relative position relationship between the light emitting element on the exhibition object and the projection hole is determined.

[0091] exist Figure 4 Based on the display output control device of the box-type exhibition stand shown in the figure, the display output control device of the box-type exhibition stand in the embodiment of the present application further includes:

[0092] Get unit( Figure 4(not shown) for obtaining the surface type of the outer surface of the exhibition object, that is, determining whether the outer surface is one of a rotational surface, a plane or a curved surface; obtaining the surface characteristics of the outer surface, the surface characteristics at least including at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface;

[0093] The first determination unit 41 is further used to: take a continuous surface area with the same or similar surface characteristics as a planning area, form an element group with more than two light-emitting elements, and the element group is electrically connected to the control unit through the same light-emitting control circuit; and use the element group as a filling unit to fill and fix the light-emitting elements in the planning area to form the outer surface of the exhibition object.

[0094] In some exemplary embodiments, the first determining unit 41 is further configured to:

[0095] For surface areas without the same or similar surface characteristics, fill the outer surface of the exhibition object with a single or multiple light-emitting elements as units;

[0096] For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are arranged in other adjacent element groups and share the same light-emitting control circuit with other element groups.

[0097] In an exemplary embodiment, the aforementioned units and the like may be implemented by one or more central processing units (CPU), graphics processing units (GPU), application specific integrated circuits (ASIC), DSPs, programmable logic devices (PLD), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components.

[0098] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0099] Figure 5Schematic diagram of the structure of the electronic device according to the embodiment of the present application. Figure 5 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0100] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0101] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0102] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0103] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0104] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0105] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0106] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0107] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0108] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the steps of the display output control method of the box-type booth of the above-mentioned embodiment.

[0109] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to complete the steps of the display output control method of the box-type booth of the above embodiment. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0110] The embodiment of the present application also describes a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the display output control method of the box-type exhibition stand of the embodiment are implemented.

[0111] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0112] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0113] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or do not exist.

[0114] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0115] The above is only an embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A display output control method for a box-type exhibition stand, wherein an exhibition object is arranged in the box-type exhibition stand, and at least one side of the box-type exhibition stand is a light-transmitting surface, which serves as a display output surface; characterized in that: The outer surface of the exhibition object is provided with a light-emitting element, and the light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a plurality of depth image acquisition units are provided on the box-type exhibition stand; the method comprises: In response to the arrival of the detection cycle, the image information collected by the multiple depth image acquisition units is subjected to object recognition, and when it is determined that there is a portrait in the image, the portrait in the image is recognized; the biometric information in the portrait is extracted, and identity recognition is performed based on the extracted biometric information to determine the person who meets the identity information for presentation; Determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face with the face facing the light-transmitting surface of the box-type booth, and determine the intersection position of the presenter's line of sight and the light-transmitting surface of the box-type booth based on the eye position and facial orientation of the presenter; Determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections; Based on the display area, the distance and angle between the light-emitting element and the display area are determined; based on the determined distance and angle, the light-emitting element on the outer surface of the exhibition object is turned on, so that the light-emitting element emits light at a set angle and intensity, and the color of the emitted light of the light-emitting element is adjusted so that the color of the emitted light matches the original color of the outer surface of the exhibition object.

2. The method according to claim 1, characterized in that A light-emitting element is provided on the set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided at the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole, so that the light path of the projection hole can be reflected toward the display area; the method further includes: In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

3. The method according to claim 1, characterized in that The method further comprises: In response to changes in the number of presenters in the image, or changes in information about the position of the intersection between the presenters' lines of sight and the light-transmitting surface of the box-type exhibition stand, the display area is redetermined on the light-transmitting surface based on the intersection position, the distance and angle between the light-emitting element and the display area are redetermined, and the output light angle of the light-emitting element is adjusted.

4. The method according to claim 2, characterized in that: The box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is arranged on the posture adjustment structure; the method further comprises: In response to the posture adjustment structure driving the exhibition object to change its posture, the position of the exhibition object in the set coordinate system is recalibrated, and the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface are determined; and The relative position relationship between the light emitting element on the exhibition object and the projection hole is determined.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquire the surface type of the outer surface of the exhibition object, that is, determine whether the outer surface is one of a rotational surface, a plane or a curved surface; acquire the surface characteristics of the outer surface, the surface characteristics at least including at least one of surface flatness, surface inclination direction and inclination angle, color, and curvature of the curved surface; A continuous surface area with the same or similar surface characteristics is used as a planning area, and an element group is formed by two or more light-emitting elements. The element group is electrically connected to a control unit through a same light-emitting control circuit; the element group is used as a filling unit to fill and fix in the planning area to form the light-emitting elements on the outer surface of the exhibition object.

6. The method according to claim 5, characterized in that The method further comprises: For surface areas without the same or similar surface characteristics, fill the outer surface of the exhibition object with a single or multiple light-emitting elements as units; For surface areas with partially identical or partially similar surface characteristics, single or multiple light-emitting elements are used as units to fill the outer surface of the exhibition object, or single or multiple light-emitting elements are arranged in other adjacent element groups and share the same light-emitting control circuit with other element groups.

7. A display output control device for a box-type exhibition stand, wherein an exhibition object is arranged in the box-type exhibition stand, and at least one side of the box-type exhibition stand is a light-transmitting surface, serving as a display output surface; characterized in that: The outer surface of the exhibition object is provided with a light-emitting element, and the light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a plurality of depth image acquisition units are provided on the box-type exhibition stand; the device includes: The recognition unit is used to perform object recognition on the image information collected by the multiple depth image acquisition units in response to the arrival of the detection cycle, and when it is determined that there is a portrait in the image, recognize the portrait in the image; extract biometric information from the portrait, perform identity recognition based on the extracted biometric information, and determine the person who meets the identity information for presentation; A first determination unit is used to determine the head position and facial orientation of the presenter based on the depth information of the image, determine the eye position of the presenter's face with the face facing the light-transmitting surface of the box-type exhibition stand, and determine the position of the intersection of the presenter's line of sight and the light-transmitting surface of the box-type exhibition stand based on the eye position and facial orientation of the presenter; A second determining unit, configured to determine a display area on the light-transmitting surface of the box-type exhibition stand based on the positions of the intersections, wherein the display area at least includes all the intersections; A third determining unit, configured to determine a distance and an angle between the light emitting element and the display area based on the display area; The control unit is used to turn on the light-emitting element on the outer surface of the exhibition object based on the determined distance and angle, so that the light-emitting element emits light at a set angle and intensity, and adjust the color of the emitted light of the light-emitting element so that the color of the emitted light matches the original color of the outer surface of the exhibition object.

8. The device according to claim 7, characterized in that A light-emitting element is provided on the set component in the exhibition object, and a light-emitting control circuit of the light-emitting element is electrically connected to the control unit; a projection hole is provided on the side of the exhibition object near the light-transmitting surface, or a projection hole is provided at the bottom of the exhibition object; a reflector or a reflector group is provided on the light path of the projection hole, so that the light path of the projection hole can be reflected toward the display area; the control unit is further used to: In response to the display instruction of the set component, the light-emitting element on the outer surface of the exhibition object is controlled to be turned off, the light-emitting element on the set component is turned on, the emission angle of the light-emitting element is controlled so that the emitted light of the light-emitting element penetrates the projection hole and is emitted to the display area through a reflector or a reflector group, and the color of the emitted light of the light-emitting element is adjusted so that the color of the reflected light matches the original color of the outer surface of the set component.

9. The device according to claim 7, characterized in that The first determining unit is further configured to: In response to changes in the number of presenters in the image, or changes in information about the position of the intersection between the presenters' sight lines and the light-transmitting surface of the box-type exhibition stand, the display area is redetermined on the light-transmitting surface based on the intersection position, and the distance and angle between the light-emitting element and the display area are redetermined, triggering the control unit to adjust the output light angle of the light-emitting element.

10. The device according to claim 7, characterized in that The box-type exhibition stand is provided with a posture adjustment structure, and the exhibition object is arranged on the posture adjustment structure; the first determination unit is further used for: In response to the posture adjustment structure driving the exhibition object to change its posture, the position of the exhibition object in the set coordinate system is recalibrated, and the relative distance and relative angle between the light-emitting element on the exhibition object and the light-transmitting surface are determined; as well as The relative position relationship between the light emitting element on the exhibition object and the projection hole is determined.

Images