Display component presentation method and device based on human-computer interaction

Abstract

The invention discloses a display component presentation method and device based on human-computer interaction. The method comprises the steps that image information of a display position is collected, a display object is recognized based on the image information, and a recognition result is obtained; presenting a structure image of the display object on a display unit based on the identification result; touch operations for the display object are detected, and region division is carried out on different touch operations; determining areas to which different touch operations belong according to the operation positions of the touch operations, and determining touch effective areas for the different touch operations; and in response to the corresponding position of the touch effective area on the display object, outputting an internal decomposition structure image of the display object corresponding to the touch effective area on different display units. According to the invention, the experience effect of visitors is improved, and the exhibition display effect is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to display technology of display objects, and more particularly to a display component presentation method and device based on human-computer interaction. Background Art

[0002] The main significance of exhibitions is to promote exchanges, display the quality and characteristics of the exhibition objects, etc., in order to promote better exchanges and communication. At present, the display of products is generally based on video introduction, that is, the exhibits are explained to visitors through language analysis and video display. However, although this video introduction method can actively output the performance of the exhibits to visitors, it only displays language analysis and cannot reflect the interests of visitors. That is, although the video analysis is continuously output, it is not the content of interest to the visitors, and it is likely that it will not be accepted by the visitors, which greatly reduces the effect of the exhibition. In particular, the presentation of the product structure, its explanation is only the output of its characteristics, etc., and its structure itself or structural details cannot be actively displayed to visitors. Even if visitors are interested in a part of the product, they cannot actively obtain the corresponding structural details, but can only accept its product introduction through video or explanation, resulting in poor exhibition effect.

[0003] The current exhibition display method obviously cannot satisfy visitors to obtain the corresponding exhibit content according to their own wishes, nor can it obtain personalized content presentation for products. Summary of the invention

[0004] In view of this, an embodiment of the present application provides a display component presentation method and device based on human-computer interaction, which can provide different display contents to different visitors through user operations, and can adjust the display content of the display object according to the real-time dynamics of the visitors to meet the viewing needs of different visitors for product structure details.

[0005] According to a first aspect of an embodiment of the present application, a display component presentation method based on human-computer interaction is provided, comprising:

[0006] Collect image information of the display location, identify the display object based on the image information, and obtain an identification result;

[0007] presenting a structural image of the display object on a display unit based on the recognition result;

[0008] Detect touch operations on display objects and divide areas for different touch operations;

[0009] Determine the regions to which different touch operations belong according to the operation positions of the touch operations, and determine the touch effective regions for the different touch operations;

[0010] In response to the corresponding position of the touch effective area on the display object, an internal decomposition structure image of the display object corresponding to the touch effective area is output on different display units.

[0011] In some exemplary embodiments, the method further comprises:

[0012] Acquire image data of the display object, and draw multi-angle sectional structural images of the display object, as well as decomposed structural images of the display object, structural images of each component, and decomposed structures or multi-angle sectional structural images of related components;

[0013] Set corresponding presentation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object, and record the correspondence between the instructions and the corresponding presentation images; and set rotation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object.

[0014] In some exemplary embodiments, the method further comprises:

[0015] Collecting a first operation gesture in a set area, and recognizing the operation gesture as a first operation instruction;

[0016] In response to the first operation instruction, a local component or a local area in the internal decomposition structure image is enlarged.

[0017] In some exemplary embodiments, the method further comprises:

[0018] Collecting a second operation gesture in a set area, and recognizing the operation gesture as a second operation instruction;

[0019] In response to the second operation instruction, the local component or local area in the internal decomposition structure image is reduced.

[0020] In some exemplary embodiments, the method further comprises:

[0021] Collecting a third operation gesture in the set area, and recognizing the operation gesture as a third operation instruction;

[0022] In response to the third operation instruction, the local component or the local area in the internal decomposition structure image is rotated to show different postures of the local component or the local area.

[0023] According to a second aspect of an embodiment of the present application, a display component presentation device based on human-computer interaction is provided, comprising:

[0024] A first recognition unit is used to collect image information of the display location, recognize the display object based on the image information, and obtain a recognition result;

[0025] A display unit, used for presenting a structural image of the display object on a display unit based on the recognition result;

[0026] A detection unit, used to detect touch operations on the display object and divide areas for different touch operations;

[0027] A determination unit, configured to determine regions to which different touch operations belong according to operation positions of the touch operations, and to determine touch effective regions for different touch operations;

[0028] The output unit is used to output the internal decomposition structure image of the display object corresponding to the touch effective area on different display units in response to the corresponding position of the touch effective area on the display object.

[0029] In some exemplary embodiments, the apparatus further comprises:

[0030] A production unit, used to obtain image data of a display object, and draw a multi-angle cross-sectional structural image of the display object, as well as a decomposed structural image of the display object, a structural image of each component, and a decomposed structure or multi-angle cross-sectional structural image of a related component;

[0031] A setting unit is used to set corresponding presentation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object, and record the correspondence between the instructions and the corresponding presentation images; and to set rotation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object.

[0032] In some exemplary embodiments, the apparatus further comprises:

[0033] A second recognition unit, used for collecting a first operation gesture in a set area, and recognizing the operation gesture as a first operation instruction;

[0034] The display unit is further configured to amplify a local component or a local area in the internal decomposition structure image in response to the first operation instruction.

[0035] In some exemplary embodiments, the apparatus further comprises:

[0036] A third recognition unit, used for collecting a second operation gesture in a set area, and recognizing the operation gesture as a second operation instruction;

[0037] The display unit is further configured to reduce a local component or a local area in the internal decomposition structure image in response to the second operation instruction.

[0038] In some exemplary embodiments, the apparatus further comprises:

[0039] A fourth recognition unit, used for collecting a third operation gesture in a set area, and recognizing the operation gesture as a third operation instruction;

[0040] The display unit is further configured to rotate the local component or local area in the internal decomposition structure image in response to the third operation instruction to display different postures of the local component or local area.

[0041] According to a third aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the display component presentation method based on human-computer interaction are implemented.

[0042] According to a fourth aspect of an embodiment of the present application, there is provided an electronic device, including:

[0043] at least one processor; and

[0044] a memory communicatively connected to the at least one processor; wherein,

[0045] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the display component presentation method based on human-computer interaction.

[0046] The technical solution of the embodiment of the present application sets corresponding display images for display objects, and outputs corresponding display images on different display units according to the corresponding operations of visitors. When visitors participate deeply, the technical solution provides them with relevant structural details of the display objects they are interested in, which meets the basic needs of human-computer interaction and motivates visitors to participate deeply. The embodiment of the present application improves the display effect of the display objects by setting detailed display structure images of the display objects, enriches the exhibition display methods, and improves the display effect. The embodiment of the present application improves the experience effect of visitors and improves the exhibition display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 A schematic diagram showing a flow chart of a display component presentation method based on human-computer interaction according to an embodiment of the present application is shown;

[0049] Figure 2 A schematic diagram showing the composition structure of a display component presentation device based on human-computer interaction according to an embodiment of the present application is shown;

[0050] Figure 3 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0052] The essence of the technical solution of the embodiment of the present application is explained in detail below with reference to the accompanying drawings.

[0053] Figure 1 A flow chart of a method for presenting a display component based on human-computer interaction according to an embodiment of the present application is shown. Figure 1 As shown, the display component presentation method based on human-computer interaction of the embodiment of the present application includes the following steps:

[0054] Step 101 : collect image information of the display location, identify the display object based on the image information, and obtain a recognition result.

[0055] The display object of the embodiment of the present application can be any product to be displayed, such as vehicle engines and locomotive parts. The display product generally has a complex structure and needs to be analyzed for its internal structure to fully display the detailed structure of the product to be displayed to the visitors, so as to meet the visitors' requirements for the presentation of the structure of the display product and its details.

[0056] In an embodiment of the present application, firstly, an image is captured of an object to be displayed located at a booth or at a set display position to identify the display object. The booth or display position can display different display objects as needed. In an embodiment of the present application, object recognition is first performed on the items at the booth or display position to determine their identities, so that when visitors learn about the display objects in detail, the details of their structure and its structural composition can be displayed in real time on the display unit. Specifically, through image capture, the display object is identified as an engine, a brake system, a cooling system, etc., and after its identity is identified, the structural detail image related to the display object or the structural image of its component components is displayed to the visitor when the visitor performs human-computer interaction.

[0057] In the embodiment of the present application, the Yolo neural network is used to perform object detection on the collected image to determine what kind of object it is. As an example, the Yolo network structure can use yolov8 to identify the object to be displayed in the image. Specifically, the feature information in the image is extracted through the backbone network (Backbone), and the feature information is convolved to obtain the local feature information in the image; the local feature information is normalized to reduce the covariate shift of the local feature information; the normalized local feature information is input into the activation function to determine the display object in the image. Among them, Backbone uses a series of convolution and deconvolution layers to extract features, and uses residual connections and bottleneck structures to reduce the size of the network and improve performance. The C2f module is used to extract feature information, which improves the ability to enhance feature information. And the multi-scale feature fusion technology is used to fuse the feature maps from different stages of Backbone to enhance the feature representation capability.

[0058] The aforementioned object recognition is only an example. For example, a depth camera or the like may be used to capture images of the displayed objects and perform object recognition to determine the specific object.

[0059] In the embodiment of the present application, the image data of the display object needs to be determined in advance and stored in the exhibition system, that is, first determine the display objects that need to be exhibited, such as vehicle engines, vehicle cooling systems, vehicle parking systems, etc., and collect the structural images of the objects in different positions according to the physical objects to be displayed, or draw the structures of the objects in different positions according to the physical objects. As an example, the three-dimensional image can be drawn by three-dimensional object drawing software to present the specific structure of the objects at different display angles. In the embodiment of the present application, it is necessary not only to display the appearance image of the display object, but also to display the internal structure of the display object, especially the core internal structure. Therefore, in the embodiment of the present application, it is necessary to obtain the image data of the display object, and draw the multi-angle sectional structural image of the display object, as well as the decomposed structural image of the display object, the structural image of each component, and the decomposed structure or multi-angle sectional structural image of the related components. Set corresponding presentation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object, and record the correspondence between the instructions and the corresponding presentation images; and set rotation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object.

[0060] Step 102: presenting a structural image of the display object on a display unit based on the recognition result.

[0061] In the embodiment of the present application, after the display object is determined, the overall structural image of the display object is displayed. The overall structural image of the display object can respond to the operation gestures of the visitor, such as a click gesture, a double-click gesture, an OK gesture, etc., to flip the overall structural image of the display object to display its structural image in different postures.

[0062] In an embodiment of the present application, the operating gestures of the visitors can be determined through images captured by the acquisition unit, such as capturing images of the visitors to obtain their image frame video data, identifying the visitors in the image frames based on each image frame in the video data, and then identifying their gestures, and based on the changes in their gestures, identifying the corresponding gestures as corresponding instructions such as rotation instructions, and in response to the rotation instructions, rotating the overall structural image of the display object to display the specific structure of the display object in different postures.

[0063] As an example, the Yolo network structure can be used to recognize the operation gestures of visitors.

[0064] Step 103: Detect touch operations on the display object and divide areas for different touch operations.

[0065] In an embodiment of the present application, a three-dimensional structural diagram of a display object is output on a display unit by automatically identifying the display object. As an implementation method, multiple display units can be set around the booth to present relevant structural images of the display object. For example, four displays can be set around the booth to display images of the display object to visitors in different directions. After the display object is identified, three-dimensional structural diagrams of the display object at different angles can be output on different display units to display the display object to visitors in different directions.

[0066] Step 104: Determine areas to which different touch operations belong according to the operation positions of the touch operations, and determine touch effective areas for the different touch operations.

[0067] In an embodiment of the present application, a display object located at a booth or display location can directly face visitors, and the visitors can touch the display object. According to different touch directions, the display system of the embodiment of the present application can display different structural images of the display object on different display units.

[0068] In an embodiment of the present application, corresponding sensors such as capacitive sensors can be set on the display object to detect the touch area and touch position of the visitor on the display object to determine which parts of the display object the visitor is interested in, or determine which parts of the display object the visitor needs to display structural details of.

[0069] In an embodiment of the present application, the display object can be divided into areas according to the number of display units to determine which areas are touched by the visitor, to determine which display unit should respond to the structural details of the display object, and which part of the structural details of the display object should be presented to the visitor.

[0070] Due to the large number of visitors, there may be multiple touches on different areas. In this case, the number of touches and corresponding positions within the set area of ​​the display object can be counted, and a sub-area with the largest number of touches can be used as the valid area. Alternatively, based on the touch detection time, the area that is touched first can be used as the valid area.

[0071] For display objects that cannot be touched by visitors, a shield can be provided to detect touches on the display objects, that is, a sensor is provided on the shield to detect simulated touches on the display objects, which is used as a basis for confirming the substructures of the display objects that visitors are interested in, thereby determining the touch area of ​​the visitors, and presenting the corresponding substructures of the display objects on the display unit. As an implementation method, the shield can also be provided as a touch screen, and the touch detection of the display objects by visitors is determined by the touch screen, so that the structural details of the display objects are displayed on the display unit.

[0072] In the embodiment of the present application, the touch detection of the visitor on the display object can also be carried out through image acquisition to determine the touch of the visitor on the display object, that is, by acquiring images of the visitor, obtaining their video data, performing object recognition on the video frames, and determining their touch on the display object, determining their touch position and the order of touch, etc., so as to determine the effective touch area for the display object.

[0073] As an example, the Yolo network structure can be used to identify the touch operations of visitors and determine their effective touch areas.

[0074] Step 105 : in response to the corresponding position of the touch effective area on the display object, outputting the internal decomposition structure image of the display object corresponding to the touch effective area on different display units.

[0075] In the embodiment of the present application, after the effective touch area is determined, the part of the display object that the visitor is interested in can be determined according to the effective touch area, which can be used as the display demand of the structural details of the display object, so that the internal decomposition structure image of the corresponding display object can be presented on different display units according to the effective touch area. For example, a cross-sectional image of a certain part of the display object can be displayed, or a decomposition structure image of a certain component of the display object can be displayed.

[0076] In the embodiment of the present application, after the cross-section or decomposed structure image of the display object is displayed by the display unit, the visitor can further input the display requirements for the display image, such as through some operation gestures, to further present its display details. Or through some operation gestures, the local parts or local parts of the display object of interest can be enlarged or reduced.

[0077] As an implementation method, a first operation gesture in a set area is collected, and the operation gesture is recognized as a first operation instruction; in response to the first operation instruction, a local component or a local area in the internal decomposition structure image is enlarged. The first operation gesture may be a visitor making two reciprocating movements in a set direction with an outstretched palm. The first operation gesture may be demonstrated to visitors at the visiting place to help visitors understand the structural details of the displayed object. The embodiment of the present application does not limit the specific action of the first operation gesture. For example, it may also be a visitor performing a rotation gesture with an "OK" gesture as an instruction to enlarge the display object in the display unit. When the corresponding gesture of the visitor is detected, the display object is enlarged in the display unit.

[0078] The set area here can be clearly indicated by lighting methods, etc., to prompt visitors to input gestures.

[0079] As an implementation method, a second operation gesture of a set area is collected, and the operation gesture is recognized as a second operation instruction; in response to the second operation instruction, a local component or a local area in the internal decomposition structure image is reduced. Here, the second operation gesture can be a gesture of extending a finger and drawing a circle in the air. For example, a visitor can extend one of his fingers and draw a circle in the air, which can be used as an instruction to reduce the local component or local area of ​​the current display object, so as to reduce the current display image.

[0080] As an implementation method, a third operation gesture of a set area is collected, and the operation gesture is recognized as a third operation instruction; in response to the third operation instruction, a local component or a local area in the internal decomposition structure image is rotated to show different postures of the local component or the local area. Here, the third operation gesture can be a high-five gesture, and the visitor high-fives with both hands, such as high-five once as an operation instruction to rotate in the horizontal direction, high-five twice as an operation instruction to rotate in the vertical direction, high-five three times as an operation instruction to rotate along a certain set angle, etc.

[0081] The embodiment of the present application does not limit the correspondence between the operation gestures and their operation instructions.

[0082] The embodiment of the present application sets corresponding display images for display objects, and outputs corresponding display images on different display units according to the corresponding operations of visitors. When visitors participate deeply, relevant structural details of the display objects of interest are provided to them, which meets the basic needs of human-computer interaction and also mobilizes the enthusiasm of visitors to participate deeply. The embodiment of the present application improves the display effect of the display objects by setting detailed display structure images of the display objects, enriches the exhibition display methods, and improves the display effect.

[0083] Figure 2 FIG. 1 is a schematic diagram of the structure of a display component presentation device based on human-computer interaction according to an embodiment of the present application. Figure 2 As shown, the display component presentation device based on human-computer interaction in the embodiment of the present application includes:

[0084] The first recognition unit 20 is used to collect image information of the display location, recognize the display object based on the image information, and obtain a recognition result;

[0085] A display unit 21, used for presenting a structural image of a display object on a display unit based on the recognition result;

[0086] A detection unit 22, used to detect touch operations on the display object and divide areas for different touch operations;

[0087] A determination unit 23, configured to determine the regions to which different touch operations belong according to the operation positions of the touch operations, and to determine touch effective regions for the different touch operations;

[0088] The output unit 24 is used to output the internal decomposition structure image of the display object corresponding to the touch effective area on different display units in response to the corresponding position of the touch effective area on the display object.

[0089] exist Figure 2 Based on the display component presentation device based on human-computer interaction shown, the device also includes:

[0090] Production Unit( Figure 2 (not shown in the figure), used to obtain image data of the display object, and draw a multi-angle cross-sectional structure image of the display object, as well as a decomposed structure image of the display object, a structure image of each component, and a decomposed structure or multi-angle cross-sectional structure image of related components;

[0091] Set the unit ( Figure 2 (not shown in the figure), used to set corresponding presentation instructions for the sectional structure image, decomposed structure image, structure image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object, and record the correspondence between the instructions and the corresponding presentation images; and to set rotation instructions for the sectional structure image, decomposed structure image, structure image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object.

[0092] exist Figure 2 Based on the display component presentation device based on human-computer interaction shown, the device also includes:

[0093] The second identification unit ( Figure 2 (not shown) for collecting a first operation gesture in a set area and identifying the operation gesture as a first operation instruction;

[0094] The display unit 21 is further configured to enlarge a local component or a local area in the internal decomposition structure image in response to the first operation instruction.

[0095] exist Figure 2 Based on the display component presentation device based on human-computer interaction shown, the device also includes:

[0096] The third identification unit ( Figure 2 (not shown) for collecting a second operation gesture in a set area and identifying the operation gesture as a second operation instruction;

[0097] The display unit 21 is further configured to reduce a local component or a local area in the internal decomposition structure image in response to the second operation instruction.

[0098] exist Figure 2 Based on the display component presentation device based on human-computer interaction shown, the device also includes:

[0099] The fourth identification unit ( Figure 2 (not shown) for collecting a third operation gesture in a set area and identifying the operation gesture as a third operation instruction;

[0100] The display unit 21 is further configured to rotate the local component or local area in the internal decomposition structure image in response to the third operation instruction to display different postures of the local component or local area.

[0101] In an exemplary embodiment, the aforementioned units and the like may be implemented by one or more central processing units (CPU), graphics processing units (GPU), application specific integrated circuits (ASIC), DSPs, programmable logic devices (PLD), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components.

[0102] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0103] Figure 3 Schematic diagram of the structure of the electronic device according to the embodiment of the present application. Figure 3 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0104] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0105] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0106] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0107] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0108] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0109] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0110] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0111] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0112] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the steps of the display component presentation method based on human-computer interaction of the above-mentioned embodiment.

[0113] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to complete the steps of the display component presentation method based on human-computer interaction of the above embodiment. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0114] The embodiment of the present application also records a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the display component presentation method based on human-computer interaction of the embodiment are implemented.

[0115] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0116] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0117] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or do not exist.

[0118] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0119] The above is only an embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A display component presentation method based on human-computer interaction, characterized in that: The method comprises: Collect image information of the display location, identify the display object based on the image information, and obtain an identification result; presenting a structural image of the display object on a display unit based on the recognition result; Detect touch operations on display objects and divide areas for different touch operations; Determine the regions to which different touch operations belong according to the operation positions of the touch operations, and determine the touch effective areas for the different touch operations; In response to the corresponding position of the touch effective area on the display object, an internal decomposition structure image of the display object corresponding to the touch effective area is output on different display units.

2. The method according to claim 1, characterized in that The method further comprises: Acquire image data of the display object, and draw multi-angle sectional structural images of the display object, as well as decomposed structural images of the display object, structural images of each component, and decomposed structures or multi-angle sectional structural images of related components; Set corresponding presentation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object, and record the correspondence between the instructions and the corresponding presentation images; and set rotation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object.

3. The method according to claim 2, characterized in that The method further comprises: Collecting a first operation gesture in a set area, and recognizing the operation gesture as a first operation instruction; In response to the first operation instruction, a local component or a local area in the internal decomposition structure image is enlarged.

4. The method according to claim 3, characterized in that The method further comprises: Collecting a second operation gesture in a set area, and recognizing the operation gesture as a second operation instruction; In response to the second operation instruction, the local component or local area in the internal decomposition structure image is reduced.

5. The method according to claim 3 or 4, characterized in that: The method further comprises: Collecting a third operation gesture in the set area, and recognizing the operation gesture as a third operation instruction; In response to the third operation instruction, the local component or the local area in the internal decomposition structure image is rotated to show different postures of the local component or the local area.

6. A display component presentation device based on human-computer interaction, characterized in that: The device comprises: A first recognition unit is used to collect image information of the display location, recognize the display object based on the image information, and obtain a recognition result; A display unit, used for presenting a structural image of the display object on a display unit based on the recognition result; A detection unit, used to detect touch operations on the display object and divide areas for different touch operations; A determination unit, configured to determine regions to which different touch operations belong according to operation positions of the touch operations, and to determine touch effective regions for different touch operations; The output unit is used to output the internal decomposition structure image of the display object corresponding to the touch effective area on different display units in response to the corresponding position of the touch effective area on the display object.

7. The device according to claim 6, characterized in that The device also includes: A production unit, used to obtain image data of a display object, and draw a multi-angle cross-sectional structural image of the display object, as well as a decomposed structural image of the display object, a structural image of each component, and a decomposed structure or multi-angle cross-sectional structural image of a related component; A setting unit is used to set corresponding presentation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object, and record the correspondence between the instructions and the corresponding presentation images; and to set rotation instructions for the sectional structure image, decomposed structure image, structural image of a component, decomposed structure of related components or multi-angle sectional structure image of the display object.

8. The device according to claim 7, characterized in that The device also includes: A second recognition unit, used for collecting a first operation gesture in a set area, and recognizing the operation gesture as a first operation instruction; The display unit is further configured to amplify a local component or a local area in the internal decomposition structure image in response to the first operation instruction.

9. The device according to claim 8, characterized in that The device also includes: A third recognition unit, used for collecting a second operation gesture in a set area, and recognizing the operation gesture as a second operation instruction; The display unit is further configured to reduce a local component or a local area in the internal decomposition structure image in response to the second operation instruction.

10. The device according to claim 8 or 9, characterized in that The device also includes: A fourth recognition unit, used for collecting a third operation gesture in a set area, and recognizing the operation gesture as a third operation instruction; The display unit is further configured to rotate the local component or local area in the internal decomposition structure image in response to the third operation instruction to display different postures of the local component or local area.

Images