Exhibition hall service methods, devices, equipment and storage media
By using digital humans to interact with visitors and jump to display screens for explanations in the digital exhibition hall, combined with mobile robots and motion capture technology, the problem of time-consuming and labor-intensive memorization of content by tour guides has been solved, and automated and efficient exhibition hall services have been achieved.
Patent Information
- Application Number
- CN202310639785.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-31
- Publication Date
- 2026-01-30
- Estimated Expiration
- 2043-05-31
AI Technical Summary
In digital exhibition halls, guides need to memorize a large amount of content, which makes the exhibition hall service time-consuming and labor-intensive, making it difficult to reduce costs and increase efficiency.
By displaying digital humans on screens in the exhibition hall and controlling these digital humans to issue interactive invitations, visitors can jump to different screens based on their interaction information and receive product explanations. This, combined with mobile robots and motion capture technology, enables automated exhibition hall services.
It has achieved highly efficient exhibition hall explanations without human intervention, improved the visitor experience and service effectiveness, and achieved the goal of reducing costs and increasing efficiency.
Smart Images

Figure CN116682325B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of digital human, in particular to a hall service method, device, equipment and storage medium. BACKGROUND
[0002] At present, various science and technology parks will set up digital halls to show the science and technology strength of the park to the visitors. Among them, the digital hall generally has a display screen, which is used to display cockpit data including pictures, videos and digital data of the products displayed in the hall. In the digital hall, a plurality of interpreters are generally configured to serve the visitors, and the interpreters explain based on the displayed cockpit data. In this way, the interpreters need to recite a large amount of content in advance, which is time-consuming and laborious, and it is difficult to realize the real "cost reduction and efficiency increase" of the hall service. SUMMARY
[0003] The present application provides a hall service method, device, equipment and storage medium, which truly realizes the cost reduction and efficiency increase of the hall service. The technical solution is as follows:
[0004] On the one hand, a hall service method is provided, and the method comprises:
[0005] displaying a digital human on a first display screen of a hall, wherein the hall displays a plurality of products, the first display screen is any display screen of a plurality of display screens of the hall, and the plurality of display screens are used to display different product data of the plurality of products;
[0006] controlling the digital human displayed on the first display screen to issue an interaction invitation, wherein the interaction invitation is used to invite a visitor to interact based on the plurality of products;
[0007] in response to receiving interaction information fed back based on the interaction invitation, determining target product data pointed by the interaction information from product data respectively displayed on a plurality of display screens;
[0008] based on the target product data and at least one display screen where the target product data is located, controlling the digital human to display between the at least one display screen, and controlling the digital human to issue guide information and product explanation based on the target product data, wherein the guide information is used to guide to watch the at least one display screen.
[0009] In some embodiments, based on the target product data and at least one display screen where the target product data is located, controlling the digital human to display between the at least one display screen, and controlling the digital human to issue guide information and product explanation based on the target product data, comprises:
[0010] determine a display order of the digital human on the at least one display screen based on a narration order of the product data respectively displayed by the at least one display screen in the target product data;
[0011] In the narration process, in response to reaching the display order of the second display screen, control the digital human to issue guide information for guiding to watch the second display screen and jump to display on the second display screen, and perform product narration based on the product data displayed on the second display screen, the second display screen being any one of the at least one display screen.
[0012] In some embodiments, the control of the digital human to issue the guide information for guiding to watch the second display screen comprises:
[0013] Control the digital human displayed on the third display screen to issue the guide information for guiding to watch the second display screen, the guide information indicating a path moving from a viewing position of the third display screen to a viewing position of the second display screen, the third display screen being a display screen on which the digital human is located before jumping to the second display screen.
[0014] In some embodiments, the method further comprises at least one of:
[0015] projecting the digital human in a holographic manner at the viewing position of the third display screen, and controlling the digital human to move along the path to the viewing position of the second display screen to guide the visitor to follow the digital human to reach the viewing position of the second display screen; or,
[0016] projecting a light ray on the path to guide the visitor to reach the viewing position of the second display screen along the projected light ray; or,
[0017] displaying the path on the third display screen.
[0018] In some embodiments, the plurality of display screens respectively display digital humans thereon, and the process of controlling the digital human to jump to display on the second display screen comprises:
[0019] controlling the digital human displayed on the third display screen to jump to the second display screen and interact with the digital human displayed on the second display screen to realize handover between the digital human displayed on the third display screen and the digital human displayed on the second display screen, the third display screen being a display screen on which the digital human is located before jumping to the second display screen;
[0020] controlling the digital human displayed on the second display screen to perform product narration based on the product data displayed on the second display screen.
[0021] In some embodiments, the product explanation based on the target product data comprises:
[0022] If the interaction information is used to request to obtain statistical data of a preset product in a preset dimension, the statistical data of the preset product in the preset dimension is obtained based on the interaction information, the digital human displayed on the at least one display screen is controlled to perform product explanation based on the statistical data, and the statistical data is displayed on the at least one display screen.
[0023] In some embodiments, the product explanation based on the target product data comprises:
[0024] If the interaction information is first type information, the digital human is displayed on the at least one display screen using a first product based on the first product indicated by the interaction information and the target product data, and the digital human is controlled to explain the use process, the first type information being information indicating a demonstration of a product use process;
[0025] If the interaction information is second type information, the digital human is displayed on the at least one display screen disassembling a second product and showing the internal structure of the disassembled second product based on the second product indicated by the interaction information and the target product data, and the digital human is controlled to explain the disassembling process and the internal structure, the second type information being information indicating a demonstration of a product internal structure.
[0026] In some embodiments, the method further comprises:
[0027] In response to receiving the service demand information issued by the visitor object, an instruction is issued to a mobile robot in the exhibition hall based on the service demand information, the instruction being used to instruct the mobile robot to provide service for the visitor object based on the service demand information.
[0028] In some embodiments, if the service demand information is used to indicate to obtain an article, the instruction is used to instruct the mobile robot to deliver the article for the visitor object;
[0029] If the service demand information is used to indicate to reach a preset position in the exhibition hall, the instruction is used to instruct the mobile robot to guide the visitor object.
[0030] In some embodiments, the method further comprises:
[0031] If the service demand information is used to indicate to obtain an article, the position of the visitor object and the mobile robot in the exhibition hall is displayed on the first display screen during the service provided by the mobile robot for the visitor object.
[0032] In some embodiments, the method further comprises:
[0033] acquiring, by a motion capture camera, the action and expression of the visitor object;
[0034] controlling the digital human to interact with the visitor object in the action and expression of the visitor object during the explanation.
[0035] In another aspect, a hall service apparatus is provided, the apparatus comprising:
[0036] a display module configured to display a digital human on a first display screen of a hall, the hall having a plurality of products displayed therein, the first display screen being any of a plurality of display screens of the hall, the plurality of display screens being configured to display different product data of the plurality of products;
[0037] an interaction module configured to control the digital human displayed on the first display screen to issue an interaction invitation, the interaction invitation being configured to invite a visitor object to interact based on the plurality of products;
[0038] a determination module configured to determine, in response to receiving interaction information fed back based on the interaction invitation, target product data pointed to by the interaction information from product data respectively displayed by the plurality of display screens;
[0039] an explanation module configured to control the digital human to display between at least one display screen based on the target product data and the at least one display screen on which the target product data is located, and to control the digital human to issue guide information for guiding viewing of the at least one display screen and to give a product explanation based on the target product data.
[0040] In some embodiments, the explanation module is configured to:
[0041] determine a display order of the digital human on the at least one display screen based on an explanation order of product data respectively displayed by the at least one display screen in the target product data;
[0042] during the explanation, in response to reaching a display order of a second display screen, which is any of the at least one display screen, control the digital human to issue guide information for guiding viewing of the second display screen and to display on the second display screen, and to give a product explanation based on product data on the second display screen.
[0043] In some embodiments, the guide module is configured to control the digital human displayed on the third display screen to issue the guide information for guiding the viewing of the second display screen, the guide information indicating a path for moving from a viewing position of the third display screen to a viewing position of the second display screen, the third display screen being a display screen on which the digital human is located before jumping to the second display screen.
[0044] In some embodiments, the device further comprises a path guide module configured to implement at least one of:
[0045] projecting the digital human hologram at the viewing position of the third display screen, and controlling the digital human to move along the path to the viewing position of the second display screen to guide the visitor to follow the digital human to the viewing position of the second display screen; or
[0046] projecting a light ray on the path to guide the visitor to follow the projected light ray to the viewing position of the second display screen; or
[0047] displaying the path on the third display screen.
[0048] In some embodiments, the plurality of display screens respectively display digital humans, and the guide module is configured to:
[0049] control the digital human displayed on the third display screen to jump to the second display screen and interact with the digital human displayed on the second display screen to implement handover between the digital human displayed on the third display screen and the digital human displayed on the second display screen, the third display screen being a display screen on which the digital human is located before jumping to the second display screen;
[0050] control the digital human displayed on the second display screen to perform product explanation based on product data displayed on the second display screen.
[0051] In some embodiments, the guide module is configured to, if the interaction information is used to request to obtain statistical data of a preset product in a preset dimension, obtain the statistical data of the preset product in the preset dimension based on the interaction information, control the digital human displayed on the at least one display screen to perform product explanation based on the statistical data, and display the statistical data on the at least one display screen.
[0052] In some embodiments, the guide module is configured to, if the interaction information is first type information, display the digital human using a first product based on the first product and the target product data indicated by the interaction information on the at least one display screen, and control the digital human to perform explanation on the use process, the first type information being information indicating demonstration of a product use process.
[0053] If the interaction information is second type information, based on the second product indicated by the interaction information and the target product data, the digital human is displayed on the at least one display screen to disassemble the second product and show the internal structure of the disassembled second product, and the digital human is controlled to explain the disassembly process and the internal structure, and the second type information is information indicating to show the internal structure of the product.
[0054] In some embodiments, the apparatus further includes:
[0055] An instruction module is configured to, in response to receiving the service demand information issued by the visitor, issue an instruction to a mobile robot in the exhibition hall based on the service demand information, the instruction being used to instruct the mobile robot to provide service for the visitor based on the service demand information.
[0056] In some embodiments, if the service demand information is used to indicate to obtain an article, the instruction is used to instruct the mobile robot to deliver the article for the visitor;
[0057] If the service demand information is used to indicate to reach a preset position in the exhibition hall, the instruction is used to instruct the mobile robot to guide the visitor.
[0058] In some embodiments, the apparatus further includes:
[0059] A position display module is configured to, if the service demand information is used to indicate to obtain an article, display the positions of the visitor and the mobile robot in the exhibition hall on the first display screen during the service provided by the mobile robot for the visitor.
[0060] In some embodiments, the apparatus further includes:
[0061] An acquisition module is configured to acquire actions and expressions of a visitor through a motion capture camera.
[0062] An interaction module is configured to, during the explanation, control the digital human to interact with the visitor in the actions and expressions of the visitor.
[0063] In another aspect, a control device is provided, which includes one or more processors and one or more memories, the one or more memories storing at least one program code, the at least one program code being loaded and executed by the one or more processors to implement the exhibition service method of any of the above implementation manners.
[0064] In another aspect, a computer-readable storage medium is provided, the computer-readable storage medium having stored therein at least one program code, the at least one program code being loaded and executed by a processor to implement the exhibition hall service method according to any of the above implementation manners.
[0065] In another aspect, a computer program product is provided, the computer program product comprising computer program code stored in a computer-readable storage medium, a processor of a control device reading the computer program code from the computer-readable storage medium, the processor executing the computer program code to cause the control device to perform the exhibition hall service method according to any of the above implementation manners.
[0066] The exhibition hall service method provided by the embodiments of the present application can realize sufficient product explanation by the digital person through multi-screen linkage, and can guide the visiting object to follow the jumping display of the digital person and jump to watch the display screen, thereby improving the watching experience of the visiting object. The method does not need manual participation, improves the service effect while realizing the exhibition hall explanation service, and truly realizes cost reduction and benefit increase of the exhibition hall service. BRIEF DESCRIPTION OF DRAWINGS
[0067] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.
[0068] Figure 1 is a schematic diagram of an implementation environment provided by the embodiments of the present application;
[0069] Figure 2 is a flowchart of an exhibition hall service method provided by the embodiments of the present application;
[0070] Figure 3 is a flowchart of another exhibition hall service method provided by the embodiments of the present application;
[0071] Figure 4 is a block diagram of an exhibition hall service device provided by the embodiments of the present application;
[0072] Figure 5 is a block diagram of a control device provided by the embodiments of the present application. DETAILED DESCRIPTION
[0073] For the purposes of the present application, the technical solutions and advantages will be more apparent from the following detailed description of the embodiments of the present application, with reference to the accompanying drawings.
[0074] The terms "first", "second", "third", and "fourth" and the like in the description and in the claims of the present application and the drawings herein are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. The terms "include", "have", and the like should be understood as being meant to encompass the inclusion of one or more steps or units, but not excluding the inclusion of other steps or units. For example, a process, method, system, product, or apparatus that includes a list of steps or units should not be interpreted as necessarily including all of the listed steps or units, but can include only those steps or units that are specifically listed.
[0075] It should be noted that the messages (including but not limited to user device messages, user personal messages, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.), and signals involved in the present application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data need to comply with relevant laws, regulations, and standards of relevant countries and regions. For example, the interaction information and the like involved in the present application are obtained under full authorization.
[0076] The exhibition hall service method provided by the embodiments of the present application can be executed by a control device. Referring to Figure 1 , Figure 1 is a schematic diagram of an implementation environment of an exhibition hall service method provided by the embodiments of the present application, which includes an exhibition hall 10, a control device 20, and a plurality of display screens 30. The exhibition hall 10 is a product display space, and the exhibition hall 10 is provided with a plurality of display screens 30. The plurality of display screens 30 are distributed in different areas in the exhibition hall and are used to display product data of products. In addition, the exhibition hall is provided with a plurality of exhibition stands 40, and the exhibition stands 40 display products. Optionally, one exhibition stand 40 is arranged in front of one display screen 30, and the display screen 30 behind the exhibition stand 40 is used to display product data of the product displayed on the exhibition stand 40. The control device 20 is used to control the display screen 30 to display a digital person, and control the digital person displayed on the display screen 30 to interact with a visitor of the exhibition hall, and control the digital person to give a product explanation based on the product data displayed by the display screen 30.
[0077] In the embodiments of the present application, the control device 20 is a control device of the exhibition hall 10, which can control a plurality of devices in the exhibition hall 10, that is, the control device 20 can not only control the display screen 30 in the exhibition hall 10, but also can control the mobile robot, the camera, the door and window and the like in the exhibition hall 10, which is not specifically limited here. The control device 20 and the plurality of devices can be directly or indirectly connected through wired or wireless communication mode, which is not limited in the present application.
[0078] Figure 2 is a flowchart of an exhibition hall service method provided by the embodiments of the present application, and the method is executed by the control device as the execution subject, which includes the following steps.
[0079] 201, the control device displays a digital person on a first display screen in the exhibition hall, and a plurality of products are displayed in the exhibition hall, and the first display screen is any display screen of a plurality of display screens in the exhibition hall, and the plurality of display screens are used to display different product data of the plurality of products.
[0080] In the embodiments of the present application, the digital person is a digitalized person image close to human image created by using digital technology. The digital person is used to interact with the visiting object entering the exhibition hall and to explain the product based on the product data displayed on the display screen.
[0081] In the embodiments of the present application, the plurality of display screens are used to display different product data of the plurality of products, and optionally, different products are displayed on the exhibition stands in front of the plurality of display screens, and the product data displayed on each of the plurality of display screens can be the data of the product displayed on the exhibition stand, that is, the product data displayed on any two of the plurality of display screens can be the product data of two different products respectively. Optionally, the product data displayed on any two of the plurality of display screens is product data of different types of the plurality of products. For example, one display screen displays chart data of the plurality of products, and another display screen displays video data of the plurality of products. Optionally, the product data displayed on any two of the plurality of display screens is product data of the plurality of products at different stages. For example, one display screen displays data in the production process of the plurality of products, and another display screen displays data in the use process of the plurality of products. In the embodiments of the present application, the plurality of display screens are taken as an example to display product data of different products respectively.
[0082] 202, the control device controls the digital person displayed on the first display screen to issue an interaction invitation, and the interaction invitation is used to invite the visiting object to interact based on the plurality of products.
[0083] In the embodiments of the present application, the control device sends an interaction invitation to the visiting object entering the exhibition hall, which can be a voice interaction invitation sent by the digital person, or a text interaction invitation displayed on the first display screen. Further, the control device can also display the text interaction invitation on the first display screen while controlling the digital person to send the voice interaction invitation, which is not limited here. For example, the interaction invitation can be "I am digital person 123, do you need me to introduce any products?", which can be displayed in text form on the first display screen at the same time as the digital person speaks, thereby improving the effectiveness of the visiting object receiving the interaction invitation.
[0084] 203. The control device determines, from the product data respectively displayed by the plurality of display screens, target product data pointed to by the interaction information, in response to receiving the interaction information based on the interaction invitation feedback.
[0085] In the embodiments of the present application, any product can have product data in multiple dimensions, for example, multiple dimensions such as picture, video dimension, etc. The product data in multiple dimensions can be displayed on multiple display screens, and the interaction information can point to the product data in at least one dimension of at least one product, and accordingly, the target product data pointed to by the interaction information is displayed by at least one display screen.
[0086] 204. The control device controls the digital person to jump and display between at least one display screen based on the target product data and the at least one display screen where the target product data is located, and controls the digital person to send guiding information and product explanation based on the target product data, the guiding information being used to guide watching the at least one display screen.
[0087] In the embodiments of the present application, the digital person jumping and displaying can mean that the digital person disappears on the currently displayed display screen and displays on the next display screen, or means that the digital person is holographically projected in the exhibition hall, displaying the digital person moving from the current display screen to the next display screen in the exhibition hall, which is not limited here. Alternatively, the digital person jumps to display on which display screen, and product explanation is based on the product data displayed by the display screen. Alternatively, before the digital person jumps to any display screen, that is, before the digital person explains based on the product data displayed by any display screen, the digital person outputs guiding information for guiding the visiting object to watch the display screen. For example, the guiding information can be "I will introduce product A next, please watch the display screen M on the left side".
[0088] In the embodiment of the present application, the product explanation based on the product data can mean that the digital human outputs the displayed product data in the form of voice, that is, the explained content is the displayed product data, thereby improving the efficiency of explanation. Alternatively, the product explanation based on the product data can mean that the digital human takes the displayed product data as the center, combines auxiliary data that is not displayed, and outputs the displayed product data and the auxiliary data in the form of voice, that is, the explained content covers the displayed product data but is not limited to the displayed product data. In this way, the explanation range is increased while ensuring that the displayed product data is the focus of the explained content, thereby improving the explanation effect.
[0089] The embodiment of the present application provides a hall service method, which interacts with a visiting object through a digital human, and controls the digital human to jump and display on at least one display screen based on product data indicated by the visiting object, to explain the product based on the product data displayed on the at least one display screen, thereby realizing sufficient explanation of the product by the digital human through multi-screen linkage; and the digital human issues a guide information when jumping and displaying on the at least one display screen, thereby guiding the visiting object to follow the jumping and displaying of the digital human and jump and watch the display screen, improving the watching experience of the visiting object. The method does not need manual participation, improves the service effect while realizing the hall explanation service, and truly realizes cost reduction and efficiency increase of the hall service.
[0090] Figure 2 is a basic process of the hall service, and the following is based on Figure 3 to further introduce the process of the hall service. Referring to Figure 3 , Figure 3 is a flowchart of a hall service method provided by the embodiment of the present application, and a control device is the execution subject to execute the method, and the method comprises the following steps.
[0091] 301. The control device displays a digital human on a first display screen in a hall, a plurality of products are displayed in the hall, and the first display screen is any display screen of a plurality of display screens in the hall, and the plurality of display screens are used to display different product data of the plurality of products.
[0092] In the embodiment of the present application, the display position of the digital human on the first display screen can be set and changed as needed, which is not limited here. Alternatively, the first display screen has a plurality of candidate display regions for displaying the digital human, for example, the plurality of candidate display regions are respectively a left side region of the display screen and a right side region of the display screen. Correspondingly, the control device can determine distances between the current position and the plurality of candidate display regions respectively based on the current position of the visiting object, and display the digital human on the candidate display region with the smallest distance.
[0093] In some embodiments, the digital person is displayed on each of the plurality of display screens in the exhibition hall, so that the digital person displayed on any display screen interacts with the visitor object based on the digital person displayed on the display screen when the visitor object is detected to enter the viewing area of the display screen. In other embodiments, the first display screen is a display screen located at the entrance of the exhibition hall, so as to avoid the waste of resources caused by configuring a digital person for each of the plurality of display screens, and to interact with the visitor object in time based on the display screen at the entrance of the exhibition hall when the visitor object is detected to enter the exhibition hall. Accordingly, when the product data displayed on any display screen is explained, the digital person is controlled to jump to the display screen.
[0094] In some embodiments, the exhibition hall is a physical exhibition hall, that is, physical products are displayed on the exhibition stand in the exhibition hall, and product data of the products is displayed on the display screen in the exhibition hall. In other embodiments, the exhibition hall is a digital exhibition hall, and accordingly, the product data displayed on the plurality of display screens is cockpit data of the products, including but not limited to product pictures, videos, texts, three-dimensional virtual products and the like, and optionally, three-dimensional virtual products can also be displayed on the exhibition stand in the exhibition hall. In other embodiments, the exhibition hall is a combination of a digital exhibition hall and a physical exhibition hall, that is, the plurality of display screens display cockpit data of the products, and the exhibition stand displays physical products. In the embodiments of the present application, the exhibition hall is taken as an example of a combination of a digital exhibition hall and a physical exhibition hall.
[0095] In some embodiments, the control device controls the digital person to interact with the visitor object based on generative AI (Artificial Intelligence). In some embodiments, the control device limits the scope of AI conversation to the products involved in the exhibition hall, so as to ensure the explanation effect of the products involved in the exhibition hall. In other embodiments, the scope of AI conversation not only covers the content involved in the exhibition hall, but also covers other content, such as daily life content, so as to improve the conversation ability.
[0096] In the embodiments of the present application, the plurality of display screens are located in different areas in the exhibition hall, and the areas of the plurality of display screens in the exhibition hall can be set and changed as needed, which is not limited herein. One display screen or a plurality of display screens can be arranged in the exhibition hall, and the embodiments of the present application are taken as an example of the exhibition hall provided with a plurality of display screens.
[0097] In the embodiments of the present application, the product data displayed on the display screen refers to product data that can be displayed through the display screen. Due to the display area of the display screen, a preset number of product data can be displayed on the display screen at one time; accordingly, if the number of product data that can be displayed through the display screen is greater than the preset number, the product data that can be displayed through the display screen can be displayed by page turning control of the display screen and the like.
[0098] 302、the control device controls the digital human displayed on the first display screen to issue an interaction invitation, the interaction invitation being used to invite the visitor to interact based on the plurality of products.
[0099] In some embodiments, the control device acquires images in the exhibition hall through a camera in the exhibition hall, detects whether a visitor enters the exhibition hall based on the images, and controls the digital human displayed on the first display screen to issue an interaction invitation in a case where it is detected that a visitor enters the exhibition hall. In other embodiments, the control device can also detect whether a visitor enters the exhibition hall through an infrared detection device, which is not limited herein.
[0100] 303、the control device determines target product data pointed to by the interaction information from product data respectively displayed on the plurality of display screens in response to receiving the interaction information based on the feedback of the interaction invitation.
[0101] In the embodiments of the present application, the interaction information can be voice interaction information or text interaction information. Accordingly, the control device can acquire the interaction information through a microphone in the exhibition hall or through a text input device in the exhibition hall, which can be a keyboard or a handwriting board, and the like, which is not limited herein.
[0102] In the embodiments of the present application, one display screen is used to display product data of one product, and the target product data indicated by the interaction information can be product data displayed on one display screen or product data displayed on a plurality of display screens. For example, the interaction information indicates product data of product A in the plurality of products, and the target product data is product data displayed on one display screen. For another example, the interaction information indicates product data of product A and product B in the plurality of products, and the target product data is product data displayed on two display screens.
[0103] Optionally, in the process of determining the target product data pointed to by the interaction information from the product data respectively displayed on the plurality of display screens, the control device extracts a keyword in the interaction information, matches the keyword with keywords of the product data respectively displayed on the plurality of display screens, takes the matched product data as the target product data, and can determine at least one display screen where the target product data is located.
[0104] 304、the control device determines a display order of the digital human on at least one display screen based on an explanation order of product data respectively displayed on the at least one display screen, the at least one display screen being a display screen where the target product data is located.
[0105] In the embodiments of the present application, the explanation order of the product data respectively displayed by the at least one display screen in the target product data can be a preset explanation order or an explanation order indicated by the interaction information. For example, the interaction information indicating the explanation order is "first introduce product A and then introduce product B". Optionally, if the interaction information indicates the explanation order, the explanation order of the product data respectively displayed by the at least one display screen is determined based on the explanation order indicated by the interaction information, and if the interaction information does not indicate the explanation order, the explanation order of the product data respectively displayed by the at least one display screen is determined based on the preset explanation order.
[0106] In the embodiments of the present application, the display order of the digital person on the at least one display screen is the same as the explanation order of the product data respectively displayed by the at least one display screen. For example, the explanation order of the product data displayed by a certain display screen is the last one, and the display order of the digital person on the display screen is also the last one.
[0107] 305、The control device controls the digital person to perform product explanation based on the target product data. During the explanation, in response to reaching the display order of the second display screen, the control device controls the digital person displayed on the third display screen to issue guide information for guiding to watch the second display screen and jumps to the second display screen to display and perform product explanation based on the product data on the second display screen. The second display screen is any one of the at least one display screen, and the third display screen is the display screen on which the digital person is located before jumping to the second display screen.
[0108] The guide information indicates a path of moving from the watching position of the third display screen to the watching position of the second display screen. By controlling the digital person to issue guide information for guiding to watch the next display screen on the currently displayed display screen before the digital person jumps to the next display screen, and the guide information also indicates the path guide information for reaching the next display screen, the movement of the visiting object to the watching position of the next display screen is facilitated.
[0109] In some embodiments, in order to facilitate the movement of the visiting object to the watching position, the present application indicates that the path further includes at least one of the following implementation manners.
[0110] In one implementation manner, the control device projects the digital person in hologram at the watching position of the third display screen, and controls the digital person to move to the watching position of the second display screen along the path to guide the visiting object to follow the digital person to reach the watching position of the second display screen. In this implementation manner, the interaction effect between the digital person and the visiting object is improved, and the movement of the visiting object to the watching position is effectively guided. Optionally, in this implementation manner, the guide information further indicates that the visiting object follows the digital person to move.
[0111] In some embodiments, the control device can further control the digital person to move from the third display screen to a viewing position of the third display screen, and control the digital person to move from the viewing position of the second display screen to the second display screen, further improving the display effect of the digital person and the interaction effect with the visitor.
[0112] In another implementation, the control device projects a light ray on the path to guide the visitor to move along the projected light ray to the viewing position of the second display screen. In this implementation, the path can be highlighted in the exhibition hall through the projected light ray, thereby facilitating the movement of the visitor along the path to the viewing position.
[0113] In another implementation, the control device displays the path on the third display screen, thereby enabling the visitor to quickly reach the viewing position of the second display screen based on the displayed path to view the second display screen.
[0114] It should be noted that the above three implementations can be freely combined. For example, the control device projects a light ray on the path, and projects a digital person hologram at the viewing position of the third display screen, controls the digital person to move along the path to the viewing position of the second display screen, to further improve the interaction effect with the visitor, thereby improving the efficiency of the visitor's position movement and improving the service experience of the visitor.
[0115] In some embodiments, the plurality of display screens respectively display digital persons, and accordingly, the control device controls the process of the digital person jumping to the second display screen, including the following steps: the control device controls the digital person displayed on the third display screen to jump to the second display screen, and interacts with the digital person displayed on the second display screen, to realize the handover between the digital person displayed on the third display screen and the digital person displayed on the second display screen, the third display screen being the display screen where the digital person jumps to the second display screen before; the control device controls the digital person displayed on the second display screen to give a product explanation based on the product data displayed on the second display screen. In this embodiment, the digital persons displayed on the plurality of display screens can have different appearances or the same appearance, which is not limited here. In this embodiment, different digital persons explain the product data on different display screens, so that the digital persons on the plurality of display screens can explain to multiple visitors, improving the efficiency of explanation, and also showing the handover and interaction between the digital persons, improving the service experience.
[0116] In some embodiments, the interaction between the two digital humans is voice interaction. For example, the first digital human issues a voice of "next, you introduce product A" to the second digital human, the second digital human issues a voice of "OK, I will introduce product A next" to the first digital human, the first digital human is a digital human displayed on the third display screen, and the second digital human is a digital human displayed on the second display screen.
[0117] In some other embodiments, the first digital human does not jump to the second display screen, and accordingly, the control device controls the first digital human to display on the third display screen to interact with the second digital human. After the handover between the two digital humans is realized, the second digital human directly introduces the product. This embodiment improves the conciseness of product introduction based on digital humans.
[0118] In the embodiments of the present application, the steps 304-305 realize the process that the control device controls the digital human to jump and display between the at least one display screen based on the target product data and the at least one display screen where the target product data is located, and controls the digital human to issue the guide information and introduce the product based on the target product data. In this embodiment, when introducing the product based on the product data of the next display screen, the guide information of guiding to watch the next display screen is issued, which can improve the interactive experience and watching experience of the visiting object. It should be noted that the steps 304-305 are only one optional implementation manner to realize the process that the control device controls the digital human to jump and display between the at least one display screen based on the target product data and the at least one display screen where the target product data is located, and controls the digital human to issue the guide information and introduce the product based on the target product data. The process can also be realized by other optional implementation manners, which are not limited here. For example, the guide information is issued before the introduction, and the guide information directly indicates the introduction order of the product data respectively displayed on the at least one display screen, so as to realize the function of guiding to watch the at least one display screen through the guide information.
[0119] 306、The control device responds to receiving the service demand information issued by the visiting object, and issues an instruction based on the service demand information to the mobile robot in the exhibition hall. The instruction is used to instruct the mobile robot to provide services for the visiting object based on the service demand information.
[0120] In the embodiments of the present application, the service demand information can be voice information or text information. The service demand information can be issued by the visiting object based on the interactive invitation, or can be actively issued.
[0121] In the embodiments of the present application, the service demand information can be used to indicate obtaining an article, or can be used to indicate reaching a preset position in the exhibition hall. If the service demand information is used to indicate obtaining an article, the instruction is used to instruct the mobile robot to deliver the article to the visitor, so that the article demand of the visitor in the exhibition hall can be effectively met, and the service experience of the visitor can be improved. For example, the service demand information indicates obtaining coffee, and the mobile robot is instructed to deliver coffee to the visitor to meet the demand of the visitor to drink coffee.
[0122] If the service demand information is used to indicate reaching a preset position in the exhibition hall, the instruction is used to instruct the mobile robot to guide the visitor, so that the guide demand of the visitor in the exhibition hall can be effectively met, and the service experience of the visitor can be improved.
[0123] In some embodiments, if the service demand information is used to indicate obtaining an article, the control device displays the positions of the visitor and the mobile robot in the exhibition hall on the first display screen during the service of the mobile robot to the visitor. In this embodiment, the position of the mobile robot and the distance from the visitor can be obtained by the visitor in real time by displaying the positions of the two on the first display screen, so that the waiting anxiety of the visitor is reduced.
[0124] Optionally, the instruction also carries the position of the visitor, so that the mobile robot can deliver the article to the position of the visitor, and the article is delivered to the visitor and the mobile robot reaches the position of the visitor to guide the visitor. In some embodiments, the control device can perform three-dimensional modeling on the exhibition hall to obtain a plurality of positions in the exhibition hall, so as to facilitate identification of the position of the visitor and leading the visitor to the preset position.
[0125] In some embodiments, the mobile robot can directly interact with the visitor. For example, the mobile robot can talk to the visitor based on the voice instruction issued by the visitor, and then directly meet the service demand of the visitor by the mobile robot.
[0126] It should be noted that the serial numbers of steps 303-305 and step 306 are only for the convenience of description, and do not limit the execution order of the two steps. Steps 303-305 can be executed before step 306, or can be executed after step 306. Steps 303-305 and step 306 can also be executed simultaneously, which is not limited here.
[0127] In some embodiments, the control device further acquires the action and expression of the visitor object through the motion capture camera. During the explanation, the control device controls the digital person to interact with the visitor object in the action and expression of the visitor object. Alternatively, the control device can control the digital person to always interact with the visitor object in the action and expression of the visitor object during the explanation. Or, during the explanation, multiple interaction links can be interspersed, and the control device controls the digital person to interact with the visitor object in the action and expression of the visitor object in the interaction link. Alternatively, the acquired expression is the micro-expression of the visitor object. In this embodiment, interacting with the visitor object in the action and expression of the visitor object can improve the intimacy between the visitor object and the digital person, and thus improve the visit experience.
[0128] In some embodiments, if the interaction information is used to request to acquire the statistical data of the preset product in the preset dimension, the control device acquires the statistical data of the preset product in the preset dimension based on the interaction information, controls the digital person displayed on the at least one display screen to perform product explanation based on the statistical data, and displays the statistical data on the at least one display screen. In this embodiment, the acquisition demand of the visitor object for the statistical data is met.
[0129] Among them, the control device controls the digital person displayed on the at least one display screen to perform product explanation based on the statistical data, and displays the statistical data on the at least one display screen includes the following several cases. If the statistical data is only distributed on one display screen, the digital person displayed on the display screen is controlled to perform product explanation, and the statistical data is displayed on the display screen. For example, the interaction information is "how many chip companies are there in the park", the statistical data involves a number, then control the digital person on the display screen where the number is distributed to broadcast the number in the form of voice, and display on the display screen. For another example, the interaction information is "which chip company in the park has the strongest scientific research strength", the statistical data involves a name, then control the digital person on the display screen where the name is distributed to broadcast the number in the form of voice, and display on the display screen.
[0130] If the statistical data is distributed on multiple display screens, the digital person is controlled to jump and display on the multiple display screens to perform product explanation based on the product data on the multiple display screens, and the statistical data is displayed on the multiple display screens. For example, the interaction information is "please analyze the scientific research strength of company A from multiple dimensions", if the data of its scientific research strength involves product data such as papers, awards and products, and these product data are distributed on different display screens, accordingly, the control device controls the digital person to jump and display on multiple display screens to perform explanation based on the product data on the multiple display screens. The process is the same as step 305, and will not be repeated here.
[0131] In the embodiments of the present application, the statistical data can be generated in advance or currently. Optionally, the control device generates the statistical data based on the interaction information through generative AI. For example, the control device can analyze data such as papers and awards according to the generative AI, and then obtain the statistical result of the scientific research strength.
[0132] In some embodiments, for the products displayed in the exhibition hall, the visiting object can instruct the digital person to demonstrate the use process of the product or show the principle or internal structure of the product. The digital person can simulate a real person as a user to demonstrate, or can simulate a real person to disassemble the product to show the internal structure of the product.
[0133] Correspondingly, the control device demonstrates the product based on the target product data, including the following steps: if the interaction information is first type information, the control device displays the digital person using the first product on the at least one display screen based on the first product indicated by the interaction information and the target product data, and controls the digital person to demonstrate the use process. The first type information is information indicating to demonstrate the use process of the product. If the interaction information is second type information, the control device displays the digital person disassembling the second product and showing the internal structure of the disassembled second product on the at least one display screen based on the second product indicated by the interaction information and the target product data, and controls the digital person to demonstrate the disassembly process and the internal structure. The second type information is information indicating to show the internal structure of the product. In this embodiment, the digital person simulates a real person to meet the needs of the visiting object to fully understand the use process and the internal structure of the product, meet the service needs, and improve the service effect.
[0134] In some embodiments, if the first product is one and the target product data is distributed on one display screen, the digital person using the first product is displayed on the at least one display screen, and the control of the digital person demonstrating the use process means that the digital person using the first product is displayed on the display screen, and the digital person displayed on the display screen is controlled to demonstrate. If the first product is multiple and the target product data is distributed on multiple display screens, the digital person using the first product is displayed on the at least one display screen, and the control of the digital person demonstrating the use process means that the digital person is controlled to display and jump on multiple display screens, respectively demonstrate the use process of multiple products and demonstrate.
[0135] In some embodiments, the use process and the disassembly process demonstrated by the digital person can be generated in advance, thereby facilitating to improve the demonstration efficiency. In other embodiments, the use process and the disassembly process demonstrated by the digital person are currently generated through generative AI, thereby facilitating to utilize the powerful generation function of the generative AI and reduce the waste of storage resources.
[0136] In the embodiments of the present application, the generative AI is combined with the digital exhibition hall to add a high-intelligent, high-efficient and high-experience digital human intelligent exhibition hall service to the traditional digital exhibition hall. Through the method provided in the embodiments of the present application, the visiting object can fully understand the products displayed in the exhibition hall and promote the visiting object to watch the key display content without an interpreter in the exhibition hall, the actual role of the exhibition hall can be played, and the cost reduction and efficiency improvement of the digital exhibition hall can be truly realized.
[0137] The embodiments of the present application provide an exhibition hall service method. The method controls the digital human to jump and display among at least one display screen based on the product data displayed on the at least one display screen, and performs product explanation based on the product data displayed on the at least one display screen, so as to realize sufficient explanation of the products by the digital human through multi-screen linkage. The method controls the digital human to issue guidance information when jumping and displaying on the at least one display screen, thereby guiding the visiting object to follow the jumping and displaying of the digital human and jump and watch the display screen, and improving the viewing experience of the visiting object. The method does not need manual participation, improves the service effect while realizing the exhibition hall explanation service, and truly realizes the cost reduction and efficiency improvement of the exhibition hall service.
[0138] The embodiments of the present application also provide an exhibition hall service device, referring to Figure 4 , the device comprises:
[0139] The display module 401 is configured to display the digital human on a first display screen of the exhibition hall. The exhibition hall displays a plurality of products, and the first display screen is any display screen of a plurality of display screens of the exhibition hall. The plurality of display screens are used to display different product data of the plurality of products.
[0140] The interaction module 402 is configured to control the digital human displayed on the first display screen to issue an interaction invitation. The interaction invitation is used to invite the visiting object to interact based on the plurality of products.
[0141] The determination module 403 is configured to determine target product data pointed by the interaction information from the product data displayed on each of the plurality of display screens in response to receiving the interaction information fed back based on the interaction invitation.
[0142] The explanation module 404 is configured to control the digital human to jump and display between at least one display screen based on the target product data and the at least one display screen where the target product data is located, and control the digital human to issue guidance information and perform product explanation based on the target product data. The guidance information is used to guide to watch the at least one display screen.
[0143] In some embodiments, the explanation module 404 is configured to:
[0144] determine a display order of the digital human on the at least one display screen based on an explanation order of product data respectively displayed by each of the at least one display screen in the target product data;
[0145] In the explanation process, in response to reaching the display order of the second display screen, control the digital human to issue guide information for guiding to watch the second display screen and jump to display on the second display screen, and perform product explanation based on product data on the second display screen, the second display screen being any one of the at least one display screen.
[0146] In some embodiments, the explanation module 404 is configured to control the digital human displayed on the third display screen to issue guide information for guiding to watch the second display screen, the guide information indicating a path from a watching position of the third display screen to a watching position of the second display screen, the third display screen being a display screen on which the digital human is located before jumping to the second display screen.
[0147] In some embodiments, the apparatus further comprises a path guiding module configured to implement at least one of:
[0148] projecting the digital human hologram at the watching position of the third display screen and controlling the digital human to move along the path to the watching position of the second display screen to guide the visitor object to follow the digital human to the watching position of the second display screen; or
[0149] projecting a light ray on the path to guide the visitor object to follow the projected light ray to the watching position of the second display screen; or
[0150] displaying the path on the third display screen.
[0151] In some embodiments, a plurality of display screens respectively display a digital human, and the explanation module 404 is configured to:
[0152] control the digital human displayed on the third display screen to jump to the second display screen and interact with the digital human displayed on the second display screen to realize handover between the digital human displayed on the third display screen and the digital human displayed on the second display screen, the third display screen being a display screen on which the digital human is located before jumping to the second display screen;
[0153] control the digital human displayed on the second display screen to perform product explanation based on product data displayed on the second display screen.
[0154] In some embodiments, the explanation module 404 is configured to, if the interaction information is used to request to obtain statistical data of the preset product in a preset dimension, obtain the statistical data of the preset product in the preset dimension based on the interaction information, control the digital human displayed on the at least one display screen to perform product explanation based on the statistical data, and display the statistical data on the at least one display screen.
[0155] In some embodiments, the explanation module 404 is configured to: if the interaction information is first type information, display the digital human using a first product on the at least one display screen based on the first product and the target product data indicated by the interaction information, and control the digital human to explain the use process of the first product, the first type information being information indicating a demonstration of a product use process;
[0156] if the interaction information is second type information, display the digital human disassembling a second product and showing the internal structure of the disassembled second product on the at least one display screen based on the second product and the target product data indicated by the interaction information, and control the digital human to explain the disassembling process and the internal structure, the second type information being information indicating a demonstration of a product internal structure.
[0157] In some embodiments, the apparatus further comprises:
[0158] an instruction module configured to, in response to receiving the service demand information issued by the visitor, issue an instruction to the mobile robot in the exhibition hall based on the service demand information, the instruction being used to instruct the mobile robot to provide a service for the visitor based on the service demand information.
[0159] In some embodiments, if the service demand information is used to indicate an acquisition of an article, the instruction is used to instruct the mobile robot to deliver the article for the visitor;
[0160] if the service demand information is used to indicate a reaching of a preset position in the exhibition hall, the instruction is used to instruct the mobile robot to guide the visitor.
[0161] In some embodiments, the apparatus further comprises:
[0162] a position display module configured to, if the service demand information is used to indicate an acquisition of an article, display the positions of the visitor and the mobile robot in the exhibition hall on the first display screen during the service provided by the mobile robot for the visitor.
[0163] In some embodiments, the apparatus further comprises:
[0164] an acquisition module configured to acquire the actions and expressions of the visitor through the motion capture camera;
[0165] an interaction module configured to control the digital human to interact with the visitor in the actions and expressions of the visitor during the explanation.
[0166] The embodiment of the present application provides a hall service device, the device interacts with a visiting object through a digital person, and can control the digital person to jump and display on at least one display screen based on product data indicated by the visiting object, to perform product explanation based on product data displayed on the at least one display screen, so that sufficient explanation of the digital person to the product is realized through multi-screen linkage; and the device sends guiding information when controlling the digital person to jump and display on the at least one display screen, thereby guiding the visiting object to follow the jump and display of the digital person and jump and watch the display screen, and improving the watching experience of the visiting object. The device does not need manual participation, improves the service effect while realizing the hall explanation service, and truly realizes cost reduction and benefit increase of the hall service.
[0167] It should be noted that: the hall service device provided in the above embodiment is only exemplified by the division of the above functional modules, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the control device is divided into different functional modules to complete all or part of the functions described above. In addition, the hall service device and the hall service method provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.
[0168] Figure 5 A control device provided by the embodiment of the present application is a block diagram of the control device, the control device 500 can be greatly different due to different configurations or performances, and can include one or more processors (Central Processing Units, CPU) 501 and one or more memories 502, wherein the memory 502 is used to store executable program codes, and the processor 501 is configured to execute the above executable program codes to realize the hall service method provided by each method embodiment. Of course, the control device can also have a wired or wireless network interface, a keyboard and an input and output interface and the like, so as to perform input and output, and the control device can also include other components for realizing the functions of the device, which will not be repeated here.
[0169] In the exemplary embodiment, a storage medium including program codes is also provided, for example, a memory 502 including program codes, the above program codes can be executed by the processor 501 of the control device 500 to complete the above hall service method. Optionally, the storage medium can be a non-transitory computer readable storage medium, for example, the non-transitory computer readable storage medium can be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk and an optical data storage device and the like.
[0170] The embodiment of the present application further provides a computer readable storage medium, and at least one piece of program code is stored in the computer readable storage medium. The at least one piece of program code is loaded and executed by a processor to implement the exhibition hall service method of any of the implementation manners.
[0171] The embodiment of the present application further provides a computer program product, and the computer program product comprises computer program code. The computer program code is stored in a computer readable storage medium. A processor of a control device reads the computer program code from the computer readable storage medium. The processor executes the computer program code, so that the control device executes the exhibition hall service method of any of the implementation manners.
[0172] In some embodiments, the computer program product related to the embodiment of the present application can be deployed to execute on one control device, or to execute on multiple control devices located in one place, or to execute on multiple control devices distributed in multiple places and interconnected through a communication network. The multiple control devices distributed in multiple places and interconnected through the communication network can constitute a blockchain system.
[0173] The above is only an optional embodiment of the present application, and is not used to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A showroom service method characterized by, The method is applied to a control device, and comprises: Displaying a digital person on a first display screen in an exhibition hall, wherein the exhibition hall is provided with a plurality of exhibition stands, products are displayed on the exhibition stands, one exhibition stand is arranged in front of one display screen, and the display screen behind the exhibition stand is used to display product data of the product displayed on the corresponding exhibition stand, the first display screen is any one of the plurality of display screens in the exhibition hall, and the plurality of display screens are used to display different product data of a plurality of products; Controlling the digital person displayed on the first display screen to issue an interaction invitation, wherein the interaction invitation is used to invite a visitor to interact based on the plurality of products; In response to receiving interaction information based on feedback of the interaction invitation, determining target product data pointed by the interaction information from product data displayed on a plurality of display screens respectively; Determining a display order of the digital person on at least one display screen based on a presentation order of product data displayed on the at least one display screen respectively based on the target product data, wherein the at least one display screen is a display screen where the target product data is located, and the display order of the digital person on the at least one display screen is the same as the presentation order of the product data displayed on the at least one display screen respectively; Controlling the digital person to give a product presentation based on the target product data, and in the process of the presentation, in response to reaching a display order of a second display screen, controlling the digital person displayed on a third display screen to issue guide information for guiding to watch the second display screen and jump to the second display screen to display and give a product presentation based on product data on the second display screen, wherein the second display screen is any one of the at least one display screen, the third display screen is a display screen where the digital person is located before jumping to the second display screen, and the guide information indicates a path from a watching position of the third display screen to a watching position of the second display screen; The plurality of display screens respectively display digital persons, and the process of controlling the digital person displayed on the third display screen to jump to the second display screen to display comprises: Controlling the digital person displayed on the third display screen to jump to the second display screen to interact with the digital person displayed on the second display screen, so as to realize handover between the digital person displayed on the third display screen and the digital person displayed on the second display screen; Controlling the digital person displayed on the second display screen to give a product presentation based on product data displayed on the second display screen.
2. The method of claim 1, wherein, The control of the digital person displayed on the third display screen to issue the guide information for guiding to watch the second display screen comprises at least one of the following: Holographically projecting the digital person on a watching position of the third display screen, and controlling the digital person to move to the watching position of the second display screen along the path to guide the visitor to follow the digital person to reach the watching position of the second display screen; or Projecting a light on the path to guide the visitor to reach the watching position of the second display screen along the projected light; or Displaying the path on the third display screen.
3. The method of claim 1, wherein, The product presentation based on the target product data comprises: If the interaction information is used to request to obtain statistical data of a preset product in a preset dimension, statistical data of the preset product in the preset dimension is obtained based on the interaction information, a digital human displayed on the at least one display screen is controlled to perform product explanation based on the statistical data, and the statistical data is displayed on the at least one display screen.
4. The method of claim 1, wherein, The product explanation based on the target product data comprises: If the interaction information is first type information, the digital human is displayed using a first product indicated by the interaction information and the target product data on the at least one display screen, and the digital human is controlled to explain a use process, the first type information being information indicating a product use process demonstration; If the interaction information is second type information, the digital human is displayed disassembling a second product and showing an internal structure of the disassembled second product based on the second product indicated by the interaction information and the target product data on the at least one display screen, and the digital human is controlled to explain a disassembling process and the internal structure, the second type information being information indicating a product internal structure demonstration.
5. The method of claim 1, wherein, The method further comprises: In response to receiving service demand information issued by the visitor, an instruction is issued to a mobile robot in the exhibition hall based on the service demand information, the instruction being used to instruct the mobile robot to provide service for the visitor based on the service demand information.
6. The method of claim 5, wherein, if the service demand information is used to indicate to obtain an article, the instruction is used to instruct the mobile robot to deliver the article for the visitor; if the service demand information is used to indicate to reach a preset position in the exhibition hall, the instruction is used to instruct the mobile robot to guide the visitor.
7. The method of claim 6, wherein, The method further comprises: if the service demand information is used to indicate to obtain an article, a position of the visitor and the mobile robot in the exhibition hall is displayed on the first display screen during the service provided by the mobile robot for the visitor.
8. The method of claim 1, wherein, The method further comprises: actions and expressions of the visitor are obtained through a motion capture camera; during the explanation, the digital human is controlled to interact with the visitor in the actions and expressions of the visitor.
9. A showroom service device characterized by comprising: The apparatus comprises: a display module configured to display a digital human on a first display screen of an exhibition hall, the exhibition hall comprising a plurality of exhibition stands, the exhibition stands displaying products, one exhibition stand being arranged in front of one display screen, and a display screen behind the exhibition stand being used to display product data of the product displayed on the corresponding exhibition stand, the first display screen being any one of a plurality of display screens of the exhibition hall, the plurality of display screens being used to display different product data of a plurality of products, and the plurality of display screens respectively displaying digital humans; an interaction module configured to control the digital human displayed on the first display screen to issue an interaction invitation, the interaction invitation being used to invite a visitor to interact based on the plurality of products. determining, in response to receiving the interaction information based on the interaction invitation feedback, target product data to which the interaction information points from product data respectively displayed by the plurality of display screens; the explanation module is configured to determine a display order of the digital human on the at least one display screen based on an explanation order of the product data respectively displayed by the at least one display screen, the at least one display screen being a display screen on which the target product data is displayed, the display order of the digital human on the at least one display screen being the same as the explanation order of the product data respectively displayed by the at least one display screen, and control the digital human to perform product explanation based on the target product data, in the process of the product explanation, in response to reaching the display order of the second display screen, control the digital human displayed on the third display screen to issue guide information for guiding viewing of the second display screen and jump to the second display screen to display and perform product explanation based on the product data on the second display screen, the second display screen being any one of the at least one display screen, and the third display screen being a display screen on which the digital human is located before jumping to the second display screen, and the guide information indicating a path of moving from a viewing position of the third display screen to a viewing position of the second display screen; the plurality of display screens respectively display the digital human, and the process of controlling the digital human displayed on the third display screen to jump to the second display screen to display includes: controlling the digital human displayed on the third display screen to jump to the second display screen to interact with the digital human displayed on the second display screen to realize handover between the digital human displayed on the third display screen and the digital human displayed on the second display screen, and controlling the digital human displayed on the second display screen to perform product explanation based on the product data displayed on the second display screen.
10. A control device characterized by comprising: The control device includes one or more processors and one or more memories, and the one or more memories store at least one program code, which is loaded and executed by the one or more processors to implement the exhibition hall service method of any one of claims 1 to 8.
11. A computer readable storage medium, characterized in that, The storage medium stores at least one program code, which is loaded and executed by the processor to implement the exhibition hall service method of any one of claims 1 to 8.
12. A computer program product, characterised in that, The computer program product includes computer program code stored in a computer readable storage medium, and the processor of the control device reads the computer program code from the computer readable storage medium, and the processor executes the computer program code to enable the control device to perform the exhibition hall service method of any one of claims 1 to 8.
Citation Information
Patent Citations
Exhibition hall control system and method, cloud server and terminal control equipment
CN109782706A
Virtual human behavior interaction system
CN115129163A
User interaction method and device, electronic equipment and storage medium
CN115544234A
Exhibition system based on meta universe, interaction method and electronic equipment
CN115857704A