Holographic projection method, device, equipment and medium based on sweeper platform
By integrating a holographic projection module on the sweeper, using user instructions and recognition mode to mark the cleaning area, the problem that existing sweepers cannot interact with human-computer is solved, deep cleaning and functional diversity are achieved, and user experience is improved.
Patent Information
- Application Number
- CN202210081450.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-24
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-01-24
AI Technical Summary
The existing sweeping robots cannot perform human-computer interaction, resulting in poor user experience and inability to effectively mark clean areas, affecting their functional diversity.
Integrated holographic projection module on the sweeper, by obtaining user instructions, extracting keyword information, matching work videos, and using marking features and projected images to determine the cleaning area, realizing deep cleaning operations, while supporting gestures, pupils and speech recognition modes, enhancing Human-computer interaction function.
Through holographic projection technology, users can easily mark areas that need to be cleaned, and the sweeper automatically performs deep cleaning, which improves user experience and functional diversity, and enhances the intelligence and interactivity of the sweeper.
Smart Images

Figure CN114488752B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of smart home projection technology, and in particular to a holographic projection method, device, equipment and medium based on a sweeper platform. Background Art
[0002] As early as 1947, Hungarian physicist Denis Gabor invented holographic projection technology. In 1962, Soviet scientist Yuri Philips recorded the first optical holographic projection of a three-dimensional object. With the development of this technology, it is now possible to stably project three-dimensional images.
[0003] The existing sweeping robots have relatively simple functions. Most of them only have the sweeping function. A few sweeping robots have the plane projection function, but the plane projection can only project the video, and does not have the powerful human-computer interaction function of holographic projection. For example, when the user wants the sweeping robot to clean a certain place, the existing sweeping robots require the user to move the sweeping robot over or open the APP bound to the sweeping robot and mark it on the internal map of the sweeping robot. The sweeping robot will then go over to clean. The operation is relatively mechanical and programmed, and human-computer interaction cannot be carried out. It is not convenient enough and affects the user experience. Summary of the invention
[0004] The present application provides a holographic projection method, device, equipment and medium based on a sweeping machine platform. By setting a holographic projection module on the sweeping machine, the sweeping machine is endowed with powerful human-computer interaction functions, making its functions more complete and diversified, aiming to solve the problem that existing sweeping machines can only project but not perform human-computer interaction, resulting in poor user experience.
[0005] In order to achieve the above-mentioned invention problem, in a first aspect, the present application provides a holographic projection method based on a sweeper platform, comprising:
[0006] Get the first demand instructions of frequent users;
[0007] Extracting first keyword information according to the first demand instruction of the frequent user;
[0008] Matching the first keyword information with words in a preset working vocabulary;
[0009] When the first keyword information matches a word in the preset working vocabulary, obtaining a working video matching the first keyword information;
[0010] Projecting and playing the working video based on holographic projection to generate a first projection image;
[0011] After the projection is played, the marking features of the common user are obtained by using a preset mode;
[0012] Based on the marking feature and in combination with the projection image, obtaining a marking area;
[0013] The sweeper is controlled to perform deep cleaning on the marked area.
[0014] Preferably, when the preset mode is a gesture recognition mode, the step of obtaining the marking features of the common user by using the preset mode includes:
[0015] Acquire and analyze the first gesture instruction of the frequent user;
[0016] When the first gesture instruction of the common user matches the preset gesture wake-up instruction, waking up the gesture recognition mode;
[0017] Continuing to track and identify a second gesture instruction of the frequent user;
[0018] The second gesture instruction is parsed to generate a marking feature of the frequent user.
[0019] Preferably, when the preset mode is a pupil recognition mode, the step of obtaining the user's marking features by using the preset mode includes:
[0020] Acquire and parse the first pupil instruction of the common user;
[0021] When the first pupil instruction of the common user matches the preset pupil awakening instruction, awakening the pupil recognition mode;
[0022] Continue to track and identify the second pupil instruction of the frequent user;
[0023] The second pupil instruction is parsed to generate a marking feature of the common user.
[0024] Preferably, when the preset mode is a speech recognition mode, the step of obtaining the user's marking features by using the preset mode includes:
[0025] Acquire a first voice command issued by the frequent user;
[0026] When the first voice command of the frequent user matches the preset voice wake-up command, waking up the voice recognition mode;
[0027] Acquire a second voice command issued by the frequent user;
[0028] Extracting keyword information contained in the voice command based on voice recognition;
[0029] The keyword information is parsed to generate the marking features of the frequent users.
[0030] Preferably, after the step of obtaining the marked area based on the marked feature and in combination with the projection image, the method further comprises:
[0031] Obtaining a zoom-in instruction of the frequent user;
[0032] The marked area is enlarged by a preset multiple according to the enlargement instruction.
[0033] Preferably, after the step of extracting the first keyword information according to the first demand instruction of the frequent user, the following steps are included:
[0034] Matching the first keyword information with words in a preset entertainment vocabulary;
[0035] When the first keyword information matches a word in a preset entertainment vocabulary, obtaining media content matching the first keyword information;
[0036] The media content is projected and played based on holographic projection to generate a second projection image.
[0037] Preferably, after the step of projecting and playing the media content based on holographic projection to generate a second projection image, the method further includes:
[0038] Obtaining a second demand instruction of the frequent user;
[0039] According to the second demand instruction, extracting second keyword information in the second demand instruction;
[0040] Acquire second media content matching the second keyword information;
[0041] The second media content is projected and played.
[0042] Preferably, after the step of projecting and playing the media content based on holographic projection to generate a second projection image, the method further includes:
[0043] Obtaining a selfie instruction of the frequent user;
[0044] According to the selfie instruction, the frequently used user is locked and photographed to generate a selfie video;
[0045] The selfie video and the media content are projected and played together to generate a third projection image.
[0046] Preferably, before the step of obtaining the first demand instruction of the frequent user, the step includes:
[0047] Collecting the first vital sign information of the current user;
[0048] Comparing and identifying the first physical sign information with at least one physical sign information in a preset physical sign library;
[0049] When the first physical sign information is compared and is consistent with the physical sign information in the preset physical sign library, determining that the current user is a frequent user;
[0050] When the first physical sign information is inconsistent with the physical sign information in the preset physical sign library, determining that the current user is an abnormal user;
[0051] Record and save the vital signs information of the abnormal user and generate alarm information;
[0052] The vital sign information of the abnormal user and the alarm information are sent to a preset user terminal.
[0053] The present disclosure also provides a holographic projection device based on a sweeper platform, which includes:
[0054] A first instruction acquisition module, used to acquire the first demand instruction of a frequent user;
[0055] A first keyword acquisition module, used to extract first keyword information according to the first demand instruction of the frequent user;
[0056] A matching module, used for matching the first keyword information with words in a preset working vocabulary;
[0057] A work video acquisition module, configured to acquire a work video matching the first keyword information when the first keyword information matches a word in the preset work vocabulary;
[0058] A first projection module, used for projecting and playing the working video based on holographic projection to generate a first projection image;
[0059] A marking feature acquisition module, used to obtain the marking features of the common users by using a preset mode after projection playback;
[0060] A marking area acquisition module, used to obtain a marking area based on the marking feature and in combination with the projection image;
[0061] The cleaning module is used to control the sweeper to perform deep cleaning on the marked area.
[0062] The present disclosure also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the holographic projection method based on a sweeper platform described in any one of the above items are implemented.
[0063] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of any one of the above-mentioned holographic projection methods based on a sweeper platform are implemented.
[0064] The present invention discloses a holographic projection method, device, equipment and medium based on a sweeping machine platform. The user can perform human-computer interaction with the sweeping machine through a preset mode, reproduce the video and recording of the sweeping machine's work for cleaning inspection, etc., and can identify the areas that were ignored and not cleaned during the cleaning process to the sweeping machine based on the holographic projection technology, so that the sweeping machine can perform deep cleaning. By arranging a holographic projection module on the sweeping machine, the sweeping machine is given a powerful human-computer interaction function, making its functions more complete and diversified, aiming to solve the problem that the existing sweeping machines can only project but not perform human-computer interaction, resulting in a poor user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0065] Figure 1 The figure is a flow chart of a holographic projection method based on a sweeper platform according to an embodiment of the present invention;
[0066] Figure 2 This is a schematic structural diagram of a holographic projection device based on a sweeper platform according to an embodiment;
[0067] Figure 3 The present invention is a schematic block diagram of the structure of a computer device according to an embodiment.
[0068] The realization of the objectives, functional features and advantages of the present disclosure will be further described in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0069] In order to make the purpose, technical solution and advantages of the present disclosure more clear, the present disclosure is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present disclosure and are not used to limit the present disclosure.
[0070] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "a", "an", "above", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present disclosure refers to the presence of features, integers, steps, operations, elements, units, units, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, units, units, components, and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate element. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.
[0071] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by those skilled in the art in the field to which the present disclosure belongs. It should also be understood that terms such as those defined in common dictionaries should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless specifically defined as here.
[0072] Reference Figure 1 , is a flow chart of a holographic projection method based on a sweeper platform disclosed in this solution, including:
[0073] S1: Get the first demand instruction of frequent users;
[0074] S2: extracting first keyword information according to the first demand instruction of the frequent user;
[0075] S3: matching the first keyword information with words in a preset working vocabulary;
[0076] S4: when the first keyword information matches a word in the preset working vocabulary, obtaining a working video matching the first keyword information;
[0077] S5: Projecting and playing the working video based on holographic projection to generate a first projection image;
[0078] S6: After the projection is played, the marking features of the frequent users are obtained by using a preset mode;
[0079] S7: Based on the marking feature and in combination with the projection image, obtaining a marking area;
[0080] S8: Control the sweeper to perform deep cleaning on the marked area.
[0081] As described in the above steps S1-S5, a preset word library is preset in the memory of the sweeping machine, and the words in the preset word library include an entertainment word library and a work word library, wherein the entertainment word library contains various entertainment words such as game-related words, music-related words, video-related words, fitness-related words, dance-related words, etc., and the work word library is preset with words involved in the daily work of the sweeping machine, such as "dust", "cleaning", "monitoring", "lighting" and corresponding room and furniture-related words, etc. The preset word library can be added by the user himself, and can also be automatically updated and supplemented based on the communication network; if the user issues a command "view today's cleaning video of room A" when he comes back, the sweeping machine will extract "room A" and "cleaning video" as keywords, extract today's cleaning video of room A and project it based on holographic projection to form a projection video;
[0082] As described in the above step S6, after projecting the cleaning video of room A, the sweeping machine will record whether the user marks it in the projected image. For example, when the user is viewing the video, he finds that there are residual stains under the sofa in room A that have not been cleaned. The user can mark the residual stains through gesture recognition mode, voice recognition mode or pupil recognition mode. The sweeping machine will detect whether the user raises his hand to frame the area under the sofa in room A in the projected image, or issues a voice command "The area under the sofa in room A needs to be cleaned again". The sweeping machine will frame the area under the sofa in room A in the projected image based on voice recognition. Pupil recognition can also be used, for example, by keeping the eyes on the sofa in room A for a predetermined time to frame this area, and then wake up the input keyboard through a specific eye movement such as flipping the eyes upward three times in a row or blinking three times in a row, and then input the mark by turning the eyes or blinking, etc.
[0083] As described in the above steps S7-S8, after the user has marked the location, the sweeping machine will mark the location of "under the sofa in room A" in the built-in map according to the information marked by the user in the projection image frame. When the sweeping machine is idle, it will automatically navigate there for cleaning. The use of holographic projection technology can greatly improve the user's experience when using the sweeping machine.
[0084] In one embodiment, when the preset mode is a gesture recognition mode, the step of obtaining the marking features of the common user by using the preset mode includes:
[0085] Acquire and analyze the first gesture instruction of the frequent user;
[0086] When the first gesture instruction of the common user matches the preset gesture wake-up instruction, waking up the gesture recognition mode;
[0087] Continuing to track and identify a second gesture instruction of the frequent user;
[0088] The second gesture instruction is parsed to generate a marking feature of the frequent user.
[0089] As mentioned above, when using the gesture recognition mode, first, the user needs to make a preset wake-up gesture to wake up and control the sweeper, such as clapping his hands three times in a row. The specific wake-up gesture can be set by the user. After waking up, the gesture recognition module of the sweeper will continue to track the user's gesture, unless the user makes a preset close gesture to turn off this mode. During this process, the user can use a lift gesture to specify any position in the projected image displayed by the sweeper to zoom in, slide or mark, etc., which is convenient for people who are not good at operating smart products.
[0090] In one embodiment, when the preset mode is a pupil recognition mode, the step of obtaining the user's marking features by using the preset mode includes:
[0091] Acquire and parse the first pupil instruction of the common user;
[0092] When the first pupil instruction of the common user matches the preset pupil awakening instruction, awakening the pupil recognition mode;
[0093] Continue to track and identify the second pupil instruction of the frequent user;
[0094] The second pupil instruction is parsed to generate a marking feature of the common user.
[0095] As mentioned above, similarly, when using the pupil recognition mode, first, the user needs to make a preset eye movement to wake up and control the sweeper, such as turning the eyes upward three times in a row or blinking three times, etc. The specific wake-up action can be set by the user. After waking up, the gesture recognition module of the sweeper will continue to track the user's gesture, unless the user makes a preset closing action to turn off this mode. During this process, the user can specify any position in the projected image displayed by the sweeper to enlarge, slide or mark by blinking, rolling eyes in a certain direction, etc., which is convenient for people with language barriers to use.
[0096] In one embodiment, when the preset mode is a speech recognition mode, the step of obtaining the user's marking features by using the preset mode includes:
[0097] Acquire a first voice command issued by the frequent user;
[0098] When the first voice command of the frequent user matches the preset voice wake-up command, waking up the voice recognition mode;
[0099] Acquire a second voice command issued by the frequent user;
[0100] Extracting keyword information contained in the voice command based on voice recognition;
[0101] The keyword information is parsed to generate the marking features of the frequent users.
[0102] As mentioned above, similarly, when the user turns on the voice recognition mode, he or she also needs to first send a wake-up command such as "turn on voice control mode" to the sweeping machine to perform the wake-up operation. When the sweeping machine obtains the command "turn on voice control mode", it will turn on the voice control mode and make a response. After waking up, the voice recognition module of the sweeping machine will continue to recognize the voice commands issued by the user and perform related operations according to the voice commands, unless the user issues a preset shutdown command to turn off this mode. During this process, the sweeping machine will recognize the user's voice "The area under the sofa in Room A needs to be cleaned again" based on voice recognition, and mark the sofa in Room A in the built-in map with "Needs to be cleaned again" and other signs. The user can also send corresponding operation commands to the sweeping machine to control the sweeping machine to enlarge or slide the projected image, etc., to facilitate use by people with visual impairments.
[0103] In one embodiment, after the step of obtaining the marked area based on the marking feature and in combination with the projection image, the method further includes:
[0104] Obtaining a zoom-in instruction of the frequent user;
[0105] The marked area is enlarged by a preset multiple according to the enlargement instruction.
[0106] As described above, when the user needs to carefully view the video of a certain place, the user can issue a zoom-in command to the sweeping machine through gesture instructions based on the gesture recognition mode or through eye movements or voice commands based on the through-hole recognition mode. The sweeping machine enlarges the user-specified area in the projected image according to the user's zoom-in command, so that the user can check the situation in the room more clearly. At the same time, the user can also use the enlarged marked area to find lost items.
[0107] In one embodiment, after the step of extracting the first keyword information according to the first demand instruction of the frequent user, the following steps are included:
[0108] Matching the first keyword information with words in a preset entertainment vocabulary;
[0109] When the first keyword information matches a word in a preset entertainment vocabulary, obtaining media content matching the first keyword information;
[0110] The media content is projected and played based on holographic projection to generate a second projection image.
[0111] As mentioned above, when the user returns home and does not issue an instruction to check the sanitary environment at home, the sweeping machine can also be used as a multimedia device. For example, after the user returns home, if the instruction "play B's song (B is the name of the singer)" is issued, the sweeping machine will extract "B" and "song" as keywords, and match "B" and "song" with the words in the entertainment vocabulary preset in the sweeping machine, where the entertainment vocabulary contains various entertainment words such as game-related words, music-related words, video-related words, fitness-related words, dance-related words, etc., or connect to the cloud through WIFI to retrieve "B's" songs for playback. If the instruction "I want to play XX game" is issued, "XX game" will be searched, or "I want to practice yoga" will be issued, "yoga" related videos will be searched and projected using the holographic projection module. Similarly, users can also operate the projected image through gesture recognition mode, voice recognition mode and gesture recognition mode, which can make users feel as if they are in the scene and greatly increase the user experience.
[0112] In a real-time example, after the step of projecting and playing the media content based on holographic projection to generate a second projection image, the step further includes:
[0113] Obtaining a second demand instruction of the frequent user;
[0114] According to the second demand instruction, extracting second keyword information in the second demand instruction;
[0115] Acquire second media content matching the second keyword information;
[0116] The second media content is projected and played.
[0117] As mentioned above, for example, when the user is listening to music, playing games or practicing yoga, the relevant instructions can be sent to the sweeping machine, and the sweeping machine will search for relevant videos or music according to the instructions for playing. For example, when the user is playing a game, the sweeping machine can play some music with a faster rhythm. When the user is practicing yoga or exercising, some colorful pictures can be played to add some atmosphere.
[0118] In a real-time example, after the step of projecting and playing the media content based on holographic projection to generate a second projection image, the step further includes:
[0119] Obtaining a selfie instruction of the frequent user;
[0120] According to the selfie instruction, the frequently used user is locked and photographed to generate a selfie video;
[0121] The selfie video and the media content are projected and played together to generate a third projection image.
[0122] As mentioned above, if the user is practicing yoga or dancing, the user can give instructions to the sweeping robot to play some dance or yoga teaching videos that he wants to learn. At the same time, the user can use the built-in camera of the sweeping robot to record the video of himself practicing yoga or dancing, and project the video of himself practicing yoga or dancing synchronously with the teaching video, so that the user can intuitively see whether the movements he has made are in place with the movements in the teaching video, helping the user to better improve his practice efficiency.
[0123] In one embodiment, before the step of obtaining the first demand instruction of the frequent user, the following steps are included:
[0124] Collecting the first vital sign information of the current user;
[0125] Comparing and identifying the first physical sign information with at least one physical sign information in a preset physical sign library;
[0126] When the first physical sign information is compared and is consistent with the physical sign information in the preset physical sign library, determining that the current user is a frequent user;
[0127] When the first physical sign information is inconsistent with the physical sign information in the preset physical sign library, determining that the current user is an abnormal user;
[0128] Record and save the vital signs information of the abnormal user and generate alarm information;
[0129] The vital sign information of the abnormal user and the alarm information are sent to a preset user terminal.
[0130] As mentioned above, when someone enters the room, the user's vital signs are first identified through pupil recognition or voice recognition photo comparison, where the user's vital signs information includes the user's voice, or the user's facial lines or pupil lines, etc., and the obtained user vital signs are compared with the vital signs information in the pre-set user vital signs library to confirm whether the person who comes back is a frequent user. If so, the frequent user will be served. If not, the vital signs of the person coming in will be photographed, and an alarm message will be generated. The vital signs of the person coming in and the alarm message will be sent to the bound user to confirm whether it is a stranger who breaks in. The APP in the user's mobile phone has an alarm and vibration prompt function. Therefore, the user can confirm whether an alarm is needed in the first time, which can play a role in safety and anti-theft.
[0131] Reference Figure 2 , is a holographic projection device based on a sweeper platform in this embodiment, which includes:
[0132] The first instruction acquisition module 100 is used to acquire the first demand instruction of the frequent user;
[0133] A first keyword acquisition module 200 is used to extract first keyword information according to the first demand instruction of the frequent user;
[0134] A matching module 300, used to match the first keyword information with words in a preset working vocabulary;
[0135] A working video acquisition module 400, configured to acquire a working video matching the first keyword information when the first keyword information matches a word in the preset working vocabulary;
[0136] A first projection module 500 is used to project and play the working video based on holographic projection to generate a first projection image;
[0137] The marking feature acquisition module 600 is used to obtain the marking features of the common users by using a preset mode after the projection is played;
[0138] A marking region acquisition module 700, configured to obtain a marking region based on the marking feature and in combination with the projection image;
[0139] Cleaning module 800, used to control the sweeper to perform deep cleaning on the marked area
[0140] Reference Figure 3 In the embodiment of the present disclosure, a computer device is also provided. The computer device may be a server, and its internal structure may be as follows: Figure 3 As shown. The computer device includes a processor, a memory, a network interface and a database connected via a system bus. Among them, the processor designed by the computer is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store holographic projection data based on a sweeper platform, etc. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a holographic projection method based on a sweeper platform is implemented.
[0141] Those skilled in the art will understand that Figure 3 The structure shown in is merely a block diagram of a portion of the structure related to the disclosed solution and does not constitute a limitation on the computer device to which the disclosed solution is applied.
[0142] An embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a holographic projection method based on a sweeper platform is implemented. It can be understood that the computer-readable storage medium in this embodiment can be a volatile readable storage medium or a non-volatile readable storage medium.
[0143] In summary, the holographic projection method, device, equipment and medium based on the sweeping machine platform provided in the embodiments of the present invention can utilize the function of holographic projection to project the entire room image through the sweeping machine, and use the pupil recognition module, gesture recognition module or voice recognition module to mark the required cleaning area in the room image, and the sweeping machine will automatically clean according to the marked points. At the same time, more entertainment functions are also set on the sweeping machine. Some colorful pictures and fast-paced music can be played while playing games, or the user can project fitness videos through the sweeping machine. The sweeping machine locks the user's front through the pupil recognition module, and can record the user's movements at all times, which is convenient for the user to learn while checking or correcting his movements. The function is very powerful.
[0144] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing related hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media provided by the present disclosure and used in the embodiments may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
[0145] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, device, article or method. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, device, article or method including the element.
[0146] The above description is only a preferred embodiment of the present disclosure, and does not limit the patent scope of the present disclosure. Any equivalent structure or equivalent process transformation made using the contents of the present disclosure and the drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present disclosure.
Claims
1. A holographic projection method based on a sweeper platform, characterized in that: The method comprises: Get the first demand instructions of frequent users; Extracting first keyword information according to the first demand instruction of the frequent user; Matching the first keyword information with words in a preset working vocabulary; When the first keyword information matches a word in the preset working vocabulary, obtaining a working video matching the first keyword information; Projecting and playing the working video based on holographic projection to generate a first projection image; After the projection is played, the marking features of the common user are obtained by using a preset mode; Based on the marking feature and in combination with the projection image, obtaining a marking area; Controlling the sweeper to perform deep cleaning on the marked area; After the step of extracting the first keyword information according to the first demand instruction of the frequent user, the method further comprises: Matching the first keyword information with words in a preset entertainment vocabulary; When the first keyword information matches a word in a preset entertainment vocabulary, obtaining media content matching the first keyword information; Projecting and playing the media content based on holographic projection to generate a second projection image; Obtaining a selfie instruction of the frequent user; According to the selfie instruction, the frequently used user is locked and photographed to generate a selfie video; The selfie video and the media content are projected and played together to generate a third projection image.
2. The holographic projection method based on the sweeper platform according to claim 1 is characterized in that: When the preset mode is a gesture recognition mode, the step of obtaining the marker features of the common user by using the preset mode includes: Acquire and analyze the first gesture instruction of the frequent user; When the first gesture instruction of the common user matches the preset gesture wake-up instruction, waking up the gesture recognition mode; Continuing to track and identify a second gesture instruction of the frequent user; The second gesture instruction is parsed to generate a marking feature of the frequent user.
3. The holographic projection method based on the sweeper platform according to claim 1 is characterized in that: When the preset mode is the pupil recognition mode, the step of obtaining the user's marking features by using the preset mode includes: Acquire and parse the first pupil instruction of the common user; When the first pupil instruction of the common user matches the preset pupil awakening instruction, awakening the pupil recognition mode; Continue to track and identify the second pupil instruction of the frequent user; The second pupil instruction is parsed to generate a marking feature of the common user.
4. The holographic projection method based on the sweeper platform according to claim 1, characterized in that: When the preset mode is the speech recognition mode, the step of obtaining the user's marking features by using the preset mode includes: Acquire a first voice command issued by the frequent user; When the first voice command of the frequent user matches the preset voice wake-up command, waking up the voice recognition mode; Acquire a second voice command issued by the frequent user; Extracting keyword information contained in the voice command based on voice recognition; The keyword information is parsed to generate the marking features of the frequent users.
5. The holographic projection method based on the sweeper platform according to claim 1, characterized in that: After the step of obtaining the marked area based on the marked feature and in combination with the projection image, the method further includes: Obtaining a zoom-in instruction of the frequent user; The marked area is enlarged by a preset multiple according to the enlargement instruction.
6. The holographic projection method based on the sweeper platform according to claim 1, characterized in that: Before the step of obtaining the first demand instruction of the frequent user, the method includes: Collecting the first vital sign information of the current user; Comparing and identifying the first physical sign information with at least one physical sign information in a preset physical sign library; When the first physical sign information is compared and consistent with the physical sign information in the preset physical sign library, determining that the current user is a frequent user; When the first physical sign information is inconsistent with the physical sign information in the preset physical sign library, determining that the current user is an abnormal user; Record and save the vital signs information of the abnormal user and generate alarm information; The vital sign information of the abnormal user and the alarm information are sent to a preset user terminal.
7. A holographic projection device based on a sweeper platform, used to implement the method according to any one of claims 1 to 6, characterized in that: include: A first instruction acquisition module, used to acquire the first demand instruction of a frequent user; A first keyword acquisition module, used to extract first keyword information according to the first demand instruction of the frequent user; A matching module, used for matching the first keyword information with words in a preset working vocabulary; A work video acquisition module, configured to acquire a work video matching the first keyword information when the first keyword information matches a word in the preset work vocabulary; A first projection module, used for projecting and playing the working video based on holographic projection to generate a first projection image; A marking feature acquisition module, used to obtain the marking features of the common users by using a preset mode after projection playback; A marking area acquisition module, used to obtain a marking area based on the marking feature and in combination with the projection image; The cleaning module is used to control the sweeper to perform deep cleaning on the marked area.
8. A computer device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the processor executes the computer program, the steps of the holographic projection method based on the sweeper platform described in any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the holographic projection method based on a sweeper platform described in any one of claims 1 to 6 are implemented.
