A method and apparatus for interactive entertainment with a laser radar and projection
Patent Information
- Application Number
- CN202311092593.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-28
- Publication Date
- 2026-10-20
- Estimated Expiration
- 2043-08-28
AI Technical Summary
[0002]随着科技发展,人们对于娱乐方式的选择越来越多,而多数娱乐方式都极大的限制了现代人的运动量,因此,需要一种能够结合娱乐和运动的交互娱乐方式
[0040]本发明实施例中,首先通过投影设备和激光雷达分别在地面上投射出检测区域和显示区域,并调整激光雷达的检测区域完全覆盖显示区域,确保显示区域的每个角落都能被用户检测触发,显示区域用于显示不同的游戏类型为用户提供多种娱乐游戏,用户点击显示区域中的按键的行为被激光雷达识别并检测到,将对应的触发信号发送至交互程序中完成交互。使得娱乐活动的互动形式更加丰富,在增加游玩趣味的同时带动用户进行运动。
Smart Images

Figure CN117122892B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of computer technology, and in particular to an interactive entertainment method and device combining lidar and projection. Background Technology
[0002] With the development of technology, people have more and more choices for entertainment, but most entertainment options greatly limit the amount of exercise modern people can do. Therefore, there is a need for an interactive entertainment method that can combine entertainment and exercise. Summary of the Invention
[0003] To address the aforementioned technical problems, the first aspect of this invention discloses an interactive entertainment method combining lidar and projection, the method comprising:
[0004] The laser radar projects a detection area on the ground for detecting interactive behavior, and the projection device projects a display area on the ground for displaying the interactive program.
[0005] Adjust the detection area so that its coverage area is the same as the display area;
[0006] Obtain the coordinate system of the detection area, and convert the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system;
[0007] After detecting the interaction signal returned from the set of trigger coordinates, a corresponding instruction is issued to the interaction program.
[0008] In one embodiment, when detecting the interaction signal returned from the set of trigger coordinates, the method further includes:
[0009] Build a behavior library containing several interactive behaviors, each interactive behavior including corresponding triggering logic;
[0010] The interactive behavior corresponding to the launcher is locked from the behavior library so that the triggering unit can only trigger the interactive behavior;
[0011] When the lidar starts returning interaction signals, it is determined whether the interaction signals meet the triggering logic of the interaction behavior. If they do, the corresponding interaction behavior is executed; otherwise, it is not executed.
[0012] In one embodiment, the interactive behavior includes basic actions and composite actions; the composite action consists of several basic actions and action connection logic relationships, the action connection logic relationships include interval time, sequence, parallel actions, branch routes, mutually exclusive routes, and random routes.
[0013] The behavior library includes a preset unit time Δt, and the basic actions include tap, long press, jump, and run;
[0014] The trigger logic for the tap is as follows: when the trigger point detects an interaction signal in the initial state, a tap operation is performed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the trigger point is restored to the initial state; if an interaction signal is detected within a unit time Δt, the current time is updated to t0.
[0015] The trigger logic for long press is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the long press operation is continuously executed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the long press operation is stopped and the trigger point is restored to the initial state.
[0016] The triggering logic for the jump is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the current time is updated to t0. Based on t0, if an interaction signal is detected between the unit time Δt and 2Δt, the jump operation is executed, and the trigger point is restored to the initial state.
[0017] The running trigger logic is to simultaneously determine two trigger points in the initial state. When one trigger point detects an interaction signal, the current time is updated to t0. Based on t0, if the other trigger point detects an interaction signal within a unit time Δt, the running operation is executed.
[0018] In one embodiment, the interaction signals include signals that trigger the lidar and signals that allow the user to leave the lidar.
[0019] In one embodiment, when obtaining the coordinate system of the detection area and converting the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system, the method further includes:
[0020] The coordinates of the interactive button that are at a preset distance from the edge in the trigger coordinate set are filtered out from the trigger coordinate set to avoid accidental contact with the interactive button.
[0021] In one embodiment, the coordinate system of the detection area is obtained, and the coordinate values corresponding to the interactive button area in the projection area are converted into a set of trigger coordinates in the coordinate system. The method further includes:
[0022] The system acquires the raw position data coordinates of the interactive signals detected by the lidar in real time. The returned raw position data coordinates are represented in polar coordinates (r, θ), and the polar coordinates are converted into Cartesian coordinates (x, y).
[0023] A second aspect of the present invention discloses an interactive entertainment device combining lidar and projection, the device comprising:
[0024] LiDAR, which is used to project a detection area on the ground for detecting interactive behavior;
[0025] Projection equipment, used to project a display area on the ground for displaying interactive programs;
[0026] An adjustment module is used to adjust the detection area so that the coverage of the detection area is the same as that of the display area;
[0027] The conversion module is used to obtain the coordinate system of the detection area and convert the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system.
[0028] The detection module is used to determine whether the interaction signal conforms to the triggering logic of the interaction behavior when the lidar starts to return an interaction signal. If it does, the corresponding interaction behavior is executed; otherwise, it is not executed.
[0029] In one embodiment, the detection module further includes:
[0030] The building unit is used to build a behavior library containing several interactive behaviors, wherein the interactive behaviors include corresponding triggering logic;
[0031] A locking unit is used to lock the interactive behavior corresponding to the launcher from the behavior library, so that the triggering unit can only trigger the interactive behavior;
[0032] The judgment unit is used to determine whether the interaction signal conforms to the triggering logic of the interaction behavior when the lidar starts to return the interaction signal. If it does, the corresponding interaction behavior is executed; otherwise, it is not executed.
[0033] In one embodiment, the judgment unit further includes a preset unit time Δt and a behavior library. The behavior library includes basic actions and compound actions. The basic actions include tapping, long pressing, jumping, and running. The compound actions are composed of several basic actions and action connection logic relationships. The action connection logic relationships include interval time, sequence, parallel actions, branch routes, mutually exclusive routes, and random routes.
[0034] The trigger logic for the tap is as follows: when the trigger point detects an interaction signal in the initial state, a tap operation is performed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the trigger point is restored to the initial state; if an interaction signal is detected within a unit time Δt, the current time is updated to t0.
[0035] The trigger logic for long press is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the long press operation is continuously executed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the long press operation is stopped and the trigger point is restored to the initial state.
[0036] The triggering logic for the jump is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the current time is updated to t0. Based on t0, if an interaction signal is detected between the unit time Δt and 2Δt, the jump operation is executed, and the trigger point is restored to the initial state.
[0037] The running trigger logic is to simultaneously determine two trigger points in the initial state. When one trigger point detects an interaction signal, the current time is updated to t0. Based on t0, if the other trigger point detects an interaction signal within a unit time Δt, the running operation is executed.
[0038] In one embodiment, the conversion module further includes a filtering unit, which is used to filter out the coordinates of the interactive button and the edge that are at a preset distance from the trigger coordinate set, so as to avoid accidental contact of the interactive button.
[0039] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
[0040] In this embodiment of the invention, a detection area and a display area are first projected onto the ground using a projection device and a LiDAR, respectively. The LiDAR's detection area is adjusted to completely cover the display area, ensuring that every corner of the display area can be detected and triggered by the user. The display area is used to show different game types, providing users with a variety of entertainment games. The user's action of clicking buttons in the display area is recognized and detected by the LiDAR, and the corresponding trigger signal is sent to the interactive program to complete the interaction. This makes the interactive forms of entertainment activities richer, increasing the fun of playing while encouraging users to exercise.
[0041] This invention also configures a behavior library to judge the user's interaction signals when the user triggers the action, thereby determining the type of user interaction behavior. By configuring the behavior library, this invention can be adapted to various types of games, while improving the detection accuracy and effectively enhancing the gaming experience. Attached Figure Description
[0042] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0043] Figure 1This is a flowchart illustrating an interactive entertainment method combining lidar and projection, as disclosed in an embodiment of the present invention.
[0044] Figure 2 This is a schematic diagram of the structure of an interactive entertainment device combining a lidar and a projector, as disclosed in an embodiment of the present invention. Detailed Implementation
[0045] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0046] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.
[0047] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0048] This invention discloses an interactive entertainment method, device, terminal, and storage medium using lidar and projection. First, a detection area and a display area are projected onto the ground using a projection device and lidar, respectively. The lidar's detection area is adjusted to completely cover the display area, ensuring that every corner of the display area can be detected and triggered by the user. The display area shows different game types, providing users with various entertainment options. The lidar recognizes and detects the user's clicks on buttons in the display area, sending the corresponding trigger signal to the interactive program to complete the interaction. This enriches the interactive forms of entertainment activities, increasing the fun while encouraging user movement. Furthermore, this invention configures a behavior library to judge the user's interaction signal when triggering, determining the type of user interaction behavior. This behavior library allows the invention to adapt to various game types, improving detection accuracy and effectively enhancing the gaming experience. These are described in detail below.
[0049] Example 1
[0050] Please see Figure 1 , Figure 1 This is a flowchart illustrating an interactive entertainment method combining lidar and projection, as disclosed in an embodiment of the present invention. Figure 1 As shown, the interactive entertainment method between the lidar and the projection can include the following operations:
[0051] 101 The laser radar projects a detection area on the ground for detecting interactive behavior, and the projection device projects a display area on the ground for displaying the interactive program.
[0052] 102. Adjust the detection area so that its coverage is the same as the display area;
[0053] 103. Obtain the coordinate system of the detection area, and convert the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system;
[0054] After detecting the interaction signal returned from the set of trigger coordinates, 104 issues a corresponding instruction to the interaction program.
[0055] In one embodiment, when detecting the interaction signal returned from the set of trigger coordinates, the method further includes:
[0056] 1041 Build a behavior library containing several interactive behaviors, wherein the interactive behaviors include corresponding triggering logic;
[0057] In one embodiment, the behavior library includes a preset unit time Δt to simulate continuous triggering in discrete time. It is understood that the unit time Δt is configured with several different durations. Since different age groups and physical conditions result in different reaction times, the reaction time to button triggers varies during gameplay. Therefore, it is necessary to differentiate the unit time Δt to meet the average reaction time of people with different age groups and physical conditions.
[0058] 1042. The system locks the interactive behavior corresponding to the launched program from the behavior library, ensuring that the triggering unit can only trigger the aforementioned interactive behavior. Since different programs require different actions—for example, sports games require players to run or do burpees, while chess and quiz games require players to tap on the projected screen to select the correct answer—the system pre-locks the interactive signals that can be triggered based on different game programs. Each triggering unit contains one or more trigger points, and each triggering unit can only trigger one or more actions set by the program during a specific phase of the program's execution. This ensures that the program can accurately and quickly identify and judge the player's actions.
[0059] 1043 When the lidar starts to return an interaction signal, determine whether the interaction signal meets the triggering logic of the interaction behavior. If it does, execute the corresponding interaction behavior; otherwise, do not execute it.
[0060] Specifically, in one embodiment, the interactive behavior includes basic actions and compound actions; the compound actions consist of several basic actions and action connection logic, and the basic actions include tapping, long pressing, jumping, and running.
[0061] The trigger logic for the tap is as follows: when the trigger point detects an interaction signal in the initial state, a tap operation is performed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the trigger point is restored to the initial state; if an interaction signal is detected within a unit time Δt, the current time is updated to t0.
[0062] The trigger logic for long press is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the long press operation is continuously executed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the long press operation is stopped and the trigger point is restored to the initial state.
[0063] The triggering logic for the jump is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the current time is updated to t0. Based on t0, if an interaction signal is detected between the unit time Δt and 2Δt, the jump operation is executed, and the trigger point is restored to the initial state.
[0064] The running trigger logic is to simultaneously determine two trigger points A and B in the initial state. When one of the trigger points detects an interaction signal, the current time is updated to t0. Based on t0, if the other trigger point detects an interaction signal within a unit time Δt, the running operation is executed.
[0065] Understandably, complex physical training or game interactions can generally be viewed as permutations and combinations of these basic movements. Furthermore, each movement requires a signal from the program to be detected for interaction; this behavior is called "enabling," and the opposite behavior is called "disabling." Complex movements are as follows:
[0066] Burpees are a type of strength training exercise that combines multiple movements in the following order: squat, plank, tuck, squat, and vertical jump. This exercise utilizes basic movements such as holding down, tapping, and jumping, along with their sequential order and simultaneous execution.
[0067] Coordinated stepping requires the user to place one foot in a designated position and touch the indicated area with the other foot to trigger the interaction. This employs basic actions such as long press and tap, with the order of these actions supplemented by random logical connections.
[0068] Cross lunge: The cross lunge requires the user to alternately trigger two sets of trigger units, each set containing two trigger points. It employs the basic action of tapping, with a sequential and simultaneous execution, supplemented by mutually exclusive logical connections.
[0069] In one embodiment, the action connection logic includes interval time, sequence, parallel actions, branching paths, mutually exclusive paths, and random paths. The interval time is used to activate the next action after a certain period of time. The sequence is used to activate the next action after completing the previous stage, and actions are considered as multiple actions that can be satisfied simultaneously. The branching path is used when actions A and B are activated simultaneously. When action A is completed, action C is activated; when action B is completed, action D is activated. The mutually exclusive path ensures that if one of actions A or B is activated, the other is always disabled. The random path randomly selects the next action to be activated from the action library container after an action is completed.
[0070] In one embodiment, the interaction signal includes a signal that the user triggers the lidar and a signal that the user leaves the lidar. It is understood that, for actions such as jumping, leaving the lidar range triggers an interaction signal once, and returning to the lidar triggers another interaction signal, thus enabling the program to recognize the player's actions and provide feedback. In one implementation, when obtaining the coordinate system of the detection area and converting the coordinate values corresponding to the interactive buttons in the projection area into several sets of trigger coordinates in the coordinate system, the method further includes:
[0071] The coordinates of the interactive button that are at a preset distance from the edge in the trigger coordinate set are filtered out from the trigger coordinate set to avoid accidental contact with the interactive button.
[0072] One implementation method involves obtaining the coordinate system of the detection area, converting the coordinate values corresponding to the interactive button area in the projection area into a set of trigger coordinates within the coordinate system, and further including:
[0073] The system acquires the raw position data of the interactive signals detected by the lidar in real time, and the returned radar point coordinates are represented in polar coordinates (r, θ), and then converts the polar coordinates into Cartesian coordinates (x, y).
[0074] The embodiments of the present invention have at least the following beneficial effects:
[0075] (1) It fully combines sports and games, increases the interactive ways of games, and adds fun to the game for users.
[0076] (2) User interaction action recognition is more accurate. It can set up a behavior library according to the interaction action requirements of different games, and more accurately identify user operations, thereby improving user experience.
[0077] (3) The display area can project different types of games, including trivia, sports, and competitive games. The LiDAR converts the user's trigger signal into interactive actions, thereby satisfying the interaction of any game and providing users with more entertainment options.
[0078] It is evident that implementation Figure 1 The described interactive entertainment method using lidar and projection first projects a detection area and a display area onto the ground using a projection device and lidar, respectively. The lidar's detection area is adjusted to completely cover the display area, ensuring that every corner of the display area can be detected and triggered by the user. The display area shows different game types, providing users with a variety of entertainment options. When a user clicks a button in the display area, the lidar recognizes and detects the action, sending the corresponding trigger signal to the interactive program to complete the interaction. This enriches the interactive forms of entertainment activities, increasing the fun while encouraging user movement. Furthermore, this invention configures a behavior library to judge the user's interaction signal when triggering actions, determining the type of user interaction. By configuring the behavior library, this invention can adapt to various game types, improving detection accuracy and effectively enhancing the gaming experience.
[0079] Example 2
[0080] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of an interactive entertainment device combining a lidar and a projector, as disclosed in an embodiment of the present invention. Figure 2As shown, the interactive entertainment device combining lidar and projection may include:
[0081] LiDAR 201 is used to project a detection area on the ground for detecting interactive behavior;
[0082] Projection device 202, which is used to project a display area on the ground for displaying interactive programs;
[0083] Adjustment module 203 is used to adjust the detection area so that the coverage of the detection area is the same as that of the display area;
[0084] The conversion module 204 is used to obtain the coordinate system of the detection area and convert the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system.
[0085] The detection module 205 is used to issue corresponding instructions to the interaction program after the lidar detects the interaction signal in the set of trigger coordinates.
[0086] In one embodiment, the detection module further includes:
[0087] The building unit is used to build a behavior library containing several interactive behavior configuration data, including trigger duration and trigger logic;
[0088] The judgment unit is used to call the behavior library to determine whether the interaction signal conforms to the interaction behavior configuration data when the lidar returns an interaction signal. If it conforms, the interaction signal is identified as an interaction behavior; otherwise, it is identified as an invalid behavior.
[0089] In one embodiment, the detection module further includes:
[0090] The building unit is used to build a behavior library containing several interactive behaviors, wherein the interactive behaviors include corresponding triggering logic;
[0091] A locking unit is used to lock the interactive behavior corresponding to the launcher from the behavior library, so that the triggering unit can only trigger the interactive behavior;
[0092] The judgment unit is used to determine whether the interaction signal conforms to the triggering logic of the interaction behavior when the lidar starts to return the interaction signal. If it does, the corresponding interaction behavior is executed; otherwise, it is not executed.
[0093] In one embodiment, the judgment unit further includes a preset unit time Δt and a behavior library. The behavior library includes basic actions and compound actions. The basic actions include tapping, long pressing, jumping, and running. The compound actions are composed of several basic actions and action connection logic relationships. The action connection logic relationships include interval time, sequence, parallel actions, branch routes, mutually exclusive routes, and random routes.
[0094] The trigger logic for the tap is as follows: when the trigger point detects an interaction signal in the initial state, a tap operation is performed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the trigger point is restored to the initial state; if an interaction signal is detected within a unit time Δt, the current time is updated to t0.
[0095] The trigger logic for long press is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the long press operation is continuously executed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the long press operation is stopped and the trigger point is restored to the initial state.
[0096] The triggering logic for the jump is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the current time is updated to t0. Based on t0, if an interaction signal is detected between the unit time Δt and 2Δt, the jump operation is executed, and the trigger point is restored to the initial state.
[0097] The running trigger logic is to simultaneously determine two trigger points in the initial state. When one trigger point detects an interaction signal, the current time is updated to t0. Based on t0, if the other trigger point detects an interaction signal within a unit time Δt, the running operation is executed.
[0098] In one embodiment, the conversion module further includes a filtering unit, which is used to filter out coordinates in the trigger coordinate set where the distance between the interactive button and the edge is a preset value, to avoid accidental contact with the interactive button. For a detailed description of the interactive entertainment device using LiDAR and projection, please refer to the detailed description of the interactive entertainment method using LiDAR and projection, which will not be repeated here.
[0099] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the methods for rapid repair through SDK version mixing described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0100] Alternatively, if the integrated units of this invention are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this invention, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, terminal, or network device, etc.) to execute all or part of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, RAM, ROM, magnetic disks, or optical disks.
[0101] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0102] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0103] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
[0104] Finally, it should be noted that the interactive entertainment method and apparatus for lidar and projection disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention and are only used to illustrate the technical solutions of the present invention, not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. An interactive entertainment method combining lidar and projection, characterized in that, The method includes a lidar and a projection device, and comprises: The laser radar projects a detection area on the ground for detecting interactive behavior, and the projection device projects a display area on the ground for displaying the interactive program. Adjust the detection area so that its coverage area is the same as the display area; Obtain the coordinate system of the detection area, and convert the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system; After detecting the interaction signal returned from the set of trigger coordinates, a corresponding instruction is issued to the interaction program; The detection of the interaction signal returned from the set of trigger coordinates also includes; Build a behavior library containing several interactive behaviors, each interactive behavior including corresponding triggering logic; The interactive behavior corresponding to the launcher is locked from the behavior library so that the triggering unit can only trigger the interactive behavior; When the lidar starts returning interaction signals, it is determined whether the interaction signals meet the triggering logic of the interaction behavior. If they do, the corresponding interaction behavior is executed; otherwise, it is not executed. The interaction behavior includes basic actions and compound actions. The compound action consists of several basic actions and action connection logic relationships. The action connection logic relationships include interval time, sequence, parallel actions, branch routes, mutually exclusive routes, and random routes. The behavior library includes a preset unit time Δt, and the basic actions include tap, long press, jump, and run; The trigger logic for the tap is as follows: when the trigger point detects an interaction signal in the initial state, a tap operation is performed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the trigger point is restored to the initial state; if an interaction signal is detected within a unit time Δt, the current time is updated to t0. The trigger logic for long press is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the long press operation is continuously executed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the long press operation is stopped and the trigger point is restored to the initial state. The triggering logic for the jump is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the current time is updated to t0. Based on t0, if an interaction signal is detected between the unit time Δt and 2Δt, the jump operation is executed, and the trigger point is restored to the initial state. The running trigger logic is to simultaneously determine two trigger points in the initial state. When one trigger point detects an interaction signal, the current time is updated to t0. Based on t0, if the other trigger point detects an interaction signal within a unit time Δt, the running operation is executed.
2. The interactive entertainment method of lidar and projection according to claim 1, characterized in that, The interaction signals include signals that trigger the lidar and signals that allow the user to leave the lidar.
3. The interactive entertainment method of lidar and projection according to claim 1, characterized in that, When obtaining the coordinate system of the detection area and converting the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system, the method further includes: The coordinates of the interactive button that are at a preset distance from the edge in the trigger coordinate set are filtered out from the trigger coordinate set to avoid accidental contact with the interactive button.
4. The interactive entertainment method of lidar and projection according to claim 1, characterized in that, Obtain the coordinate system of the detection area, and convert the coordinate values corresponding to the interactive button area in the projection area into several sets of trigger coordinates in the coordinate system, further including: The system acquires the raw position data coordinates of the interactive signals detected by the lidar in real time. The returned raw position data coordinates are represented in polar coordinates (r, θ), and the polar coordinates are converted into Cartesian coordinates (x, y).
5. A laser radar and projection interactive entertainment device for implementing the interactive entertainment method of laser radar and projection according to any one of claims 1-4, characterized in that, The device includes: LiDAR, which is used to project a detection area on the ground for detecting interactive behavior; Projection equipment, used to project a display area on the ground for displaying interactive programs; An adjustment module is used to adjust the detection area so that the coverage of the detection area is the same as that of the display area; The conversion module is used to obtain the coordinate system of the detection area and convert the coordinate values corresponding to the interactive buttons in the projection area into a set of trigger coordinates in the coordinate system. The detection module is used to determine whether the interaction signal conforms to the triggering logic of the interaction behavior when the lidar starts to return an interaction signal. If it does, the corresponding interaction behavior is executed; otherwise, it is not executed.
6. The interactive entertainment device combining lidar and projection according to claim 5, characterized in that, The detection module also includes: The building unit is used to build a behavior library containing several interactive behaviors, wherein the interactive behaviors include corresponding triggering logic; A locking unit is used to lock the interactive behavior corresponding to the launcher from the behavior library, so that the triggering unit can only trigger the interactive behavior; The judgment unit is used to determine whether the interaction signal conforms to the triggering logic of the interaction behavior when the lidar starts to return the interaction signal. If it does, the corresponding interaction behavior is executed; otherwise, it is not executed.
7. The interactive entertainment device combining lidar and projection according to claim 6, characterized in that, The judgment unit also includes a preset unit time Δt and a behavior library. The behavior library includes basic actions and compound actions. The basic actions include tap, long press, jump, and run. The compound actions are composed of several basic actions and action connection logic relationships. The action connection logic relationships include interval time, sequence, parallel actions, branch routes, mutually exclusive routes, and random routes. The triggering logic for the tap is as follows: when the trigger point detects an interaction signal in the initial state, the tap operation is performed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the trigger point is restored to the initial state. If an interaction signal is detected within a unit time Δt, then update the current time to t0; The trigger logic for long press is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the long press operation is continuously executed and the current time is updated to t0. Based on t0, if no interaction signal is detected within a unit time Δt, the long press operation is stopped and the trigger point is restored to the initial state. The triggering logic for the jump is as follows: when the trigger point is in the initial state, if an interaction signal is detected, the current time is updated to t0. Based on t0, if an interaction signal is detected between the unit time Δt and 2Δt, the jump operation is executed, and the trigger point is restored to the initial state. The running trigger logic is to simultaneously determine two trigger points in the initial state. When one trigger point detects an interaction signal, the current time is updated to t0. Based on t0, if the other trigger point detects an interaction signal within a unit time Δt, the running operation is executed.
8. The interactive entertainment device combining lidar and projection according to claim 5, characterized in that, The conversion module also includes a filtering unit, which is used to filter out the coordinates of the interactive buttons and the edge that are at a preset distance from the trigger coordinate set, so as to avoid accidental contact of the interactive buttons.
Citation Information
Patent Citations
Human body behavior identification method and device, computer equipment and storage medium
CN110231605A
Multi-person multi-point interactive projection system based on solid-state laser radar
CN111309186A