Projection method and system based on electric holder and electronic equipment

Abstract

The invention relates to a projection method based on an electric holder, and the method comprises the steps: obtaining the environment data of a projection scene where a projector is located, generating a scene coordinate system based on the environment data, obtaining the holder coordinate of the electric holder on the projector and the wall coordinate data of the projection scene, recognizing a motion track corresponding to the audio-visual data, and carrying out the recognition of the motion track. Based on the movement track, the holder coordinates and the wall coordinate data, rotation parameters of the electric holder are determined, the rotation parameters comprise the rotation direction and the rotation angle, and the electric holder is controlled to rotate based on the rotation parameters while the audio-visual data are played. Through the application, the problem of poor projection interaction experience is solved, the rotation parameter of the electric holder is determined based on the audio-visual data, and the projection picture is driven to move through the rotation of the electric holder, so that the purpose of dynamically presenting the projection picture along with the audio-visual data is achieved, and the projection interaction experience is improved.

Description

Technical Field

[0001] This application relates to the field of intelligent control, and particularly to a projection method, system, and electronic device based on an electric pan-tilt head. Background Art

[0002] In a traditional projection interaction system, a projection device is usually fixedly installed or only supports limited physical adjustments (such as manual rotation), and the position of the projected content hardly changes. However, this static or semi-static projection method has certain limitations in terms of interactivity and interestingness, and it is difficult to achieve dynamic and flexible physical space interaction effects.

[0003] Currently, no effective solution has been proposed for the problem of poor projection interaction experience in related technologies. Summary of the Invention

[0004] Embodiments of this application provide a projection method, system, electronic device, and storage medium based on an electric pan-tilt head to at least solve the problem of poor projection interaction experience in related technologies.

[0005] In a first aspect, embodiments of this application provide a projection method based on an electric pan-tilt head, the method including:

[0006] Obtain environmental data of a projection scene where a projector is located, generate a scene coordinate system based on the environmental data, and obtain the pan-tilt head coordinates of the electric pan-tilt head on the projector and the wall coordinate data of the projection scene;

[0007] Identify a motion trajectory corresponding to audiovisual data;

[0008] Based on the motion trajectory, the pan-tilt head coordinates, and the wall coordinate data, determine rotation parameters of the electric pan-tilt head, where the rotation parameters include a rotation direction and a rotation angle;

[0009] While playing the audiovisual data, control the electric pan-tilt head to rotate based on the rotation parameters.

[0010] In some embodiments, the audiovisual data includes game data, and the identifying a motion trajectory corresponding to audiovisual data includes:

[0011] Identify a game image of the game data, and obtain angle change data of a first-person view in the game image;

[0012] According to the angle change data, determine the motion trajectory of the electric pan-tilt head.

[0013] In some embodiments, the audiovisual data includes audio data; the identifying a motion trajectory corresponding to audiovisual data includes:

[0014] Identify the audio data to obtain beat data and pitch data;

[0015] Determine a speed parameter sequence and a motion direction sequence of the projection target according to the beat data;

[0016] Determine a vibration parameter sequence of the projection target according to the pitch data, where the vibration parameter sequence includes a vibration frequency sequence and a vibration amplitude sequence;

[0017] Generate a motion trajectory of the projection target based on the speed parameter sequence, the motion direction sequence, and the vibration parameter sequence.

[0018] In some embodiments, the method further includes:

[0019] Identify the audio data to obtain a melody style;

[0020] Determine a motion pattern of the projection target based on the melody style, where the motion pattern includes a wave motion, a spiral motion, and a bouncing motion.

[0021] In some embodiments, the audiovisual data includes video data, and the video data includes a reference object of the projection target; the identifying the motion trajectory corresponding to the audiovisual data includes:

[0022] Identify the video data to obtain the motion trajectory of the reference object;

[0023] Generate the motion trajectory of the projection target based on the motion trajectory of the reference object.

[0024] In some embodiments, the obtaining the environmental data of the projection scene where the projector is located includes:

[0025] Obtain image data of the projection scene through a camera device carried by the electric pan-tilt head, and obtain the environmental data based on the image data; and / or

[0026] Scan the projection scene through a distance measuring sensor carried by the electric pan-tilt head to obtain the environmental data.

[0027] In some embodiments, the method further includes:

[0028] Analyze the environmental data to determine whether there are obstacles. If so, determine the obstacle coordinates,

[0029] Based on the wall coordinate data, construct a virtual projection canvas, and mark non-projectable areas in the virtual projection canvas according to the obstacle coordinates.

[0030] In some embodiments, the method further includes:

[0031] During the projection process, the imaging data of the projection target is obtained by the imaging device carried by the electric pan-tilt head.

[0032] Compare the projection imaging data with the motion trajectory to determine whether there is an abnormality in the projection of the projection target.

[0033] In a second aspect, an embodiment of the present application provides a projection system based on an electric pan-tilt head, the system includes:

[0034] A data acquisition module, configured to acquire environmental data of the projection scene where the projector is located, generate a scene coordinate system based on the environmental data, and obtain the pan-tilt head coordinates of the electric pan-tilt head on the projector and the wall coordinate data of the projection scene.

[0035] An identification module, configured to identify the motion trajectory corresponding to the audio-visual data.

[0036] A parameter determination module, configured to determine the rotation parameters of the electric pan-tilt head based on the motion trajectory, the pan-tilt head coordinates, and the wall coordinate data, where the rotation parameters include a rotation direction and a rotation angle.

[0037] A projection module, configured to control the rotation of the electric pan-tilt head based on the rotation parameters while playing the audio-visual data.

[0038] In a third aspect, an embodiment of the present application provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the projection method based on the electric pan-tilt head described in the first aspect above is implemented.

[0039] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the projection method based on the electric pan-tilt head described in the first aspect above is implemented.

[0040] Compared with the related art, the projection method based on the electric pan-tilt head provided by the embodiment of the present application obtains the environmental data of the projection scene where the projector is located, generates a scene coordinate system based on the environmental data, obtains the pan-tilt head coordinates of the electric pan-tilt head on the projector and the wall coordinate data of the projection scene, identifies the motion trajectory corresponding to the audio-visual data, determines the rotation parameters of the electric pan-tilt head based on the motion trajectory, the pan-tilt head coordinates, and the wall coordinate data, where the rotation parameters include a rotation direction and a rotation angle, and controls the rotation of the electric pan-tilt head based on the rotation parameters while playing the audio-visual data, solving the problem of poor projection interaction experience. Determining the rotation parameters of the electric pan-tilt head based on the audio-visual data, driving the projection screen to move through the rotation of the electric pan-tilt head, so as to achieve the purpose of dynamically presenting the projection screen following the audio-visual data, and improving the projection interaction experience. Brief Description of the Drawings

[0041] The drawings described herein are provided to further understand the present application and form a part of the present application. The schematic embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation to the present application. In the drawings:

[0042] Figure 1 is a flowchart of a projection method based on an electric pan-tilt according to an embodiment of the present application;

[0043] Figure 2 is a projection schematic diagram according to an embodiment of the present application;

[0044] Figure 3 is a schematic diagram of an electric pan-tilt according to an embodiment of the present application;

[0045] Figure 4 is a structural block diagram of a projection system based on an electric pan-tilt according to an embodiment of the present application;

[0046] Figure 5 is an internal structural schematic diagram of an electronic device according to an embodiment of the present application. Detailed Description of the Embodiments

[0047] In order to make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be described and explained below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application. Based on the embodiments provided by the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0048] Obviously, the drawings in the following description are only some examples or embodiments of the present application. For those of ordinary skill in the art, the present application can also be applied to other similar scenarios based on these drawings without creative efforts. In addition, it can also be understood that although the efforts made in this development process may be complex and time-consuming, for those of ordinary skill in the art related to the content disclosed in the present application, some design, manufacturing or production changes based on the technical content disclosed in the present application are only conventional technical means and should not be understood as the content disclosed in the present application being insufficient.

[0049] Reference to "embodiment" in this application means that the specific features, structures or characteristics described in connection with the embodiment may be included in at least one embodiment of this application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment each time, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. It is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0050] Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the ordinary meaning understood by those with ordinary skills in the technical field to which this application belongs. The words such as "a", "an", "one kind", "the" and the like involved in this application do not indicate a quantity limitation and may represent a singular or plural number. The terms "include", "comprise", "have" and any variations thereof involved in this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or modules (units) is not limited to the listed steps or units, but may further include unlisted steps or units, or may further include other steps or units inherent to these processes, methods, products or devices. The terms "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "plurality" involved in this application means two or more. "And / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, "A and / or B" may represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. The terms "first", "second", "third" and the like involved in this application are only used to distinguish similar objects and do not represent a specific order for the objects.

[0051] This embodiment provides a projection method based on an electric pan-tilt. Figure 1 is a flowchart of the projection method based on an electric pan-tilt according to an embodiment of this application, as Figure 1 shown, and the process includes the following steps:

[0052] Step S101, obtain environmental data of the projection scene where the projector is located, generate a scene coordinate system based on the environmental data, and obtain the pan-tilt coordinates of the electric pan-tilt on the projector and the wall coordinate data of the projection scene.

[0053] In this embodiment, the environmental data may be point cloud data of the projection scene or reconstructed three-dimensional model data. Map the physical size of the wall into a digital coordinate system (scene coordinate system) according to the environmental data, and establish a virtual projection canvas.

[0054] In some of these embodiments, obtaining the environmental data of the projection scene where the projector is located in step S101 includes:

[0055] Step S1011: Obtain the image data of the projection scene through the imaging device carried by the electric pan-tilt, and obtain the environmental data based on the image data.

[0056] Step S1012: Scan the projection scene through the distance measuring sensor carried by the electric pan-tilt to obtain the environmental data.

[0057] In this embodiment, the electric pan-tilt is equipped with an imaging device or a distance measuring sensor. By shooting the wall surface of the projection scene with the imaging device or scanning it with the distance measuring sensor, the wall size, flatness condition, and coordinates of obstacles (such as sockets and wall decorations) are obtained. It should be noted that the distance measuring sensor includes, but is not limited to, laser sensors and infrared sensors.

[0058] Step S102: Identify the motion trajectory corresponding to the audio-visual data.

[0059] The audio-visual data can be a video or a piece of music, and the motion trajectory is generated according to the video frame features or audio rhythm features.

[0060] In some of these embodiments, the audio-visual data includes game data, and step S102 includes:

[0061] Step S201: Identify the game image of the game data, and obtain the angular change data of the first-person view in the game image.

[0062] Step S202: Determine the motion trajectory of the electric pan-tilt according to the angular change data.

[0063] Figure 2 It is a projection schematic diagram according to an embodiment of the present application. As Figure 2 shown, when the angular change data of the first-person view in the game image is 60 degrees horizontally, the motion trajectory of the electric pan-tilt of the projector moves the projection image from projection A on the wall to projection B. When the angular change data of the first-person view in the game image is 150 degrees horizontally, the motion trajectory of the electric pan-tilt of the projector moves the projection image from projection A on the wall to projection C.

[0064] In some of these embodiments, the audio-visual data includes audio data; step S102 includes:

[0065] Step S1021: Identify the audio data to obtain the beat data and pitch data.

[0066] Step S1022: Determine the speed parameter sequence and motion direction sequence of the projection target according to the beat data.

[0067] Step S1023: Determine the vibration parameter sequence of the projection target object according to the pitch data. The vibration parameter sequence includes a vibration frequency sequence and a vibration amplitude sequence.

[0068] Step S1024: Generate the motion trajectory of the projection target object based on the velocity parameter sequence, the motion direction sequence, and the vibration parameter sequence.

[0069] Extract the rhythm features of the audio data, including beat data and pitch data (such as pitch, bass vibration, and drum beats), and generate a time stamp sequence. Optionally, the time stamp sequence includes a number of rhythm points with the same interval (such as one rhythm point every 0.5 seconds). Determine the motion speed and / or acceleration of each rhythm point according to the beat data; determine the vibration amplitude and vibration frequency of each rhythm point according to the pitch level, for example, a higher pitch has a larger vibration amplitude and a smaller vibration frequency, and a lower pitch has a smaller vibration amplitude and a larger vibration frequency; determine the motion direction of each rhythm point according to the note change.

[0070] Assume the projection target object is a small ball. When playing music, the small ball "dances" on the wall along with the rhythm, enhancing the immersion. The small ball moves according to the music melody, including linear motion during each note interval and bouncing (vibration) at each note node.

[0071] For example, determine the vibration amplitude and frequency of the small ball at the first note node according to the pitch level of the first note of the audio data, determine the first motion speed according to the beat count of the first note, and control the motion of the small ball in the first motion direction and at the first motion speed during the duration of the first note; determine the vibration amplitude and frequency of the small ball at the second note node according to the pitch level of the second note, determine the second motion speed according to the beat count of the second note, and control the motion of the small ball in the second motion direction and at the second motion speed during the duration of the second note; determine the vibration amplitude and frequency of the small ball at the third note node according to the pitch level of the third note, determine the third motion speed according to the beat count of the third note, and control the motion of the small ball in the third motion direction and at the third motion speed during the duration of the third note, and so on until the audio playback is completed. Among them, the motion direction can be a preset motion direction, and only the direction change time is determined according to the note change situation.

[0072] In some embodiments, the method further includes:

[0073] Step S1025: Identify the melody style from the audio data, and determine the motion mode of the projection target object based on the melody style. The motion mode includes wave motion, spiral motion, and bouncing motion.

[0074] Different music styles (such as rock, electronic, light music) can correspond to different motion modes (such as wave motion, spiral motion, and bouncing motion).

[0075] In some of these embodiments, the audiovisual data includes video data, and the video data includes a reference object of the projection target; step S102 includes:

[0076] Step S1026, identifying the video data to obtain the motion trajectory of the reference object.

[0077] Step S1027, generating the motion trajectory of the projection target based on the motion trajectory of the reference object.

[0078] For example, the video data is game video data, and the reference object is a game character in the video data. The game character or the corresponding cartoon image of the character is used as the projection target for projection. The motion trajectory of the projection target is consistent with the motion trajectory of the game character in the video, including motion data, acceleration, motion direction, and character orientation.

[0079] The video data can also be a brand logo or a customized trajectory of a product, and the brand logo or product dynamics are displayed through the customized trajectory to attract audience interaction.

[0080] Optionally, while projecting the projection target through an electric pan-tilt head, a solid-state projection device is used to project a background image (such as a small ball springboard or a game background) so that the projection target moves in the background image, further improving the user experience of projection interaction.

[0081] In the case where the audiovisual data is an audio-visual video, the trajectory data of the projection target can also be generated simultaneously according to the picture content and audio content of the audio-visual data. For example, in combination with an animation course, knowledge points are dynamically presented on the wall along with music to enhance the user's learning interest.

[0082] Continue to refer to Figure 1 , after obtaining the motion trajectory of the projection target, step S103 is continued.

[0083] Step S103, determining the rotation parameters of the electric pan-tilt head based on the motion trajectory, the coordinates of the electric pan-tilt head, and the wall coordinates data. The rotation parameters include the rotation direction and the rotation angle.

[0084] Figure 3 is a schematic diagram of an electric pan-tilt head according to an embodiment of the present application. As Figure 3 shown, the electric pan-tilt head has two rotation degrees of freedom, namely horizontal angle rotation and pitch angle rotation, and is driven by an electric motor.

[0085] Based on the coordinates of the PTZ (Pan-Tilt-Zoom) in the scene coordinate system data and the wall coordinates, the distances from the PTZ to each wall are obtained. According to the movement direction data, movement speed data, vibration data, and orientation data in the movement trajectory, as well as the distances from the PTZ to each wall, the rotation parameters of the PTZ at each moment are determined, including the rotation parameters of the first degree of freedom and the second degree of freedom.

[0086] Step S104, while playing the audio-visual data, control the rotation of the PTZ based on the rotation parameters.

[0087] By controlling the rotation of the PTZ, the projected image (such as a game image, a projection target) of the projection device is made to move. The playback of the audio-visual data is synchronized with the rotation of the PTZ, so that the movement of the game image or the projection target is consistent with the content (audio content or video content) of the audio-visual data.

[0088] Through the above steps S101 to S104, the environmental data of the projection scene where the projector is located is obtained, a scene coordinate system is generated based on the environmental data, the PTZ coordinates on the projector and the wall coordinate data of the projection scene are obtained, the movement trajectory corresponding to the audio-visual data is identified, and based on the movement trajectory, the PTZ coordinates, and the wall coordinate data, the rotation parameters of the PTZ are determined. The rotation parameters include the rotation direction and the rotation angle. While playing the audio-visual data, the rotation of the PTZ is controlled based on the rotation parameters, solving the problem of poor projection interaction experience. Determining the rotation parameters of the PTZ based on the audio-visual data, and driving the movement of the projection image through the rotation of the PTZ, so as to achieve the purpose of the projection image following the dynamic presentation of the audio-visual data, and improving the projection interaction experience.

[0089] In some embodiments, after obtaining the environmental data of the projection scene where the projector is located, the method further includes:

[0090] Step S1013, analyze the environmental data to determine whether there are obstacles. If so, determine the obstacle coordinates.

[0091] Step S1014, based on the wall coordinate data, construct a virtual projection canvas, and mark the non-projectable areas in the virtual projection canvas according to the obstacle coordinates.

[0092] The obstacles include but are not limited to sockets, wall decorations, and wall lights. Dynamically mark the non-projectable areas, and avoid these non-projectable areas when determining the projection range to ensure the safety of the movement trajectory.

[0093] In some embodiments, the method further includes:

[0094] Step S105, during the projection process, obtain the projection imaging data of the projection target through the imaging device carried by the PTZ.

[0095] Step S106: Compare the projection imaging data with the motion trajectory to determine whether there is an abnormality in the projection.

[0096] The projection position of the projection target is captured in real time by a camera device, and it is determined whether there is an abnormality in the projection of the projection target according to the position information feedback by the pan-tilt controller in real time. For example, it is detected whether there is a deviation between the actual projection imaging and the theoretical motion trajectory of the projection target (for example, if the error is greater than 1 mm, it is considered that there is a deviation) to determine whether there is an abnormality such as stuttering in the projection.

[0097] In some embodiments, the method further includes:

[0098] Step S107: During the projection, in response to a user's gesture instruction or voice instruction, adjust the rotation parameters of the electric pan-tilt to adjust the motion trajectory of the projection screen, where the gesture instruction is obtained based on the camera device carried by the electric pan-tilt.

[0099] This embodiment supports the user to interact through gestures and / or voices (for example, waving to control the projection target to change the trajectory direction of the projection), improving the interactivity of the projection.

[0100] Step S108: When the light change in the projection scene is detected, adjust the brightness parameter of the projection device based on the light change situation.

[0101] If the light change on the wall is detected (such as ambient light interference), the projection brightness is automatically optimized to improve the visual comfort of the user's interaction with the projection.

[0102] It should be noted that the steps shown in the above process or the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0103] This embodiment also provides a projection system based on an electric pan-tilt. This system is used to implement the above embodiments and preferred implementation manners, and those that have been described will not be repeated. As used below, terms such as "module", "unit", "sub-unit", etc. can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0104] Figure 4 is a structural block diagram of a projection system based on an electric pan-tilt according to an embodiment of the present application, as Figure 4 shown, the system includes:

[0105] The data acquisition module 31 is configured to acquire the environmental data of the projection scene where the projector is located, generate a scene coordinate system based on the environmental data, and obtain the pan-tilt coordinates of the pan-tilt on the projector and the wall coordinates of the projection scene.

[0106] The recognition module 32 is configured to recognize the motion trajectory corresponding to the audiovisual data.

[0107] The parameter determination module 33 is configured to determine the rotation parameters of the pan-tilt based on the motion trajectory, the pan-tilt coordinates, and the wall coordinates, where the rotation parameters include the rotation direction and the rotation angle.

[0108] The projection module 34 is configured to control the rotation of the pan-tilt based on the rotation parameters while playing the audiovisual data.

[0109] In some embodiments, the audiovisual data includes game data, and the recognition module 32 includes:

[0110] The angle recognition module is configured to recognize the game images of the game data and obtain the angle change data of the first-person view in the game images;

[0111] The trajectory determination module is configured to determine the motion trajectory of the pan-tilt according to the angle change data.

[0112] In some embodiments, the audiovisual data includes audio data; the recognition module 32 includes:

[0113] The audio recognition module is configured to recognize the audio data to obtain the beat data and the pitch data.

[0114] The first parameter module is configured to determine the speed parameter sequence and the motion direction sequence of the projection target according to the beat data.

[0115] The second parameter module is configured to determine the vibration parameter sequence of the projection target according to the pitch data, where the vibration parameter sequence includes the vibration frequency sequence and the vibration amplitude sequence;

[0116] The first trajectory generation module is configured to generate the motion trajectory of the projection target based on the speed parameter sequence, the motion direction sequence, and the vibration parameter sequence.

[0117] In some embodiments, the recognition module 32 further includes:

[0118] The motion mode determination module is configured to recognize the audio data to obtain the melody style; determine the motion mode of the projection target based on the melody style, where the motion mode includes wave motion, spiral motion, and bouncing motion.

[0119] In some embodiments, the audiovisual data includes video data, and the video data includes the reference object of the projection target; the recognition module 32 includes:

[0120] The second trajectory generation module is configured to identify video data to obtain the motion trajectory of a reference object; and generate the motion trajectory of a projection target based on the motion trajectory of the reference object.

[0121] In some embodiments, the data acquisition module 31 includes:

[0122] An image acquisition module, configured to acquire image data of a projection scene through a camera device carried by a pan-tilt head, and obtain environmental data based on the image data. And / or

[0123] A scanning module, configured to scan the projection scene through a ranging sensor carried by a pan-tilt head to obtain environmental data.

[0124] In some embodiments, the system further includes:

[0125] An obstacle recognition module, configured to analyze the environmental data to determine whether there is an obstacle, and if so, determine the obstacle coordinates.

[0126] A marking module, configured to construct a virtual projection canvas based on the wall coordinate data, and mark the non-projectable area in the virtual projection canvas according to the obstacle coordinates.

[0127] In some embodiments, the system further includes:

[0128] A projection monitoring module, configured to acquire projection imaging data of a projection target through a camera device carried by a pan-tilt head during the projection process.

[0129] An anomaly recognition module, configured to compare the projection imaging data with the motion trajectory to determine whether there is an anomaly in the projection of the projection target.

[0130] Through the above, the data acquisition module 31 acquires the environmental data of the projection scene where the projector is located, generates a scene coordinate system based on the environmental data, obtains the pan-tilt head coordinates of the pan-tilt head on the projector and the wall coordinate data of the projection scene, the recognition module 32 recognizes the motion trajectory corresponding to the audio-visual data, and the parameter determination module 33 determines the rotation parameters of the pan-tilt head based on the motion trajectory, the pan-tilt head coordinates, and the wall coordinate data. The rotation parameters include the rotation direction and the rotation angle. While playing the audio-visual data, the projection module 34 controls the rotation of the pan-tilt head based on the rotation parameters, solving the problem of poor projection interaction experience. Determining the rotation parameters of the pan-tilt head based on the audio-visual data, and driving the projection screen to move through the rotation of the pan-tilt head, so as to achieve the purpose of dynamically presenting the projection screen following the audio-visual data, and improving the projection interaction experience.

[0131] It should be noted that each of the above modules can be a functional module or a program module, and can be implemented either by software or by hardware. For the modules implemented by hardware, each of the above modules can be located in the same processor; or each of the above modules can also be located in different processors in any combined form.

[0132] This embodiment also provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0133] Optionally, the above electronic device may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0134] Optionally, in this embodiment, the above processor may be configured to execute the following steps through a computer program:

[0135] S1. Obtain the environmental data of the projection scene where the projector is located, generate a scene coordinate system based on the environmental data, and obtain the pan-tilt coordinate of the pan-tilt on the projector and the wall coordinate data of the projection scene.

[0136] S2. Identify the motion trajectory corresponding to the audiovisual data.

[0137] S3. Based on the motion trajectory, pan-tilt coordinate, and wall coordinate data, determine the rotation parameters of the pan-tilt. The rotation parameters include the rotation direction and the rotation angle.

[0138] S4. While playing the audiovisual data, control the rotation of the pan-tilt based on the rotation parameters.

[0139] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementation manners, and will not be elaborated here.

[0140] In one embodiment, Figure 5 is a schematic internal structure diagram of an electronic device according to an embodiment of the present application. As Figure 5 shown, an electronic device is provided. The electronic device can be a server, and its internal structure diagram can be as Figure 5As shown in the figure. The electronic device includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the electronic device is used to store data. The network interface of the electronic device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it realizes a projection method based on a pan-tilt head.

[0141] Those skilled in the art can understand that Figure 5 the structure shown in the figure is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the electronic device to which the solution of this application is applied. The specific electronic device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0142] Those of ordinary skill in the art can understand that all or part of the processes in the above-described method embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the above-described method embodiments. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided in this application can include non-volatile and / or volatile memories. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or an external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0143] Those skilled in the art should understand that the technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered to be within the scope described in this specification.

[0144] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.

Claims

1. A projection method based on an electric pan-tilt head, characterized in that, The method includes: Obtaining environmental data of the projection scene where the projector is located, generating a scene coordinate system based on the environmental data, and obtaining the pan-tilt coordinates of the pan-tilt on the projector and the wall coordinate data of the projection scene; Identifying the motion trajectory corresponding to the audio-visual data; Based on the motion trajectory, the pan-tilt coordinates, and the wall coordinate data, determining the rotation parameters of the pan-tilt, where the rotation parameters include the rotation direction and the rotation angle; While playing the audio-visual data, controlling the rotation of the pan-tilt based on the rotation parameters.

2. The method according to claim 1, characterized in that The audio-visual data includes game data, and the identifying the motion trajectory corresponding to the audio-visual data includes: Identifying the game images of the game data and obtaining the angle change data of the first-person view in the game images; Determining the motion trajectory of the pan-tilt according to the angle change data.

3. The method according to claim 1, wherein The audio-visual data includes audio data; the identifying the motion trajectory corresponding to the audio-visual data includes: Identifying the audio data to obtain the beat data and the pitch data; Determining the speed parameter sequence and the motion direction sequence of the projection target according to the beat data; Determining the vibration parameter sequence of the projection target according to the pitch data, where the vibration parameter sequence includes the vibration frequency sequence and the vibration amplitude sequence; Generating the motion trajectory of the projection target based on the speed parameter sequence, the motion direction sequence, and the vibration parameter sequence.

4. The method according to claim 3, wherein The method further includes: Identifying the audio data to obtain the melody style; Determining the motion mode of the projection target based on the melody style, where the motion mode includes wave motion, spiral motion, and bouncing motion.

5. The method according to claim 1, wherein The audio-visual data includes video data, and the video data includes a reference object of the projection target; the identifying the motion trajectory corresponding to the audio-visual data includes: Identifying the video data to obtain the motion trajectory of the reference object; Generating the motion trajectory of the projection target based on the motion trajectory of the reference object.

6. The method according to claim 1, characterized in that, The obtaining the environmental data of the projection scene where the projector is located includes: Obtaining the image data of the projection scene through the imaging device carried by the pan-tilt and obtaining the environmental data based on the image data; and / or Scanning the projection scene through the distance sensor carried by the pan-tilt to obtain the environmental data.

7. The method according to claim 1, wherein The method further includes: Analyzing the environmental data to determine whether there are obstacles. If so, determining the obstacle coordinates, Based on the wall coordinate data, constructing a virtual projection canvas and marking the non-projectable area in the virtual projection canvas according to the obstacle coordinates.

8. The method according to claim 1, characterized in that, The method further includes: During the projection process, obtaining the projection imaging data of the projection target through the imaging device carried by the pan-tilt; Comparing the projection imaging data with the motion trajectory to determine whether there is an abnormality in the projection.

9. A projection system based on an electric pan-tilt head, characterized in that, The system includes: A data acquisition module for obtaining environmental data of the projection scene where the projector is located, generating a scene coordinate system based on the environmental data, and obtaining the pan-tilt coordinates of the pan-tilt on the projector and the wall coordinate data of the projection scene; An identification module for identifying the motion trajectory corresponding to the audio-visual data; A parameter determination module, configured to determine rotation parameters of the electric pan-tilt based on the motion trajectory, the pan-tilt coordinates, and the wall coordinate data, where the rotation parameters include a rotation direction and a rotation angle; A projection module, configured to, while playing the audio-visual data, control the rotation of the electric pan-tilt based on the rotation parameters.

10. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the projection method based on an electric pan-tilt according to any one of claims 1 to 8.

Images