Projection interactive system, projection control method, controller, vehicle and storage medium

Abstract

The present application provides a projection interaction system, a projection control method, a controller, a vehicle and a storage medium. It relates to the field of projection interaction. The projection interaction system includes: a projection device, an image acquisition device and a projection control device. The projection device is used to project a projection screen for the interactor to interact in a projection area, the image acquisition device is used to acquire an image of the projection area, and the projection control device is used to recognize and process the image to obtain a matching score between the action in the projection screen and the action of the interactor in the image. The matching score is used to indicate the degree of fit between the action of the interactor and the action in the projection screen; and the matching score is projected in the projection area by the projection device. The system is used to enhance the interactive experience between people and vehicles to meet the entertainment needs of users.

Description

Technical Field

[0001] The present application relates to the field of projection interaction, and in particular to a projection interaction system, a projection control method, a controller, a vehicle and a storage medium. Background Art

[0002] With the continuous development of vehicle technology, vehicle lighting systems, especially headlight technology, are also undergoing significant innovation and progress. Nowadays, by configuring projection headlights on vehicles, navigation instructions, speed limits, driving information, etc. can be projected on the road surface to further enhance driving convenience and safety.

[0003] In the prior art, projection headlights equipped on vehicles are mainly used for functions directly related to the vehicle, such as lighting and safety assistance. However, with the growing demand for diversified vehicle functions, especially in terms of entertainment experience, the application of projection headlights is not comprehensive enough. Therefore, it is urgent to develop a new projection interaction solution to better meet users' entertainment needs. Summary of the invention

[0004] The present application provides a projection interaction system, a projection control method, a controller, a vehicle and a storage medium to meet the entertainment needs of users.

[0005] In a first aspect, the present application provides a projection interaction system, comprising:

[0006] Projection device, image acquisition device and projection control device;

[0007] The projection device is used to project a projection picture for the interactors to interact in the projection area;

[0008] The image acquisition device is used to acquire the image of the projection area;

[0009] The projection control device is used to perform recognition processing on the image to obtain a matching score between the action in the projection screen in the image and the action of the interactor, wherein the matching score is used to indicate the degree of fit between the action of the interactor and the action in the projection screen;

[0010] The projection device is further used to project the matching score on the projection area.

[0011] In a possible implementation, the performing recognition processing on the image to obtain a matching score between an action in the projection screen of the image and an action of the interactor includes:

[0012] Determining the similarity between the action of the interactor and the action in the projection picture;

[0013] The matching score is determined according to the similarity.

[0014] In a possible implementation, the projection interaction system further includes:

[0015] A voice announcement device is used to send a voice prompt to the interactor according to the matching score.

[0016] In a possible implementation manner, the voice broadcasting device is further used to play music when the interactor interacts with the projection screen.

[0017] In a possible implementation, the projection interaction system further includes:

[0018] The vehicle-mounted display device is used to display a matching score, where the matching score is obtained by accumulating matching scores corresponding to at least one image in the projection area.

[0019] In a second aspect, the present application provides a projection control method, which is applied to a projection control device in a projection interactive system according to any one of the first aspects, comprising:

[0020] Acquire an image of the projection area acquired by an image acquisition device;

[0021] Performing recognition processing on the image to obtain a matching score between an action in a projection screen in the image and an action of the interactor, wherein the matching score is used to indicate a degree of fit between the action of the interactor and the action in the projection screen, wherein the projection screen is projected by the projection device for the interactor to interact;

[0022] Wherein, the projection device is further used to project the matching score on the projection area.

[0023] In a possible implementation, the method further includes:

[0024] Accumulating the matching scores corresponding to at least one image to obtain a matching score;

[0025] Displaying the matching points through the vehicle display device and uploading them to the cloud service platform;

[0026] Receive a ranking result returned by the cloud service platform, wherein the ranking result includes a ranking of the matching score.

[0027] In a third aspect, the present application provides a controller, including: a memory, a processor;

[0028] The memory stores computer-executable instructions;

[0029] The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method described in any one of the second aspects.

[0030] In a fourth aspect, the present application provides a vehicle, comprising: a projection interaction system as described in any one of the first aspects.

[0031] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the projection control method as described in any one of the second aspects above.

[0032] In a fifth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the projection control method described in any one of the second aspects.

[0033] In a sixth aspect, the present application provides a computer program product, wherein the computer program product includes a computer program, and when the computer program is executed by a processor, it is used to implement the projection control method described in any one of the second aspects.

[0034] The present application provides a projection interaction system, a projection control method, a controller, a vehicle and a storage medium. The system includes a projection device, an image acquisition device and a projection control device, wherein the projection device is used to project a projection screen for the interactor to interact in the projection area, the image acquisition device is used to acquire the image of the projection area, and the projection control device recognizes and processes the acquired image to calculate the matching score between the interactor's action and the action in the projection screen, and displays the matching score through the projection device. The system can enhance the interactive experience between people and vehicles and achieve the effect of satisfying the user's entertainment needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0036] Figure 1 A schematic diagram of an application scenario provided by an embodiment of the present application;

[0037] Figure 2 This is a schematic diagram of the structure of the first embodiment of the projection interaction system provided by the present application;

[0038] Figure 3 A schematic diagram of a projection screen provided in an embodiment of the present application;

[0039] Figure 4 This is a schematic diagram of the structure of the second embodiment of the projection interaction system provided by the present application;

[0040] Figure 5 A schematic diagram of another projection screen provided in an embodiment of the present application;

[0041] Figure 6 A flowchart of a first embodiment of the projection control method provided in the present application;

[0042] Figure 7 A schematic diagram of a flow chart of a second embodiment of the projection control method provided in this application;

[0043] Figure 8 A schematic diagram of the structure of a controller provided in an embodiment of the present application.

[0044] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0045] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0046] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present application. Figure 1 , including a vehicle 100, a controller 101 and a projection headlight 102. The controller 101 in the vehicle 100 can communicate with the projection headlight and control the projection headlight 102 to project functions directly related to the vehicle, such as lighting and safety assistance, to enhance driving convenience and safety.

[0047] For example, when the vehicle 100 is driving at night, the controller 101 can control the projection headlights 102 to turn on the lighting, and project the navigation instructions in the projection area as safety assistance information that the current vehicle speed is 40 km / h.

[0048] Combined with the above scenarios, it can be seen that in the prior art, projection headlights are mainly used to provide functions directly related to the vehicle, such as lighting and enhancing safety. However, as users' demands for vehicle functions become increasingly diversified, especially in terms of entertainment and personalized experience, the application of traditional projection headlights is relatively limited. Users are no longer satisfied with basic driving functions, but hope that vehicles can provide more interactive and entertainment options to meet their entertainment needs.

[0049] In response to the above problems, the inventors have proposed a projection interaction system that meets the user's needs for vehicle entertainment by expanding the functions of a projection device (such as a projection headlight). Specifically, the projection interaction system may include a projection device, an image acquisition device, and a projection control device. The projection device is used to project a projection screen for the interactor to interact in a projection area, the image acquisition device is used to capture the image of the projection area, and the projection control device is used to recognize and process the image to obtain a matching score between the action in the projection screen and the action of the interactor in the image. By projecting the matching score in the projection area by the projection device, the system can enhance human-vehicle interaction, thereby meeting the user's entertainment needs. Based on this, the present application provides a projection interaction system for enhancing the user's entertainment experience.

[0050] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0051] Figure 2 For a structural diagram of the first embodiment of the projection interactive system provided by this application, please refer to Figure 2 , the projection interaction system 10 comprises:

[0052] A projection device 11, an image acquisition device 12 and a projection control device 13;

[0053] The projection device 11 is used to project a projection picture for interacting with the interactors (users) in the projection area.

[0054] The projection device 11 may be a projection headlight disposed in the vehicle;

[0055] The projection area may refer to a specific area that the projection headlight can cover and display images or information, such as the ground, wall or other surface in front of the vehicle.

[0056] Optionally, the size and shape of the projection area can be adjusted according to the design of the projection headlight and the driving conditions of the vehicle.

[0057] Figure 3 A schematic diagram of a projection screen provided in an embodiment of the present application. Figure 3 The projection picture may be an image projected by the projection headlights on the ground in front of the vehicle, and the projection picture includes the movements of both hands and both feet.

[0058] The image acquisition device 12 is used to acquire images of the projection area.

[0059] The image acquisition device 12 may include one or more of a laser radar, a millimeter wave radar, and a camera. For example, the image acquisition device 12 may be a front-view camera disposed in a vehicle.

[0060] Specifically, the interactor may perform similar actions in the projection area according to the actions in the projection picture, and the image acquisition device 12 may acquire images of the projection area.

[0061] In an optional implementation, the interactor performs similar actions in the projection area according to the actions in the projection image, which may include any of the following situations:

[0062] Case 1: The projection screen is an image projected by the projection device 11 on the ground in front of the vehicle. The projection screen includes movements of palms and / or soles of feet. The interactor makes similar movements in the projection area, which may be placing the palm at the position of the palm in the projection screen and / or placing the sole of the foot at the position of the sole of the foot in the projection screen.

[0063] Case 2: The projection screen is an image projected by the projection device 11 onto the wall in front of the vehicle. The projection screen only includes movements of the hands and / or a single sole of the foot. The interactant makes similar movements in the projection area, which may be placing the palm at the position of the palm in the projection screen, and / or placing a single sole of the foot at the position of the sole in the projection screen.

[0064] Case 3: The projection screen is an image projected by the projection device 11 onto the wall in front of the vehicle. In addition to the movements of the palms and / or soles of the feet, the projection screen also includes various limb movements, such as waving arms, moving legs, rotating the body, etc. The interactor makes similar movements in the projection area, which can allow the interactor to imitate the palms and / or soles of the feet and various other limb movements in the projection screen.

[0065] For ease of understanding, the projection screen described in situation 1 is taken as an example in which the projection device 11 projects an image on the ground in front of the vehicle.

[0066] For example, the projection headlights can project a projection screen for the interactors to interact in the projection area, and the projection screen includes the movements of the hands and feet. The interactors can place their hands at the positions of the hands in the projection screen, and place their feet at the positions of the hands in the projection screen. The front-view camera set in the vehicle can collect images of the projection area.

[0067] Optionally, the image acquisition device 12 and the projection control device 13 may be in communication connection, and after acquiring the image of the projection area, the image acquisition device 12 may send the image to the projection control device 13 for processing.

[0068] The projection control device 13 is used to perform recognition processing on the image, and obtain a matching score between the action in the projection screen and the action of the interactor in the image, wherein the matching score is used to indicate the degree of fit between the action of the interactor and the action in the projection screen.

[0069] In an optional implementation, the projection control device 13 may determine the similarity between the action of the interactor and the action in the projection picture, and determine the matching score according to the similarity.

[0070] For example, if the interactor places both hands completely at the position of both hands in the projection screen and places both feet completely at the position of both feet in the projection screen, the projection control device 13 can determine that the similarity between the interactor's action and the action in the projection screen is 80%. Based on the similarity of 80%, the matching score can be determined to be 8 points.

[0071] The projection device 11 is also used to project the matching score in the projection area.

[0072] Optionally, after performing recognition processing on the image and obtaining the matching score, the projection control device 13 may project the matching score into the projection area through the projection device 11 .

[0073] For example, after the projection control device 13 performs recognition processing on the image and obtains a matching score of 8, the projection device 11 may project the words of the matching score of 8 in the projection area.

[0074] In an embodiment of the present application, the projection interaction system includes a projection device, an image acquisition device, and a projection control device. The projection device can project a projection screen for the interactor to interact in the projection area; after the interactor makes similar actions in the projection area according to the actions in the projection screen, the image acquisition device can capture the image of the projection area and send it to the projection control device for recognition processing, obtain a matching score indicating the degree of fit between the interactor's actions and the actions in the projection screen, and project the matching score in the projection area through the projection device. In the above process, the interaction performance of the interactor can be displayed by the projection device, so that the interactor can see the degree of match between his or her actions and the actions in the projection screen, which effectively enhances the user's immersion and interactivity in entertainment activities, thereby meeting the user's diverse entertainment needs.

[0075] exist Figure 2 Based on the embodiment shown below, combined with Figure 4 , the above-mentioned projection interaction system is further described in detail.

[0076] Figure 4 This is a schematic diagram of the structure of the second embodiment of the projection interaction system provided by this application. Figure 2 Based on the examples shown, see Figure 4, the projection interaction system 10 may include:

[0077] A projection device 11 , an image acquisition device 12 , a projection control device 13 , a voice broadcasting device 14 , and a vehicle-mounted display device 15 .

[0078] The projection device 11 is used to project a projection picture for the interactors to interact in the projection area.

[0079] Figure 5 This is a schematic diagram of another projection screen provided by an embodiment of the present application. Figure 5 The projection picture may be an image projected by the projection headlights on the ground in front of the vehicle, and the projection picture includes the movements of the left hand and the left foot.

[0080] The image acquisition device 12 is used to acquire images of the projection area.

[0081] For example, when the interactor places his left hand and left foot at the corresponding left hand and left foot positions in the projection image, the forward-looking camera can capture an image of the projection area.

[0082] In a specific implementation, the image acquisition device 12 may send the acquired image of the projection area to the projection control device 13 for recognition processing.

[0083] Optionally, the image acquisition frequency of the image acquisition device 12 can be preset according to the specific needs of the interactor, so as to better adapt to different interactive scenes and rhythms. When the projection control device 13 recognizes and processes the continuous multiple images sent by the image acquisition device 12, it can select the image with the highest similarity between the action of the interactor and the action of the projection screen as the basis for analysis, thereby obtaining the matching score between the action in the projection screen in the image and the action of the interactor.

[0084] For selecting the image with the highest similarity between the action of the interactor and the action of the projection screen, the following two situations may be included:

[0085] Case 1: If the interactor places his palm at the corresponding palm position in the projection screen, and / or places his foot at the corresponding foot position in the projection screen, the image with the highest degree of overlap can be selected according to the degree of overlap between the interactor's action and the projection screen action.

[0086] Case 2: If the projection image is an image projected on a wall, and the image includes not only the movements of the palms and / or soles of the feet but also various body movements, the image with the highest similarity can be selected based on the similarity of the interactants imitating these movements.

[0087] In an optional implementation, the image with the highest similarity may be selected through image processing and machine learning techniques.

[0088] For example, the image with the highest similarity can be selected by template matching. Specifically, the action in the projected image can be determined as the template action, the action of the user in the image can be determined as the object to be matched, and the image with the highest similarity can be determined by comparing the similarity between the object to be matched and the template action.

[0089] For ease of understanding, the example of selecting the image with the highest degree of overlap described in Case 1 is used for explanation.

[0090] Specifically, the projection control device 13 can perform recognition processing on the image with the highest overlap, and obtain a matching score between the action in the projection screen and the action of the interactor in the image, where the matching score is used to indicate the degree of fit between the action of the interactor and the action in the projection screen.

[0091] Optionally, the matching score may be obtained in any of the following ways.

[0092] Mode 1: A mapping relationship table between the overlap degree and the matching score is pre-set in the projection control device 13, and the matching score can be obtained by looking up the table.

[0093] Exemplarily, the mapping relationship table may be shown in Table 1:

[0094] Table 1

[0095]

[0096] Method 2: The projection control device 13 may use a pre-acquired scoring model to process the image and determine a matching score; wherein the scoring model is obtained by training a convolutional neural network based on multiple images and the matching score corresponding to each image.

[0097] For example, the image with the highest degree of overlap selected is that the interactor places half of his left hand at the position of the left hand in the projection screen, and places half of his left foot at the position of the left foot in the projection screen. The projection control device 13 can determine that the similarity between the interactor's action and the action in the projection screen is 50%. According to the table lookup method, the matching score can be determined to be 5 points.

[0098] The projection device 11 is also used to project the matching score in the projection area.

[0099] For example, after the projection control device 13 performs recognition processing on the image with the highest overlap degree and obtains a matching score of 5, the projection control device 13 can project the words with a matching score of 5 in the projection area through the projection device 11.

[0100] Optionally, when the projection device 11 projects the matching score onto the projection area, a voice prompt can be issued to the interactor according to the matching score through the voice broadcast device 14. The voice prompt can include at least one of encouraging information, matching score status, and providing feedback.

[0101] For example, when the matching score is greater than a preset threshold, a voice prompt of "very good" may be sent to the interacting party.

[0102] In an optional implementation, the voice broadcasting device 14 is also used to play music when the interactor interacts with the projection screen.

[0103] For example, when the interactor interacts with the projection screen, corresponding music or sound effects can be played according to the rhythm of the projection screen changes. If the projection screen changes quickly and dynamically, you can choose to play music with a brisk rhythm; if the projection screen changes slowly and elegantly, you can choose to play soft background music.

[0104] In another optional implementation, if the projection control device 13 performs recognition processing on a plurality of continuous images and obtains continuous matching scores that are greater than a preset threshold, a voice prompt may be issued to the interactor through the voice broadcast device 14 .

[0105] For example, when the projection control device 13 performs recognition processing on three consecutive images and obtains consecutive matching scores of 7, 8, and 9, all of which are greater than the preset threshold of 4, a voice prompt of "Nice" can be issued to the interactor. Specifically, when the projection control device 13 performs recognition processing on image 1, a matching score of 7 can be obtained, when the projection control device 13 performs recognition processing on image 2, a matching score of 8 can be obtained, and when the projection control device 13 performs recognition processing on image 3, a matching score of 9 can be obtained. Based on the matching scores of 7, 8, and 9, all of which are greater than the preset threshold of 4, a voice prompt of "Super" can be issued to the interactor through the voice broadcast device 14.

[0106] Optionally, when the projection device 11 projects the matching score onto the projection area, the matching score may also be displayed via the vehicle-mounted display device 15 , where the matching score is obtained by accumulating the matching score corresponding to at least one image in the projection area.

[0107] When an interactor interacts with a projection screen, he or she usually interacts with at least one projection screen. In this case, one or more images in the projection area can be identified and processed to obtain matching scores, and these matching scores can be accumulated. In this way, a comprehensive matching score can be calculated to reflect the interaction's participation and matching degree in the entire interaction process.

[0108] When the interactor finishes interacting with the projection image, the matching score can be viewed through the vehicle-mounted display device 15 .

[0109] In an optional implementation, the duration of the projection screen projected by the projection device 11 in the projection area for the interactors to interact can be selected through the vehicle-mounted display device 15. For example, the interactors can select the duration of each projection screen to stay for 30 seconds.

[0110] In an optional implementation, the projection control device 13 can also communicate with the cloud service platform, upload the matching points to the cloud service platform, and receive the sorting results returned by the cloud service platform, including the ranking of the matching points. Further, the projection control device 13 can display the sorting results through the vehicle display device 15, and the interactor can understand the relative position of his matching points in a wider user group based on the sorting results, thereby motivating himself to improve his interactive performance, or adjust his interactive strategy based on the ranking to achieve higher matching points and better rankings.

[0111] In an embodiment of the present application, the projection interaction system includes a projection device, an image acquisition device, a projection control device, a voice broadcast device and a vehicle-mounted display device. Among them, the projection device can project a projection screen for the interactor to interact in the projection area; the image acquisition device can capture the image of the projection area and send it to the projection control device for recognition processing, obtain the matching score between the action in the projection screen and the action of the interactor in the image, and project the matching score in the projection area through the projection device. At the same time, the voice broadcast device can issue a voice prompt to the interactor according to the matching score. In addition, the voice broadcast device can also play music when the interactor interacts with the projection screen. In the above process, not only can the matching score be projected in the projection area by the projection device, but the matching score can also be played by the voice broadcast device. The interactor can understand the matching degree between his or her actions and the actions in the projection screen from both visual and auditory aspects, improve human-vehicle interaction, and meet entertainment needs.

[0112] Furthermore, the projection interaction system provided in the embodiment of the present application can display the matching score of the interactor after completing a set of actions through the vehicle display device, as well as the ranking results returned by the cloud service platform. Matching scores can provide instant feedback, so that the interactor can clearly understand the pros and cons of their own actions, and help them to improve accurately and continuously; the ranking results can add competitive fun to the interactor, stimulate the interactor's enthusiasm for participation, and let the projection interaction bring a multi-dimensional entertainment experience to the interactor.

[0113] Figure 6 This is a flowchart of the first embodiment of the projection control method provided by this application. Figure 6The method is applied to the projection control device in the projection interaction system described in the above embodiment, and the method includes:

[0114] S601: Acquire an image of a projection area acquired by an image acquisition device.

[0115] In this step, the projection control device may obtain the image of the projection area captured and sent by the image capture device, and the image may include the actions of the interactor and the actions in the projection screen.

[0116] Optionally, the actions in a projection screen may include: left hand, right hand, both hands, left foot, right foot, both feet, left hand plus right foot, right hand plus left foot, left hand plus left foot, right hand plus right foot, left hand plus both feet, right hand plus both feet, both hands plus left foot, both hands plus right foot, and any one of both hands plus both feet.

[0117] In an optional implementation, in order to enhance the interactivity between the interactor and the projection screen, a random algorithm may be used to control the projection screen, break the fixed screen sequence, and continuously output novel and unpredictable projection screens to capture the interactor's attention, stimulate their curiosity and desire to explore, and enhance the overall interactive experience.

[0118] For example, the projection control device may obtain an image of the projection area captured and sent by the front camera, and the image may include the interactor's left hand movements, left foot movements, left hand movements in the projection screen, and left foot movements in the projection screen.

[0119] S602: Perform recognition processing on the image to obtain a matching score between the action in the projection screen in the image and the action of the interactor.

[0120] In this step, the projection control device can perform recognition processing on the image to obtain a matching score indicating the degree of fit between the action of the interactor and the action in the projection screen, wherein the projection screen is projected by the projection device for the interactor to interact.

[0121] For example, the projection control device can perform recognition processing on the image and obtain a matching score of 6 points between the action in the projection screen in the image and the action of the interactor. The projection screen is projected by a projection headlight for the interactor to interact.

[0122] In a specific implementation, the projection device is further used to project the matching score in the projection area. For example, the words "matching score of 6" can be projected in the projection area by the projection headlight.

[0123] In an embodiment of the present application, the projection control device in the projection interaction system can perform recognition processing on the image rows of the projection area captured by the image acquisition device, and obtain the matching score between the action in the projection screen and the action of the interactor in the image. Then, the matching score is projected in the projection area by the projection device. In the above process, on the one hand, the interactor can intuitively and instantly know the degree of fit between his own action and the action required by the projection screen, and give the interactor clear feedback so as to adjust and improve the action in a targeted manner, thereby improving the quality of action completion. On the other hand, it also adds fun and participation to the interactive activities, making the entire projection interaction experience more vivid, effective and immersive, so as to further meet the entertainment needs of users.

[0124] Figure 7 This is a flowchart of the second embodiment of the projection control method provided by this application. Figure 7 , the method may include:

[0125] S701. Acquire an image of a projection area acquired by an image acquisition device.

[0126] For example, the projection control device can obtain image 1, image 2 and image 3 of the projection area captured and sent by the front camera. Image 1 can include the left foot movement of the interactor and the left foot movement in the projection picture, image 2 can include the left hand movement of the interactor and the left hand movement in the projection picture, and image 3 can include the two-hand movement of the interactor and the two-hand movement in the projection picture.

[0127] S702: Perform recognition processing on the image to obtain a matching score between the action in the projection screen in the image and the action of the interactor.

[0128] For example, the projection control device can perform recognition processing on image 1 and obtain a matching score of 6 points between the action in the projected screen and the action of the interactor; perform recognition processing on image 2 and obtain a matching score of 7 points between the action in the projected screen and the action of the interactor; perform recognition processing on image 3 and obtain a matching score of 8 points between the action in the projected screen and the action of the interactor.

[0129] In an optional implementation, after obtaining a matching score corresponding to an image in the projection area, the projection control device may project the matching score in the projection area through the projection device, and after the matching score is projected for a preset time, the next image is projected. The preset time can be preset according to the needs of the interactor.

[0130] For example, the preset time length is 5 seconds. After obtaining the matching score of 6 points corresponding to image 1 in the projection area, the projection control device can project the words of the matching score of 6 points in the projection area through the projection device. After the projection of the words of the matching score of 6 points reaches 5 seconds, image 2 is projected.

[0131] In another optional implementation, when the projection control device completes the matching score for an image captured in the projection area and obtains the matching score, the matching score may not be displayed separately, but when the projection device projects the next image to the projection area, the previously obtained matching score may be projected and presented together, so as to achieve synchronous and coherent display of the image and the corresponding score.

[0132] For example, when the projection control device completes the matching score for the image 1 collected in the projection area and obtains a matching score of 6, the words "matching score 6" may not be displayed separately, but when the projection device projects the image 2 to the projection area, the words "matching score 6" may be projected and presented together, so as to achieve synchronous and coherent display of the image 2 and the matching score 6.

[0133] S703: Accumulate the matching scores corresponding to at least one image to obtain a matching score.

[0134] For example, the projection control device may accumulate the matching score of 6 points corresponding to image 1, the matching score of 7 points corresponding to image 2, and the matching score of 8 points corresponding to image 3 to obtain a matching score of 21 points.

[0135] S704: Display the matching points through the vehicle-mounted display device and upload them to the cloud service platform.

[0136] In this step, after the projection control device accumulates the matching scores corresponding to at least one image and obtains the matching score, the matching score can be displayed through the vehicle-mounted display device and uploaded to the cloud service platform.

[0137] In an optional implementation, the vehicle-mounted display device may display the matching score through icons, progress bars, or other graphical elements, making the information more intuitive and easy to understand, and helping users quickly grasp the overall situation of the matching score.

[0138] Optionally, after completing the matching calculation, the matching points can be uploaded to the cloud service platform, where they will be centrally processed and stored, and compared and sorted with other users' data.

[0139] For example, the projection control device can match the points of 21 points for display through the vehicle-mounted display device and upload it to the cloud service platform.

[0140] S705: Receive the sorting result returned by the cloud service platform, where the sorting result includes the ranking of the matching points.

[0141] In this step, the projection control device may receive a ranking result from the cloud platform, and the result may include matching score ranking information of the interactors.

[0142] Optionally, through the received sorting results, the projection control device can feed back the latest ranking information to the interactor, so that the interactor can understand his relative position in the overall user group in real time.

[0143] In an embodiment of the present application, the projection control device in the projection interaction system can perform image recognition processing to obtain a matching score between the projection painting in the image and the action of the interactor. Then, the matching score corresponding to at least one image can be accumulated to obtain a matching score, and then the matching score can be displayed through the vehicle display device and uploaded to the cloud service platform. After processing by the cloud service platform, the returned sorting result can be received. In the above process, the projection control device can display the accumulated matching score through the vehicle display device, so that the user can understand his performance in real time. At the same time, after the points are uploaded to the cloud service platform, data sorting and analysis can be performed in a wider user group. After receiving the returned sorting results, the interactor can understand his ranking, enhance the interactive experience, and meet the entertainment needs of the interactor.

[0144] Figure 8 This is a schematic diagram of the structure of the controller provided in the embodiment of the present application. Figure 8 The controller 20 provided in this embodiment includes: at least one processor 21 and a memory 22. Optionally, the controller 20 also includes a communication component 23. The processor 21, the memory 22 and the communication component 23 are connected via a bus 24.

[0145] In a specific implementation process, at least one processor 21 executes the computer-executable instructions stored in the memory 22, so that at least one processor 21 executes the above method.

[0146] The specific implementation process of the processor 21 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0147] In a specific implementation, the controller provided in the embodiment of the present application may be the projection control device in the above system embodiment or method embodiment, and is used to execute the above method.

[0148] In the embodiments of the present application, the controller provided can be flexibly selected as different controller types in the vehicle, such as a driving domain controller, a chassis domain controller, a cockpit domain controller, or any other type of controller in the vehicle. Those skilled in the art can make appropriate selections and configurations according to specific needs and application scenarios.

[0149] Optionally, in the above system embodiment or method embodiment, the projection control device may also be implemented by a processor in the controller.

[0150] In the above embodiments, it should be understood that the processor can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the invention can be directly implemented as a hardware processor, or can be implemented by a combination of hardware and software modules in the processor.

[0151] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (NVM), such as at least one disk storage.

[0152] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of this application is not limited to only one bus or one type of bus.

[0153] An embodiment of the present application provides a vehicle, comprising the projection interaction system described in the above embodiment, so as to implement the projection control method in the above embodiment.

[0154] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.

[0155] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.

[0156] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0157] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0158] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0159] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0160] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0161] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0162] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0163] Finally, it should be noted that those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed by the present invention, are not limited to the precise structure described above and shown in the drawings, and may be modified and changed in various ways without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A projection interactive system, characterized in that: include: Projection device, image acquisition device and projection control device; The projection device is used to project a projection picture for the interactors to interact in the projection area; The image acquisition device is used to acquire the image of the projection area; The projection control device is used to perform recognition processing on the image to obtain a matching score between the action in the projection screen in the image and the action of the interactor, wherein the matching score is used to indicate the degree of fit between the action of the interactor and the action in the projection screen; The projection device is further used to project the matching score on the projection area.

2. The system according to claim 1, characterized in that The performing recognition processing on the image to obtain a matching score between the action in the projection screen of the image and the action of the interactor includes: Determining the similarity between the action of the interactor and the action in the projection picture; The matching score is determined according to the similarity.

3. The system according to claim 1 or 2, characterized in that: The projection interaction system also includes: A voice announcement device is used to send a voice prompt to the interactor according to the matching score.

4. The system according to claim 3, characterized in that The voice broadcasting device is also used to play music when the interactor interacts with the projection screen.

5. The system according to claim 1 or 2, characterized in that: The projection interaction system also includes: The vehicle-mounted display device is used to display a matching score, where the matching score is obtained by accumulating matching scores corresponding to at least one image in the projection area.

6. A projection control method, characterized in that: A projection control device used in a projection interactive system according to any one of claims 1 to 5, comprising: Acquire an image of the projection area acquired by an image acquisition device; Performing recognition processing on the image to obtain a matching score between an action in a projection screen in the image and an action of the interactor, wherein the matching score is used to indicate a degree of fit between the action of the interactor and the action in the projection screen, wherein the projection screen is projected by the projection device for the interactor to interact; Wherein, the projection device is further used to project the matching score on the projection area.

7. The method according to claim 6, characterized in that The method further comprises: Accumulating the matching scores corresponding to at least one image to obtain a matching score; Displaying the matching points through the vehicle display device and uploading them to the cloud service platform; Receive a ranking result returned by the cloud service platform, wherein the ranking result includes a ranking of the matching score.

8. A controller, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to claim 6 or 7.

9. A vehicle, characterized in that: include: A projection interactive system as claimed in any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to claim 6 or 7 when executed by a processor.

Images