Interaction system for use in a vehicle

Abstract

Interaction system for use in a vehicle, characterized in that the vehicle comprises a processor, a camera device and a projection device, wherein: the processor is configured to determine a motion field corresponding to a target movement based on a target movement selected by a user; the projection device is configured to project a projection screen corresponding to the target movement, comprising the movement field and an interaction object, wherein the interaction object comprises a manipulation object of the user during the movement and / or a virtual character participating in the target movement; the camera device is configured to capture a motion image of the user and the interaction object in the motion field in real time and to update the projection screen corresponding to the projection device based on the motion image.

Description

Technical FieldThe present application relates to an interaction technology for vehicles, particularly an interaction method, an apparatus, and an electronic device for vehicles.Prior ArtWith the increasing spread and application of vehicle intelligence, vehicles can also provide entertainment functions to their users in addition to the basic driving functions.In the prior art, only playing music or viewing video is supported by entertainment devices in the vehicle, making it difficult to effectively support the user's movement needs, so that the user experience is poor.Content of the Present Utility ModelThe present application provides an interaction method, apparatus, and electronic device that are applied in a vehicle to effectively support a user's movement needs, increase movement comfort, and improve the user experience.In a first aspect, the present application provides an interaction method applied in a vehicle, the vehicle including a camera device and a projection device, the method comprising:determining a motion field corresponding to the target motion based on a target motion selected by the user;projecting, by the projection device, a projection screen corresponding to the target movement, comprising the movement field and an interaction object, wherein the interaction object comprises a manipulation object of the user during the movement and / or a virtual character participating in the target movement;acquiring a motion image of the user and the interaction object in the motion field by the camera device in real time, and updating the projection screen corresponding to the projection device based on the motion image.Optionally, updating the projection screen corresponding to the projection device based on the motion image comprises:determining the position and posture information of the user and the interaction object at the current time point based on the motion image acquired at the current time point, and determining the projection screen for the next time point based on the position and posture information of the user and the interaction object;further comprising: a sound device;wherein the method further comprises: determining, based on the position and posture information of the user and the interaction object, whether or not to trigger a preset audio event in the target motion;wherein corresponding audio is played back by the sound device when the preset audio event is triggered.Optionally, the projection screen further comprises a display icon; wherein the method comprises:determining the display icon based on the position and posture information of the user and the interaction object, wherein the display icon is used to instruct the user the next recommended operation.Optionally, the vehicle further comprises: a control system, the control system comprising motion rules for the target motion;determining the display icon based on the position and posture information of the user and the interaction object, comprising:determining a state of motion corresponding to the position and posture information of the user and the interaction object at the current time point based on the motion rules, and determining the display icons to which both the user and the interaction object respectively correspond based on the state of motion at the current time point.Optionally, determining the motion field corresponding to the target motion based on the target motion selected by the user comprises:determining a shape and a standard size of the motion field based on the target motion selected by the user, and causing the projection device to preliminarily project the motion field based on the shape and the standard size;and determining the size of the adjusted motion field to cause the projection device to project the adjusted motion field based on the shape and the adjusted size.Optionally, determining the size of the adjusted motion field comprises:determining whether the preliminarily projected moving field is out of a movable range;wherein, when the movable range is exceeded, it is determined whether the amount corresponding to the movable range is less than a predetermined minimum amount of the movable field that can be projected;and wherein, when the size corresponding to the movable area is not less than the preset minimum size, a current movable area of the vehicle is determined based on the image captured by the camera device, the captured image including environment information corresponding to the vehicle;adjusting the standard size corresponding to the movable range to obtain an adjusted size.If the size corresponding to the movable region is less than the preset minimum size, the method optionally comprises:controlling the vehicle to automatically travel to a target location on the motion field where the target motion may be projected.In a second aspect, the present application provides an interaction device applied in a vehicle, the vehicle including a camera device and a projection device, the interaction device comprising:a processing module for determining a motion field corresponding to the target motion based on a target motion selected by the user;a projection module for projecting, by the projection device, a projection screen corresponding to the target movement, comprising the movement field and an interaction object, wherein the interaction object comprises a manipulation object of the user during the movement and / or a virtual character participating in the target movement;a capturing module for capturing a motion image of the user and the interaction object in the motion field by the camera device in real time, and updating the projection screen corresponding to the projection device based on the motion image.Optionally, the processing module is further used for determining the position and posture information of the user and the interaction object at the current time point based on the motion image captured at the current time point and determining the projection screen for the next time point based on the position and posture information of the user and the interaction object;further comprising: a sound device;wherein the method further comprises: determining, based on the position and posture information of the user and the interaction object, whether or not to trigger a preset audio event in the target motion;wherein corresponding audio is played back by the sound device when the preset audio event is triggered.Optionally, the projection screen further comprises a display icon; wherein the processing module further uses to determine the display icon based on the position and posture information of the user and the interaction object, wherein the display icon is used to instruct the user the next recommended operation.Optionally, the vehicle further comprises: a control system, wherein the control system comprises motion rules for the target motion; a processing module further used for determining the display icon based on the user's position and posture information and the interaction object, comprising:determining a state of motion corresponding to the position and posture information of the user and the interaction object at the current time point based on the motion rules, and determining the display icons to which both the user and the interaction object respectively correspond based on the state of motion at the current time point.Optionally, the processing module is used to determine a shape and a default size of the motion field based on the target motion selected by the user and to cause the projection device to preliminarily project the motion field based on the shape and the default size; and to determine the size of the adjusted motion field to cause the projection device to project the adjusted motion field based on the shape and the adjusted size.Optionally, the processing module is used to determine whether the provisionally projected field of motion is outside a movable range;wherein, when the movable range is exceeded, it is determined whether the amount corresponding to the movable range is less than a predetermined minimum amount of the movable field that can be projected;and wherein, when the size corresponding to the movable area is not less than the preset minimum size, a current movable area of the vehicle is determined based on the image captured by the camera device, the captured image including environment information corresponding to the vehicle;adjusting the standard size corresponding to the movable range to obtain an adjusted size.Optionally, the processing module is used to control the vehicle to automatically travel to a destination location on the field of motion where the target motion may be projected.In a third aspect, the present application provides an electronic device comprising: a processor; and a memory communicatively coupled to the processor; wherein the memory stores computer-executable instruction; wherein the processor executes the computer-executable instruction stored in the memory to implement the method related to the above first aspect.In a fourth aspect, the present application provides a computer readable storage medium storing the computer executable instruction which, when executed by the processor, is used to implement the method related to the above first aspect.In a fifth aspect, the present application provides a computer program product comprising a computer program, which computer program, when executed by the processor, is used to implement the method related to the above first aspect.The present application provides an interaction method, an apparatus, and an electronic device applied to a vehicle, wherein a user selects a target motion, a corresponding motion field is determined based on the target motion, and the determined motion field is projected by a projection device onto a projection screen of a movable area of a current position of a vehicle, an image within the current motion field is captured and captured by a camera device in real time, and position and posture information of a user and an interaction object is obtained from the image, and the projection screen is updated according to the obtained position and posture information to realize dynamic interaction with the user, effectively support the motion needs of the user, increase the outdoor motion comfort, and improve the user experience.Brief Description of the DrawingsThe drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present application and are used in conjunction with the specification to explain the principles of the present application. FIG. 1 shows a flow diagram of an interaction method applied in a vehicle and provided by embodiments of the present application; FIG. 2 shows a flow diagram of an interaction method applied in a vehicle and provided by embodiments of the present application; FIG. 3 is a diagram of an application scenario of an interaction method applied in a vehicle provided by embodiments of the present application; FIG. 4 is a diagram of an application scenario of an interaction method applied in a vehicle provided by embodiments of the present application; FIG. 5 is a schematic diagram of a structure of an interaction device applied in a vehicle and provided by embodiments of the present application; FIG. 6 is a diagram of an application scenario of an interaction method applied in a vehicle provided by embodiments of the present application; FIGS. 7 aand 7 b show a diagram of an application scenario of an interaction method applied in a vehicle and provided by embodiments of the present application; FIG. 8 is a schematic diagram of a structure of another interaction device applied in a vehicle and provided by embodiments of the present application; FIG. 9 is a schematic diagram showing a structure of an electronic device provided by embodiments of the present application;With reference to the drawings presented above, certain embodiments of the present application are shown, which will be described in more detail below. These drawings and textual descriptions are not intended to limit the scope of the concept of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to particular embodiments.DETAILED EMBODIMENTSExemplary embodiments are described in detail here, which are illustrated by way of example in the drawings. When the following description refers to the drawings, like numerals in different drawings designate like or similar elements, unless otherwise specified. The embodiments described in the following exemplary embodiments do not represent all embodiments that are consistent with the present application. Rather, they are only examples of devices and methods consistent with some aspects of the present application as described in the dependent claims.It should be noted that the user information (including, but not limited to, information about the user's device, personal information of the user, etc.) and data (including, but not limited to, the data used for analysis, the stored data, the displayed data, etc.) affected by the present application are information and data authorized by the user or fully authorized by all parties, and that the acquisition, use and processing of the relevant data must comply with the relevant laws, regulations and norms of the respective region, and that there are corresponding operational portals on which the users can choose whether to grant or deny their approval.With the increasing spread and application of vehicle intelligence, vehicles offer their users not only the basic driving functions, but also a rich experience through various interaction possibilities.Currently, prior art vehicles only support the control of the on-board entertainment device through voice or touch interaction so that the on-board entertainment device plays music and / or video for the user, and the interaction capabilities of the prior art vehicle are difficult to effectively support the user's movement needs outdoors, so that the user experience is poor.When the user wants to move outdoors, it is also currently necessary to prepare the corresponding field of outdoor movement and equipment in advance, but many outdoor sports equipment is inconvenient to transport. And it is necessary to set up or book the corresponding field of outdoor motion in advance, which increases the cost of outdoor motion for the user and reduces the efficiency of outdoor motion due to the need to use a part of the time for preparations in the initial stage.The present application, after having obtained a target movement selected by the user, determines a corresponding movement field corresponding to the target movement and projects a standard movement field corresponding to the target movement through a projection means of the vehicle, after which a camera means of the vehicle is also used to capture an image of a vicinity of the current position of the vehicle and determine a current movable range of the vehicle corresponding to the captured image, and judge whether the movable range exceeds the predetermined minimum movement field of the target movement, thereby appropriately adjusting the movement field corresponding to the target movement projected by the projection means based on the judgment result. After the setting of the movement field is completed, the camera device of the vehicle captures the projection screen in real time, and acquires the position and posture information of the user and the position and posture information of the interaction object on the projection screen. The projection screen for next time is determined based on the position and posture information at the current time. Relevant audio is played by the audio device of the vehicle to provide the user with the relevant next action instructions and promptly notify the user of the current status of the movement on the current movement field when it determines that a preset event is triggered. The movement needs of the user outdoors are satisfied by the interaction with the vehicle, and the user experience is improved.The present application provides an interaction method that is applied to a vehicle and serves to solve the above-described technical problems of the related art.The technical solutions of the present application and the manner in which the technical solutions of the present application solve the above-described technical problems will be described in detail in the following specific embodiments. These following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in certain embodiments. Embodiments of the present application will be described below in conjunction with the drawings.FIG. 1 shows a flow chart of an interaction method applied in a vehicle and provided by embodiments of the present application as shown in FIG. 1, and in particular comprising the following steps:S 101, determining a motion field corresponding to the target motion based on a target motion selected by the user.More specifically, the vehicle detects the target motion selected by the user and determines the corresponding motion field based on the target motion.Optionally, according to the target movement selected by the user, a shape of the movement field corresponding to the target movement and a standard size of the movement field are determined, wherein the movement field corresponding to the target movement can be projected based on the determined shape and the standard size.Optionally, when the movable range corresponding to the current position of the vehicle does not appropriately represent a projection of the motion field determined based on the shape and the standard size, the standard size is adjusted. The size of the adjusted motion field is determined and the projection is appropriately performed based on the shape of the motion field corresponding to the target motion and the size of the adjusted motion field.In one possible embodiment, a user terminal includes application software associated with the vehicle configuration. Based on the various types of motion presented in the application software, the target motion is selected by clicking on the user or by voice control.In one possible embodiment, the names of the various types of motion are displayed on the vehicle screen. The user selects the target movement by clicking or voice control.S102, project a projection screen corresponding to the target movement by the projection means.More specifically, the vehicle includes a camera device and a projection device. The projection screen corresponding to the target movement is projected by the projection device, wherein the projection screen comprises a specific movement field and an interaction object.Optionally, the projection device provisionally projects the movement field based on the shape determined in step S 101 and the standard size of the movement field of the target movement.Optionally, when the movable range corresponding to the current position of the vehicle does not appropriately represent a projection of the movement field determined based on the shape and the standard size, the adjusted movement field based on the shape and the adjusted size is projected by the projection means.In a possible embodiment, the interaction object comprises a manipulation object of the user during the movement and / or a virtual character which participates in the target movement. For example, if the selected target movement is a football game, the manipulation object of the user during the movement is a football, while the virtual character participating in the target movement is an opponent in the current game against the character played by the user.Optionally, the projection device real-time projects information about the user, the manipulation object, and other virtual characters during the movement based on the projected movement field, comprising at least one of a real-time position of the user, the real-time position of the virtual characters, a movement trajectory of the manipulation object, and the name of each position.S 103, acquiring a motion image of the user and the interaction object in the motion field by the camera device in real time, and updating the projection screen corresponding to the projection device based on the motion image.More specifically, acquiring the motion image of the user and the interaction object in the motion field by monitoring or capturing images by the camera device in real time, and determining each of the respective position and posture information of the user and the interaction object at the current time point based on the motion image acquired at the current time point, and determining the projection screen for the next time point based on the respective position and posture information of the user and the interaction object.Optionally, after the motion image at the current time is acquired, the motion image at the current time is processed and the position and posture information of the user and the interaction object is identified in the motion image at the current time.In a possible embodiment, the position and posture information of the hands of the user and / or the interaction object comprises the position and posture information of the limbs and the position and posture information of other body parts.Optionally, a motion type corresponding to the target motion is determined based on the position and posture information of the user and the interaction object in the motion image at the current time, and a motion rule corresponding to the target motion and / or the corresponding motion type is determined based on the motion type.In one possible exemplary embodiment, the movement type corresponding to the target movement is determined on the basis of the number of persons involved in the movement in the movement image at the current point in time, the position of each of these persons and the movement trajectory of the manipulation object.Optionally, a real-time movement process within the movement field of the target movement is determined based on the real-time position and posture information of the user and the interaction object, wherein a movement state corresponding to the movement field and / or the position and posture information is determined in the projection screen at the current time based on the movement rules of the target movement. It is determined whether a predetermined event for projection is triggered based on the state of motion at the current time, and display icons corresponding to the user and the interaction object are generated based on the triggered predetermined event when it is determined that the predetermined event for projection has been triggered to project the projection screen corresponding to the display icons. The motion rules include ending rules and starting rules for each segment of the target motion process.For example, in a basketball game, when position and posture information of a player of one of the two sides that throws a basketball into the basket is obtained, it is determined according to the rules of the basketball game that the throw of the basketball into the basket triggers a preset point adding event, the basketball team that throws the basketball is added a point according to the preset point adding event, and the total point number of the basketball team is projected onto the top of the corresponding basket of the basketball team after the addition of the one point.Optionally, the projection screen further comprises a display icon.Optionally, the display icon is determined based on the user and interaction object position and posture information, wherein the display icon is used to instruct the user a recommended operation for next action. Wherein, the recommended operation for the next step is a recommended behavior for the next action that is different from the action at the current time.In one possible embodiment, when the target movement is a football game based on the real-time position and posture information of each player within the movement field, it is determined that the ball has been shot by the player striking the ball, and the display symbol for the goalkeeper game is determined and generated according to the rules of the football port and projected by the projection means to the position of the goalkeeper to instruct the goalkeeper to perform the goalkeeper behavior next.Optionally, an association relationship between each of the predetermined events for projection and the corresponding position and posture information is configured for each of the movement types, and when the position and posture information is obtained, whether the position and posture information triggers the predetermined event for projection is determined according to the association relationship. And when it is determined that the preset event for projection has been triggered, the projection screen at the current time is changed according to the preset event, that is, the projection screen for next time is generated by projection.In a possible embodiment, when the position and posture information of the hand-swabbing of the user is acquired in the moving image, it is determined by the mapping relationship configured in the target movement that the position and posture information of the hand-swabbing of the user triggers a playback event for the projection, wherein a playback video is acquired based on the triggered playback event, and wherein the playback video is projected into the moving field, i.e., the projection screen for the next time is generated by projection.Optionally, the projection screen includes the real-time positions of the user and the interaction object, wherein a respective corresponding sport role name and / or position name is projected over the user and the interaction object. For example, in a football game, a goalkeeper is projected over the player who is holding the goal.In the interaction method applied in a vehicle and provided by embodiments of the present application, a target motion is selected by the user interacting with the vehicle, wherein a motion field having a corresponding shape and default size is determined based on the target motion. An image is captured in real time by a camera device of the vehicle, and the position and posture information of the user and the interaction object is obtained by processing the image recognition at the current time. According to the position and posture information, a triggered preset event is determined for the projection, and according to the preset event, the projection screen is determined for the next time and projected by the projecting means of the vehicle, so that the projection screen, which changes accordingly in real time with the process of movement, is projected by the information interaction in the vehicle, so that it enables the representation of the various basic requirements for the outdoor movement without the need for preparing the sports equipments and the field of movement for outdoor movement by the users in advance, thereby satisfying the needs of the users for outdoor movement and further improving the user experience.Optionally, the vehicle comprises a sound device.Optionally, it is determined based on the position and posture information of the user and the interaction object whether or not to trigger a preset audio event in the target movement. Corresponding audio is played back by the sound device of the vehicle when the preset audio event is triggered.Optionally, each scene in which the audio is needed in the target motion is determined, each audio among each scene being configured separately with associated position and posture information to obtain an audio correspondence relationship, thereby determining whether the position and posture information obtained at the current time point triggers the preset audio event of the target motion.In one possible embodiment, in a basketball game, it is determined that a player has performed a throw at the current time based on the rules of the basketball game as well as the position and posture information of the individual players at the current time and the movement trajectory of the basketball. When it is determined that the throw has not entered the basket based on the position information of the basketball that has not entered the basket and the player's position information, a preset audio event is triggered with an explanation of the action according to the audio correspondence relationship that determines the relevant position and posture information at the current time. According to the preset audio event and by the sound device of the vehicle, the audio of the throwing operation and the explanation of the action of the misring are played back. That is, the user can understand the details of the game by listening to the explanation of the action during the movement.In one possible embodiment, in a basketball game, it is determined that a player has performed a throw at the current time based on the rules of the basketball game as well as the position and posture information of the individual players at the current time and the movement trajectory of the basketball. When it is determined that the throw has entered the basket based on the position information of the basketball of each player, a preset audio event for successful throw is initiated. According to the preset audio event and by the vehicle's audio device, the audio relating to the juble of viewers simulated after the successful throw is played. That is, the user can determine that the ball has been successfully struck based on the audio associated with the jubel.In the interaction method applied in a vehicle and provided by embodiments of the present application, the position and posture information of the user and the interaction object at each time point is acquired by the vehicle identification. And when a preset audio event determined by the position and posture information is triggered, the corresponding audio is played back in real time using the sound device of the vehicle. If the user does not obtain the relevant information in time, they are played back by the audio in time to avoid missing the key information during the movement, thereby further improving the user experience.Optionally, after the projection of the motion field corresponding to the target motion, it is determined whether the movable area corresponding to the current position of the vehicle can appropriately represent the projection of the motion field determined according to the shape and the standard size based on the determined shape and the standard size in step S 101. When the movable range corresponding to the current position of the vehicle does not appropriately represent a projection of the movement field determined based on the shape and the standard size, the standard size is adjusted. The size of the adjusted motion field is determined and the projection of the motion field is again performed based on the shape of the motion field as well as the size of the adjusted motion field. The specific method is illustrated in Figure 2 and comprises the following steps:S 201, determining whether the preliminarily projected moving field is outside a movable range.More specifically, the vehicle preliminarily projects the moving field having a standard size and shape by the projection means, and determines whether the preliminarily projected moving field is outside the moving range corresponding to the current position of the vehicle based on the range occupied by the projection screen displayed after the projection.In one possible embodiment, an image of the projection screen represented by the projection is captured by the camera device after the projection, wherein when it is determined after the processing that the projection screen after the preliminary projection is not completely represented in the current movable area of the vehicle and a part thereof is represented in the inactiveable area, it is determined that the movement field represented by the preliminary projection is outside the movable area. The specific method steps are shown in step S 202.In one possible embodiment, an image of the projection screen represented by the projection is captured by the camera device after the projection, and when it is determined after the processing that the projection screen after the preliminary projection is completely represented in the current movable area of the vehicle, it is determined that the movement field represented by the preliminary projection is not outside the movable area. The specific method steps are represented in step S203.Optionally, it is determined by the user whether or not the preliminarily projected moving field is capable of executing the target movement, wherein step S203 is executed when it is determined that the target movement can be executed, while step S202 is executed when it is determined that the target movement cannot be executed.Optionally, when the user determines that the target movement cannot be performed, the user makes adjustment-specific position and posture information, and when the camera device captures an image and the relevant adjustment-specific position and posture information is recognized, the adjustment-specific position and posture information performs size adjustment of the preliminarily projected movement field.In one possible embodiment, the adjustment-specific position and posture information comprises a reduction in the predetermined size and an increase in the predetermined size.S 202 Determine whether the amount corresponding to the movable area is less than a predetermined minimum amount of the movement field that can be projected.More specifically, when it is determined that the preliminarily projected moving field is outside the movable range, it is further determined whether the amount corresponding to the movable range is smaller than a predetermined minimum amount of the moving field that can be projected.In one possible embodiment, when it is determined that the size corresponding to the movable area is not less than the predetermined minimum projectable size of the movement field, the projection device is capable of projecting the movement field of the predetermined minimum size of the target movement within the movable area corresponding to the current position of the vehicle, the adjusted movement field within the current movable area being determined according to step S 204 and step S 205.In a possible embodiment, if it is determined that the size corresponding to the movable area is smaller than the predetermined projectable minimum size of the movement field, the projection device is not able to project the movement field of the predetermined minimum size of the target movement within the movable area corresponding to the current position of the vehicle, wherein the adjusted movement field is determined according to step S 206 and step S 207.S203, determine the adjusted size as a standard size.More specifically, when it is determined that when the preliminarily projected motion field does not exceed the movable range, the movable range corresponding to the current position of the vehicle is capable of presenting a full motion field of the target motion to the user to execute a subsequent motion based on the projected motion field, then it is determined that the standard size is an adjusted size, that is, there is no need to make adjustments to the preliminarily projected motion field.S 204, determining the current movable range of the vehicle based on the image captured by the camera device.More specifically, when it is determined that the amount corresponding to the movable range is not less than the predetermined minimum projectable amount of the movement field, an image is captured by the camera device, the current movable range of the vehicle is determined based on the image captured by the camera device, the captured image including environment information corresponding to the vehicle.Optionally, the surrounding information about the current position of the vehicle is captured by the camera device of the vehicle, wherein the maximum range in which there is no obstacle affecting the target movement is determined according to the surrounding information about the vehicle, this maximum range being the movable range corresponding to the current position.S 205, adjusting the standard size according to the movable range to obtain an adjusted size.More specifically, adjusting the standard size according to the size of the movable region to obtain an adjusted size.In one possible embodiment, the adjusted size is obtained by expanding the default size when it is determined that the movable area is too large relative to the default size of the preliminarily projected motion field.In one possible embodiment, the adjusted size is obtained by decreasing the standard size when it is determined that the movable area is too small relative to the standard size of the preliminarily projected moving field.S 206, controlling the vehicle to automatically travel to a target location on the movement field where the target movement can be projected.More specifically, when it is determined that the amount corresponding to the movable area is smaller than the predetermined minimum projectable amount of the movement field, a position where the vehicle is parked is newly determined, so that the movable area corresponding to the position can represent the projection of the movement field having the standard size, and that the vehicle is controlled to automatically travel to a target location on the movement field where the target movement can be projected.Optionally, the vehicle includes a navigation system and a map system.Optionally, environment information of the vehicle within a threshold range is obtained based on the map system, wherein no presence of obstacles that impede the movement and exceed the range of the preset minimum size is determined based on the environment information displayed within the threshold range on the map system, and this range is newly determined as a movable range, and wherein the destination of the vehicle corresponding to the movable range is determined. Thereby, a travel route is generated based on the navigation system, and the vehicle is controlled to automatically travel to the destination based on the travel route. Wherein, the travel route is a route of the vehicle from the current position to the destination.S 207: Preliminarily projecting the motion field.More specifically, after the vehicle is controlled to automatically travel to the target location, based on the movable range corresponding to the target location, the projecting means of the vehicle is used to project the moving field of the target movement with a standard size and shape.Optionally, it is determined whether the projected motion field exceeds the current movable range as shown in step S201, which will not be described in detail in this embodiment.In the interaction method applied to a vehicle and provided by embodiments of the present application, after the projection of the motion field corresponding to the target motion, it is determined by the projection device according to a standard size and shape whether the current movable area of the vehicle can appropriately represent a projection of the motion field. If the projection of the motion field cannot be properly represented, the default size is adjusted according to the size of the difference between the movable area and the currently projected area of the motion field in another manner to determine the size of the adjusted motion field and reproject the motion field. If the moving field cannot be projected fully or appropriately, the projected size of the moving field is adjusted in time to solve the problem that the movable area corresponding to the parking position cannot support the projection of the moving scene of the target movement, thereby further improving the outdoor moving experience.In one possible embodiment, after the user selects the target movement as the badminton sport via the terminal, as shown in FIG. 3, the projection device 10 of the vehicle projects a mode menu on the current movable area corresponding to the selected badminton sport, so that the user makes the position and posture information corresponding to the selected mode according to the projected menu. The camera device 30 of the vehicle captures an image and obtains the position and posture information of the user-selected mode after the image processing. The mode corresponding to the position and posture information is determined according to the mapping relationship of the badminton sport mode, for example, the mode of the badminton sport mode is the badminton interactive single mode to determine a moving scene corresponding to the badminton interactive single mode. And a projection screen corresponding to the moving scene of the badminton interactive single mode is projected from the projection means as shown in the projection screen corresponding to the preparation item in Fig. 4, the projection screen of the preparation item being shown as the position of the user and the name of the character of the badminton sport type, such as the player striking and the player receiving.Optionally, the in-vehicle camera captures an image corresponding to the projection screen in real time. When the image is processed and the position and posture information corresponding to the impact is obtained, a start of the movement is determined and the predetermined event for the projection of the impact display icon and the reception display icon is triggered. A projection screen corresponding to the impact display icon and the reception display icon is projected from the projection device. As shown in the projection screen corresponding to the moment of the start of the movement in Fig. 4, a solid line arrow in front of the player hitting the ball is projected by the projection means to instruct the player hitting the ball to hit the ball at the present time, while a broken line arrow in front of the player receiving the ball is projected by the projection means to instruct the player receiving the ball to prepare to receive the badminton ball.Optionally, the start of the movement is determined when the position and posture information corresponding to the impact is obtained. the preset audio event is triggered to cause the sound device of the vehicle to play the start of the movement and the positions of the impacting and receiving party, e.g., "The game now begins, please please please please hit the player located in the lower right corner of the movement field, the ball, and the player located in the upper left corner of the movement field prepare to receive the badminton ball."In one possible embodiment, the position and posture information corresponding to the impact triggers the sound device of the vehicle to play a reminder message about the landing area of the badmintonball, such as "attention to the player in the upper left corner, the badmintonball will land on their left side one meter before her.".Optionally, the camera device captures an image of the striking player in real time when striking. It is determined that the striking player has struck the badminton ball, and the movement trajectory of the badminton is recognized in real time. A projection screen corresponding to the movement trajectory of the badminton ball is projected from the projection device. As shown in the projection screen of the striking moment in FIG. 4, a trajectory of the badminton ball is projected by the projection means, the trajectory being projected with a broken line bearing an arrow, the arrow being used to instruct the user a moving direction of the badminton ball at the current moment from the position of the striking to the position of the reception of the badminton ball, so that the user is able to determine the position of the reception of the badminton ball more according to the moving direction instructed by the projection and to achieve a point.In a possible embodiment, the position of the badminton ball and the movement trajectory of the movement field are determined by the image of the movement trajectory of the badminton ball at the current moment acquired by the camera device, wherein the two sides continue the single game when the badminton ball is not off and receives the ball at the current moment as determined according to the position of the badminton ball and the boundary line of the movement field.In a possible embodiment, if it is determined that the badminton ball is off at the current moment, a preset audio event of the ball is triggered on the off, wherein the information that the ball is off is played back by the sound device. If it is determined that a page does not receive the ball at the current moment, the preset audio event of the failed reception of the ball is triggered, and the information about the failed reception of the ball is played back by the sound device.In one possible exemplary embodiment, an image of the current moment is captured by the camera device. When it is determined based on the image that the badminton ball is off or one of the players has not received the ball, the preset event of the projection process reproduction is initiated, and a corresponding projection screen of the process reproduction is projected by the projection means. As shown in the projection screen corresponding to the process reproduction in FIG. 4, a reproduction video of the movement trajectory of the ball in the off is included to make it easy for both sides to determine the result or score of the round of the movement based on the reproduction video.In the interaction method applied to a vehicle and provided by embodiments of the present application, a motion mode of a badminton sport type and a single sport type is determined by the user interacting with the vehicle, thereby causing the projection device of the vehicle to project a projection screen of a corresponding motion field according to the selected motion mode. The camera device of the vehicle captures an image of the projection screen in real time, identifies the position and posture information of both players and the position information of the badmintonball according to the image, thereby triggering various preset events in the badminton sport, so that the projection device is caused to project a corresponding projection screen according to the triggered preset events, and / or the sound device is caused to play a relevant audio, thereby providing the user with timely action instructions. The user is presented with a better outdoor movement experience while simultaneously satisfying his outdoor movement needs.Optionally, the vehicle comprises an interaction device.Optionally, FIG. 5 shows a schematic diagram of a structure of an interaction device applied in a vehicle and provided by embodiments of the present application. As shown in FIG. 5, the interaction device includes a projection device 10, a sound device 20, a camera device 30, a map system 40, a navigation system 50, an on-board display 70, a motion system 60, a configuration system 810, and a control system 820.In one possible embodiment, the user determines via the onboard display 70 that the target movement is a baseball sport type and selects a baseball sport type under default mode via the onboard display. The onboard display transmits the selected standard mode baseball sport type instruction to the movement system 60 interacting with the configuration system 810 based on the standard mode baseball sport type instruction to obtain a movement field corresponding to the standard mode baseball sport type, which is transmitted to the projector 810, through which a projection screen corresponding to the movement field is projected.Optionally, based on the projection screen corresponding to the moving scene, the camera device 30 is caused to capture an image of the moving field in real time and identify the position and posture information of the user in the image. Interacting with the map system 40 occurs upon identifying adjustment-specific position and pose information of the transfer field such that the map system determines a movable range that exists within a threshold range from the current position based on this position and pose information. A destination corresponding to this movable range is determined, and the current position and the destination are transmitted to the navigation system 50, so that the navigation system generates a travel route from the current position to the destination, thereby causing the vehicle to automatically travel to the destination based on the travel route.In one possible embodiment, the user determines that the target movement is a standard mode baseball sport. As shown in FIG. 6, the projection apparatus 10 projects a projection screen of a corresponding movement field based on the selected baseball sport type under standard mode, the projection screen of the movement field of the baseball sport type including the out-of-pounds lines of each movement range and the corresponding names of each range.As shown in FIG. 6, the respective names of the regions include, for example, a shot preparation region, a first base instruction region, a third base instruction region, an outer field region, an inner field region, a pitcher mound, and a home plate.Optionally, individual players enter the field based on a projection screen of a movement field of the baseball. The camera device captures a corresponding image in real time and processes and identifies the position and posture information in the image in real time. A preparation phase projection screen is projected from the projection device as shown in the preparation phase projection screen in Fig. 7b, including the positions corresponding to the individual players and names of sports character such as left field players, middle field players, right field players, first baseman, second baseman, third baseman, shortstop, pitchers, catchers and chatterers.Optionally, the camera device captures an image of the movement field in real time, and processes and identifies the position and posture information and the movement trajectory of the manipulation object in the image in real time. In identifying the position and posture information of the pitcher that lifts the baseball club, it is determined from the configuration information in the configuration system related to the baseball sports style that the position and posture information of the user at the current time point triggers a predetermined event for the start of the projection of the baseball sports style. Interacting with the control system is to determine by the control system that a preset event for the start of a baseball sport triggers a preset event for the pitcher to make a throw and triggers a preset event for the chatter to prepare to hit the ball.Optionally, the camera device acquires, in real time, an image of the pitcher that throws the ball and the mountain that strikes the ball, and obtains position and posture information of the pitcher that throws the ball and the mountain that strikes the ball, and a movement trajectory of the base ball after being struck. By interaction of the camera device with the control system and / or the configuration system, a predefined event for projecting the next direction of movement of the paddle is triggered on the basis of the position and posture information of the pitcher which throws the ball and of the paddle which strikes the ball. And the preset event for the projection of the next direction of movement of the pitcher or of the midfield player is determined based on the movement trajectory of the baseball after its stroke. The triggered preset event is transmitted to the movement system in real time, so that the movement system interacts with the projection device and / or the sound device and outputs instruction information regarding the next movement action of the player to improve the moving experience of the user outdoors.For example, as shown in the post-stroke projection screen in FIG. 7a, an arrow indication symbol is projected along the right boundary by the pre-chatter projector to direct the direction of the next motion to the chatter, and the orientation of the pre-chatter arrow indication symbol can be determined based on the baseball rules in the control system. The arrow display symbol indicating the direction of the next movement of the pitcher is projected by the projection means in front of the pitcher, wherein the orientation of the arrow display symbol in front of the pitcher can be determined on the basis of the movement trajectory of the baseball after the impact, i.e. the arrow points from the current position at which the pitcher is located to the position closest to the pitcher in the course of the movement of the baseball after the impact in the predetermined manner. The arrow display symbol indicating the direction of the next movement of the midfield player is also projected by the projection device in front of the midfield player, wherein the orientation of the arrow display symbol in front of the midfield player can be determined on the basis of the movement trajectory of the baseball after the shot, i.e. the arrow points from the current position at which the midfield player is located to the position closest to the midfield player in the course of the movement of the baseball after the shot in the predetermined manner.In one possible exemplary embodiment, a movement image within the movement field of the baseball is recorded in real time by a camera device. When position and posture information indicative of the process reproduction is acquired in the image at the current time, it is determined by the configuration system that the position and posture information triggers a preset event for the projection of the process reproduction of the current round of motion. And the associated video of the process reproduction is projected by the projection means as shown in the projection screen of the process reproduction in Fig. 7a.Optionally, a preset audio event that is triggered at the present moment is determined according to the control system and / or the configuration system, and the relevant audio is played back by the sound device according to the triggered preset audio event, whose specific method is similar to that of the playback method in the badmin sound sport type embodiment and will not be described any more in this embodiment of the present application.In the interaction method applied to a vehicle and provided by embodiments of the present application, when applied to a baseball sport outdoors, a projection screen of a movement field of the baseball in a movable area corresponding to the location of the vehicle is appropriately projected by the camera device and the projection device of the vehicle. After real-time position and posture information and movement trajectory of the baseball are obtained, a control system and a configuration system in the vehicle determine whether the real-time position and posture information and movement trajectory of the baseball trigger a relevant preset event. The projection screen corresponding to the preset event is projected when the relevant preset event is triggered to realize outdoor movement with a large number of persons, further improve the user experience, and meet the needs of outdoor movement with multiple persons.Optionally, the in-vehicle camera device acquires the actual number of persons in the current movement field and determines the standard number of persons in the current target movement mode by the movement system transmission control system, so that the movement system compares the standard number of persons with the actual number of persons to generate a difference in the number of persons for transmission to the projection device, so that the projection device projects the missing number of virtual objects corresponding to the difference in the number of persons, to solve the problem that it is difficult to perform the outdoor movement due to the insufficient number of outdoor movement personnel, to increase the optional kinds of outdoor movement, and to further improve the user experience.FIG. 8 is a schematic diagram of a structure of another interaction device applied in a vehicle and provided by embodiments of the present application. The schematic representation of the structure of the device is seen in FIG. 8, wherein the device 800 comprises:a processing module 801 for determining a motion field corresponding to the target motion based on a target motion selected by the user;a projection module 802 for projecting, by the projection device, a projection screen corresponding to the target movement, comprising the movement field and an interaction object, wherein the interaction object comprises a manipulation object of the user during the movement and / or a virtual character participating in the target movement;a capturing module 803 for capturing a motion image of the user and the interaction object in the motion field by the camera device in real time, and updating the projection screen corresponding to the projection device based on the motion image.Optionally, the processing module 801 is further used for determining the position and posture information of the user and the interaction object at the current time point based on the motion image captured at the current time point and determining the projection screen for the next time point based on the position and posture information of the user and the interaction object;further comprising: a sound device;wherein the method further comprises: determining, based on the position and posture information of the user and the interaction object, whether or not to trigger a preset audio event in the target motion;wherein corresponding audio is played back by the sound device when the preset audio event is triggered.Optionally, the projection screen further comprises a display icon; wherein the processing module 801 further uses to determine the display icon based on the position and posture information of the user and the interaction object, the display icon being used to instruct the user the next recommended operation.Optionally, the vehicle further comprises: a control system, wherein the control system comprises motion rules for the target motion; a processing module 801 further used for determining the display icon based on the user's position and posture information and the interaction object, comprising:determining a state of motion corresponding to the position and posture information of the user and the interaction object at the current time point based on the motion rules, and determining the display icons to which both the user and the interaction object respectively correspond based on the state of motion at the current time point.Optionally, the processing module 801 is used to determine a shape and a default size of the motion field based on the target motion selected by the user and to cause the projection device to preliminarily project the motion field based on the shape and the default size; and to determine the size of the adjusted motion field to cause the projection device to project the adjusted motion field based on the shape and the adjusted size.Optionally, the processing module 801 is used to determine whether the provisionally projected field of motion is outside a movable range;wherein, when the movable range is exceeded, it is determined whether the amount corresponding to the movable range is less than a predetermined minimum amount of the movable field that can be projected;and wherein, when the size corresponding to the movable area is not less than the preset minimum size, a current movable area of the vehicle is determined based on the image captured by the camera device, the captured image including environment information corresponding to the vehicle;adjusting the standard size corresponding to the movable range to obtain an adjusted size.Optionally, the processing module 801 is used to control the vehicle to automatically travel to a destination location on the motion field where the target motion can be projected.As shown in FIG. 9, an embodiment of the present application provides an electronic device 900, wherein the electronic device 900 includes a memory 901 and a processor 902.Wherein the memory 901 is used to store a computer instruction which can be executed by the processor, wherein the processor 902 executes various steps of the method in the above embodiments when the computer instruction is executed. Reference can be made to the corresponding description in the above exemplary embodiments of the method.Optionally, the aforementioned memory 901 may be either stand alone or integrated with the processor 902. When the memory 901 is stand-alone, the electronic device further includes a bus for connecting the memory 901 and the processor 902.Embodiments of the present application also provide a computer readable storage medium, wherein a computer instruction is stored on the computer readable storage medium, and wherein when the processor executes the computer instruction, various steps of the method in the above embodiments are executed.Embodiments of the present application also provide a computer program product comprising a computer instruction, wherein when the processor executes the computer instruction, various steps of the method in the above embodiments are performed.Other embodiments of the present application will readily occur to those skilled in the art upon consideration of the specification and practice of the utility models disclosed herein. This application is intended to cover all variations, uses, or adaptations of this application following the general principles of this application and including general knowledge or common technical means in the art not disclosed herein. The description and embodiments are to be considered as exemplary only. The true scope and spirit of this application is set forth in the following claims.It should be understood that this application is not limited to the precise structures described above and illustrated in the drawings, and that various modifications and changes may be made without departing from the scope of the invention. The scope of this application is limited only by the appended claims.

Claims

An interaction system for use in a vehicle, characterized in that the vehicle comprises a processor, a camera device and a projection device, wherein: the processor is configured to determine a movement field corresponding to the target movement based on a target movement selected by a user; the projection device is configured to project a projection screen corresponding to the target movement comprising the movement field and an interaction object, wherein the interaction object comprises a manipulation object of the user during the movement and / or a virtual character participating in the target movement; the camera device is configured to capture a movement image of the user and the interaction object in the movement field in real time, and update the projection screen corresponding to the projection device based on the movement image.The interaction system according to claim 1, characterized in that the processor is further configured to determine position and posture information of the user and the interaction object at the current time point based on the motion image acquired at the current time point and determine the projection screen for next time point based on the position and posture information of the user and the interaction object; wherein the vehicle further comprises: sound means; wherein the vehicle further comprises: sound means; wherein the processor is further configured to determine whether or not to trigger a preset audio event in the target motion based on the position and posture information of the user and the interaction object; wherein the sound means is configured to play corresponding sound when the preset audio event is triggered.The interaction system of claim 1 or 2, characterized in that the projection screen further comprises a display icon; wherein the processor is further configured to determine the display icon based on the position and pose information of the user and the interaction object, wherein the display icon is used to instruct the user the next recommended operation.The interaction system according to claim 3, characterized in that the vehicle further comprises: a control system, the control system comprising movement rules for the target movement; wherein the processor is further configured to determine a movement state corresponding to the position and posture information of the user and the interaction object at the current time point based on the movement rules, and to determine the display icons to which both the user and the interaction object respectively correspond based on the movement state at the current time point.The interaction system of claim 1, characterized in that the processor is further configured to determine a shape and a default size of the field of motion based on the target motion selected by the user and to cause the projection device to preliminarily project the field of motion based on the shape and the default size; determine the size of the adjusted field of motion to cause the projection device to project the adjusted field of motion based on the shape and the adjusted size.The interaction system according to claim 5, characterized in that the processor is further configured to determine whether the preliminarily projected moving field is outside a movable range; wherein, when the movable range is exceeded, it determines whether the size corresponding to the movable range is less than a predetermined minimum size of the moving field that can be projected; and wherein, when the size corresponding to the movable range is not less than the preset minimum size, it determines a current movable range of the vehicle based on the image captured by the camera device, the captured image including environment information corresponding to the vehicle; adjusts the standard size corresponding to the movable range to obtain an adjusted size.The interaction system of claim 6, characterized in that the processor is further configured to control the vehicle to automatically travel to a target location on the motion field where the target motion can be projected.

Images