Image interaction control method, device and equipment, vehicle and medium

Abstract

The invention discloses an image interaction control method, device and equipment, a vehicle and a medium. The image interaction control method comprises the following steps: detecting environment illumination intensity; and when the environment illumination intensity is lower than a preset illumination intensity threshold value, projecting an image to the projection area. The dual requirements of entertainment and exercise of the user can be met, and the application scene of the vehicle can be expanded.

Description

Technical Field

[0001] The present application belongs to the field of vehicle technology, and specifically relates to a control method, device, electronic device, vehicle and computer-readable storage medium for image interaction. Background Art

[0002] With the rapid development of vehicle intelligence, vehicles have gradually become the third space that accompanies people's lives. People's demand for smart cockpit entertainment systems is becoming more and more diverse. Currently, the more mainstream are in-car multimedia audio and video, games, social networking and other functions, which provide people with a rich entertainment experience besides driving, but still cannot meet people's needs in entertainment and sports. Summary of the Invention

[0003] This application aims to solve at least one of the technical problems existing in the prior art. To this end, this application proposes a control method, device, and vehicle for image interaction, as well as an electronic device, a computer-readable storage medium, and a computer program product, which can not only meet the dual needs of user entertainment and exercise, but also expand the application scenarios of the vehicle.

[0004] In a first aspect, an embodiment of the present application provides a method for controlling image interaction, including:

[0005] Detect ambient light intensity;

[0006] When the ambient light intensity is lower than a preset light intensity threshold, an image is projected onto the projection area.

[0007] In some embodiments, the above-mentioned image interaction control method is a vehicle-mounted image interaction control method.

[0008] In some embodiments, before projecting the image onto the projection area, the method further includes at least one of the following:

[0009] Detect the driving state of the vehicle and determine whether the vehicle is in a parked state;

[0010] Detect the vehicle key position and make sure the vehicle key is within the preset detection area.

[0011] In some embodiments, projecting an image onto the projection area includes:

[0012] A projection image is projected onto the projection area by a projection device, where the image includes at least one of entertainment content, sports content, and welcome content.

[0013] In some embodiments, the projection area includes at least two sub-areas, and projecting an image onto the projection area by a projection device includes:

[0014] Projecting an image to at least one sub-area through a projection device, wherein the image content of each sub-area is the same or different;

[0015] The above sub-areas are sub-areas specified by the user.

[0016] In some embodiments, the above-mentioned image includes at least one of display content and operation content.

[0017] In some embodiments, further comprising:

[0018] The sensing module obtains user operation instructions generated based on the operation content and executes the user operation instructions.

[0019] In some embodiments, the operation content includes at least two instruction areas, and the user operation instructions generated by the user based on the operation content are obtained by the sensing module, including:

[0020] Image analysis is performed based on the image captured by the camera to obtain the instruction area selected by the user and generate user operation instructions corresponding to the instruction area.

[0021] In some embodiments, the above-mentioned obtaining, through the sensing module, a user operation instruction generated by the user based on the operation content, includes:

[0022] The command area selected by the user is determined based on the motion signal collected by the sensor, and a user operation instruction corresponding to the command area is generated.

[0023] In some embodiments, the sensor includes a lidar or an infrared sensor.

[0024] In a second aspect, an embodiment of the present application provides a control device for image interaction, comprising:

[0025] A storage module, used for storing images;

[0026] Detection module, used to detect ambient light intensity;

[0027] The computing module is used to obtain an image from the storage module when the ambient light intensity is lower than a preset light intensity threshold;

[0028] The output module is used to project images onto the projection area.

[0029] In some embodiments, the image interaction control device is a vehicle-mounted image interaction control device.

[0030] In some embodiments, the output module includes a projection device, and the output module is specifically used to project an image onto the projection area through the projection device, and the image includes at least one of entertainment content, sports content, and welcome content.

[0031] In some embodiments, the image includes operational content, and the apparatus further includes:

[0032] The sensing module is used to obtain user operation instructions generated by the user based on the operation content.

[0033] In a third aspect, an embodiment of the present application provides an electronic device comprising: a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the image interaction control method as described in the first aspect are implemented.

[0034] In a fourth aspect, an embodiment of the present application provides a vehicle comprising the electronic device described in the third aspect.

[0035] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the image interaction control method as described in the first aspect are implemented.

[0036] The technical solution provided in this application detects ambient light intensity and projects an image onto a projection area when the ambient light intensity falls below a preset light intensity threshold. Because the projected image includes operational content and a command area, user interaction with the image is enabled. This not only enhances the user's entertainment experience but also meets the user's need for a real-life fitness experience, thereby broadening the vehicle's usage scenarios and better adapting it to the growing and diverse needs of users.

[0037] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become obvious from the description below, or will be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0039] Figure 1 Schematic diagram of a flow chart of a method for controlling image interaction in an embodiment of the present application;

[0040] Figure 2 This is a schematic diagram of the distribution of various components and systems in a vehicle according to an embodiment of the present application;

[0041] Figure 3 This is a schematic diagram of an instruction area in an embodiment of the present application;

[0042] Figure 4 This is a flow chart of a control method based on vehicle image interaction in an embodiment of the present application;

[0043] Figure 5 This is an architecture diagram of a system to which an image interaction control method according to an embodiment of the present application belongs;

[0044] Figure 6 This is a schematic structural diagram of a control device for image interaction according to an embodiment of the present application;

[0045] Figure 7 This is a schematic structural diagram of another image interaction control device according to an embodiment of the present application;

[0046] Figure 8 This is a schematic structural diagram of an electronic device according to an embodiment of the present application;

[0047] Figure 9 This is a schematic structural diagram of a vehicle in an embodiment of the present application;

[0048] Figure 10 This is a schematic structural diagram of another vehicle in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following describes embodiments of the present application in more detail with reference to the accompanying drawings. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are for illustrative purposes only and are not intended to limit the scope of protection of the present application.

[0050] It should be understood that the various steps described in the method embodiments of the present application can be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present application is not limited in this respect.

[0051] As described in the background technology section, with the rapid development of intelligent vehicles, people's demand for smart in-car entertainment systems is increasing. At the same time, due to the accelerated pace of modern life, people are spending more time in buildings, and work pressure is increasing. This has directly led to a significant increase in people's demand for exercise and fitness, seeking a balance between physical and mental health. However, while using entertainment and fitness equipment such as dance mats in indoor environments can meet this demand to a certain extent, the noise and vibration generated often easily affect neighbors downstairs, causing neighborhood conflicts. Therefore, how to meet people's growing demand for entertainment and fitness while ensuring that it does not interfere with the lives of others has become a pressing issue.

[0052] In addition, although most entertainment and fitness equipment can provide users with personalized exercise plans and entertainment experiences, the fact that they are only for individual use limits the interaction and social interaction between people to a certain extent, making it difficult to satisfy people's desire for deep social interaction. Therefore, this application provides a technical solution for a control method of image interaction. Figure 1 A flow chart of the image interaction control method provided in the embodiment of the present application is shown as follows: Figure 1 As shown, the following steps are included:

[0053] Step 101: Detecting ambient light intensity;

[0054] This step is to detect the light intensity of the surrounding environment of the corresponding device through a light detection device to obtain a light intensity value. For example, the light intensity of the surrounding environment of the corresponding device can be detected by a light sensor to obtain its light intensity value. The light detection device includes a light sensor; the above-mentioned corresponding device refers to a device with image interaction function or supports image interaction, such as a vehicle. The above-mentioned light sensor is a sensor that can sense light and convert it into an electrical signal. It is based on the photoelectric effect, that is, it uses light-sensitive materials to sense light. When these photosensitive materials receive light, their electrical properties will change, such as changes in resistance, generation of current or changes in voltage, etc. The sensor then converts these changes into electrical signals, usually amplified by a built-in amplifier for further processing or output. The number and position of the light sensors set on the corresponding device can be configured according to actual project needs. For example, a light sensor is set on the vehicle, and its position is as follows: Figure 2 shown.

[0055] Step 102: When the ambient light intensity is lower than a preset light intensity threshold, project an image onto the projection area.

[0056] Based on step 101, the obtained ambient light intensity value is compared with a preset light intensity threshold. If the value is lower than the preset light intensity threshold, the corresponding device can project an image into the projection area. If the value is greater than or equal to the preset light intensity threshold, it indicates that it is not appropriate to project an image in the area surrounding the corresponding device. The light intensity threshold is set based on previous work experience, i.e., the minimum light intensity required to not affect the projection effect of the projection device. The projection area refers to the area where the corresponding device projects the image, such as the flat area around the vehicle without obstacles. The image refers to the content that is presented in a visual manner through related equipment, such as projection equipment, vehicle welcome equipment, etc.

[0057] As described above, the image interaction control method can not only enhance the user's entertainment experience, but also meet the user's fitness experience needs of real sports participation, thereby broadening the usage scenarios of the corresponding equipment and better adapting the equipment to the user's growing and diverse needs.

[0058] In some embodiments, if the corresponding device is a vehicle, the above-mentioned image interaction control method is correspondingly transformed into a vehicle-mounted image interaction control method. The use of this vehicle-mounted image interaction control method can not only enhance the user's entertainment experience, but also meet the user's fitness experience needs for real sports participation, thereby broadening the vehicle's usage scenarios and better adapting the vehicle to the user's growing and diversified needs.

[0059] In an embodiment of the present application, when the corresponding device is a vehicle, before the vehicle projects an image onto the projection area, other operations may be performed to better enable the vehicle to project the image onto the projection area. Specifically, at least one of the following operations may be performed:

[0060] Detect the vehicle's driving status and determine whether the vehicle is in a parked state.

[0061] Detect the vehicle key position and make sure the vehicle key is within the preset detection area.

[0062] In some embodiments, before the vehicle projects an image onto the projection area, the vehicle's status can also be judged to ensure the vehicle's safety when performing the above-mentioned tasks. Specifically, the vehicle's built-in vehicle controller is used to obtain the vehicle's status information, and then the vehicle's status information is used to determine its current status, such as parking, driving, etc. The above-mentioned vehicle controller is an electronic device used to manage and control various systems and components of a car. It collects vehicle status information such as speed, acceleration, temperature, etc. through sensors, and then processes this information according to preset algorithms and control strategies. Finally, the actuators are used to precisely control various systems of the vehicle. In this application, the above-mentioned vehicle controller can be a vehicle control unit (VCU), and its position diagram is shown in FIG. Figure 2As shown in the figure, vehicle status information refers to the specific situation of the vehicle at a specific moment, which is used to reflect the safety, legality, and usability of the vehicle. It usually includes: vehicle temperature, rotational speed, speed, acceleration, gear status, location, and fuel consumption or battery power. For example, for new energy vehicles, the vehicle's gear status value can be used to determine whether it is in a parked state. Specifically, when the VCU receives a gear request signal from the gear controller, it will determine whether the gear shift conditions are met based on information such as the vehicle speed and power battery power. Based on this information, it controls the motor and transmission to achieve gear switching and stores the gear status value after switching. For example, the gear status value of the P gear is 0, the gear status value of the D gear is 1, the gear status value of the R gear is 2, and the gear status value of the N gear is 3. Afterwards, the vehicle status can be quickly determined by simply querying the current gear status value of the vehicle. When the gear status value of the above vehicle is 0, it means that the vehicle is currently in a parked state. In this way, before the vehicle projects an image onto the projection area, the vehicle's status information is used to determine the current state of the vehicle, which can avoid the danger caused by the user's accidental triggering while the vehicle is driving, thereby ensuring the safety of the user's subsequent operations.

[0063] In some embodiments, before the vehicle projects an image onto the projection area, a determination can be made as to whether the vehicle key is within a preset detection zone to ensure the user has permission to control the vehicle and project the image onto the projection area. Specifically, the vehicle's Passive Entry Passive Start (PEPS) system detects the vehicle key's location. If the key is detected within a preset detection zone, such as a 3-meter area around the vehicle, subsequent operations can proceed. For example, if a user approaches the vehicle with the key, the PEPS system automatically detects the key's location. If the key is within a 3-meter area around the vehicle, it is determined to be within the preset detection zone, and subsequent vehicle operations can proceed. The above-mentioned preset detection area refers to the maximum area in which the vehicle can detect the vehicle key; the keyless entry and start system is a vehicle intelligent entry system that integrates the two convenient functions of keyless entry and keyless start. It works through radio frequency communication between the electronic control unit and the vehicle key. That is, when the user carrying the key enters the preset detection area, the vehicle will send a low-frequency signal to the key, and the key will respond with a high-frequency response after receiving it. If the exchanged code matches the expected value and it is determined that the vehicle key is within the effective distance of unlocking the vehicle, the vehicle can be unlocked or the engine can be started; the car computer is a comprehensive system installed inside the vehicle to provide functions such as infotainment, communication, driving assistance and vehicle control. The layout diagram of the above-mentioned PEPS system and the car computer on the vehicle is shown in the figure below. Figure 2 shown.

[0064] In the embodiment of the present application, when the corresponding device is a vehicle, Figure 2 This is only a schematic diagram of the distribution of components and systems such as the projection device, sensing device, vehicle computer, vehicle controller, and keyless entry and start system in the above-mentioned vehicle. Their quantity and location can be configured according to actual project needs and are not restricted here.

[0065] In an embodiment of the present application, in the process of the corresponding device projecting an image onto the projection area, specifically, the corresponding device can be equipped with a projection device to project an image onto the projection area around it, such as the area around the vehicle. Specifically, the corresponding image is projected onto the area around the corresponding device using the projection device in combination with the actual needs of the user to meet the needs of the user. The projection device refers to a device that uses a projection light source to project images, videos and other content onto areas such as screens and the ground. The location and specific number of the projection device can be configured according to the actual needs of the project. For example, for vehicles that need to interact with images, such as Figure 2 As shown, four projection devices are arranged around the vehicle and are also controlled by a rotating mechanism so that the image can be projected to any area around the vehicle.

[0066] The above-mentioned images include entertainment content, sports content and welcome content, etc., among which entertainment content refers to content that provides users with relaxing and enjoyable audio-visual enjoyment, such as movies, TV series, concerts, games, etc.; sports content refers to a series of content related to sports, physical activities and fitness exercises, such as fitness videos, fitness games, dance videos, etc.; welcome content includes welcome information, indicator arrows and other guiding images, etc. For example, when the above-mentioned device is a vehicle, the vehicle logo, greetings and user-defined personalized information and other welcome content can be projected to the surrounding area of the vehicle through the projection device. Such a setting can make the above-mentioned projection device multifunctional, that is, one thing with multiple uses, which not only improves its use efficiency, but also saves the manufacturing cost of the corresponding equipment. Whether the above-mentioned images specifically include entertainment content, sports content, or welcome content, or include all three of the above content at the same time, can be determined according to the actual needs of the user. For example, if the user only has the need for exercise, the projected image only needs to include sports content.

[0067] In an embodiment of the present application, the projection area is divided into at least two sub-areas. Furthermore, when projecting content onto the projection area through a projection device, images can be projected onto at least one sub-area through the projection device, and the image content of each sub-area can be the same or different, so as to meet the different entertainment and fitness needs of different users and enhance the experience of each user. For example, the projection area around the vehicle is divided into at least two sub-areas, where sub-area 1 and sub-area 2 are used for projecting movies; or sub-area 1 is used for projecting movies, while sub-area 2 is used for projecting fitness videos. The above-mentioned sub-areas are part of the projection area, and refer to areas that can better present the image content projected by the projection device and are convenient for users to use.

[0068] In an embodiment of the present application, a user can specify a sub-area for projecting an image. That is, in the process of projecting an image to at least one sub-area by the projection device, the projection device can further project an image to the sub-area specified by the user. For example, sub-area 1 of the user-specified sub-areas is used for projecting an image. Specifically, when the corresponding device is a vehicle, the user-specified sub-area can be obtained in the following ways:

[0069] The first method involves the user observing the area surrounding the vehicle, selecting a suitable area, and then using the in-vehicle system to circle that area as a designated sub-area for image projection. For example, after exiting the vehicle, the user would circle the vehicle and observe the surrounding area, ultimately selecting an open and safe area in front of the vehicle's left front door. The user would then return to the vehicle and, through the in-vehicle system's interface, frame the area in front of the vehicle's left front door and set it as a sub-area for image projection. This method gives users tremendous autonomy and flexibility, allowing them to freely select areas of any size and orientation as sub-areas based on their needs and scenario characteristics.

[0070] The second method involves the vehicle automatically dividing its projection area into several fixed sections based on established rules. The results are displayed on the vehicle's display for the user to select. The user can then select a suitable sub-area from these sections to project the image based on their needs. For example, the projection area around the vehicle is evenly divided into eight sections, and the results are presented to the user on the in-vehicle display. After making some assessments, such as whether the area is flat and free of obstacles, the user selects section 1 as the sub-area to project the image.

[0071] The third method is to screen out several suitable areas and upload this information to the vehicle system for recommendation to the user. The user can then select one of these recommended projection areas as a sub-area for projection based on their needs. For example, six flat, obstacle-free areas are selected from the image data collected by the camera and recommended to the user. The user can then select area 6 as a sub-area for projection based on their needs.

[0072] In the embodiment of the present application, the number of projection devices corresponds to the number of sub-areas. This ensures that when there are at least two sub-areas, there are also at least two projection devices, i.e., each sub-area corresponds to one projection device. This configuration ensures that each user in their respective sub-area receives high-quality images projected by an independent projection device, thereby enhancing the user experience.

[0073] In an embodiment of the present application, the above-mentioned image includes at least one of display content and operation content, wherein the display content includes entertainment content or sports content that is only for users to watch, such as movies, TV series, and fitness videos, etc., to provide users with rich visual enjoyment; the operation content includes entertainment content or sports content that can be watched by users and allows users to participate in the interaction, such as interactive entertainment games, dances, and fitness courses, etc., to meet the user's dual needs for convenient entertainment and sports exercise.

[0074] In an embodiment of the present application, when the above-mentioned image includes operational content, the user operation instructions generated by the user based on the above-mentioned operational content can be obtained through the sensing module and the user operation instructions can be executed. Specifically, when the image is operational content, the user can follow or interact with it. At this time, the sensing module will use relevant devices, such as sensors, to obtain the user operation instructions generated when the user follows the image content or interacts with the image content. After that, the obtained user operation instructions are fed back to the vehicle computer, and the vehicle computer controls the corresponding area to execute the above-mentioned user operation. The above-mentioned sensing module refers to a system that captures and recognizes a series of user operation instructions through sensing devices such as sensors and cameras; user operation instructions include user gestures, stepping instruction areas, etc. The above-mentioned sensors include laser radar and infrared sensors. Among them, laser sensors are sensors that use laser technology for measurement. They are composed of lasers, laser detectors and measurement circuits, and can achieve non-contact long-distance measurement. Infrared sensors are sensors that use infrared as a medium to complete measurement functions. They are based on the physical effects or electrical effects presented by the interaction between infrared radiation and matter. When infrared radiation irradiates the sensor, it causes changes in the physical or electrical parameters inside the sensor, thereby achieving measurement of infrared radiation.

[0075] In some embodiments, the above-mentioned operation content includes at least two instruction areas. In the process of obtaining the user operation instructions generated by the user based on the operation content through the sensing module, the camera, lidar, infrared sensor and other sensing devices are further used to determine the instruction area selected by the user, and generate user operation instructions corresponding to the instruction area. In this way, setting multiple instruction areas in a sub-area can provide users with more diversified and interactive choices, thereby meeting diverse interactive needs. The above-mentioned instruction area refers to the area within the sub-area where the projection device projects for the user to perform corresponding operations, such as stepping, etc. The specific number of the instruction area can be flexibly set according to the actual needs of the project. For example, 5 instruction areas are set in both sub-areas. Specifically, Figure 3 As shown, these five command areas are designated as front, back, left, right, and confirmation areas. Users can achieve their desired actions by stepping on these command areas, thereby participating in interactive content such as dancing, entertainment games, and fitness. The process of selecting a command area is actually the process of performing specific actions within the command area.

[0076] In an embodiment of the present application, when a camera is used to determine the command area selected by the user, the camera can be used to first capture image data of the area surrounding the corresponding device, for example, image data of the area surrounding the vehicle, and then these image data can be analyzed, for example, by analyzing the above image data through methods such as target recognition, detection, and gesture recognition, and determining the command area selected by the user based on the analysis results, and further determining the user operation instructions corresponding to the selected command area; similarly, when using motion signals collected by sensors such as lidar and infrared sensors to determine the command area selected by the user, the sensor will detect the command area in which the user is located and the operations performed in the command area to determine the command area selected by the user and generate user operation instructions corresponding to the command area. For example, when using motion signals collected by infrared sensors to determine the command area selected by the user, if the user steps on and blocks the command area projected by the projection device, the infrared sensor will receive the infrared radiation emitted by the user and convert it into an electrical signal to sense the user's movements and generate corresponding user operation instructions accordingly. The above-mentioned action signal usually refers to the signal generated after the interaction between the sensor and the target object, which can reflect certain dynamic or static characteristics of the target object. For example, for a lidar, the action signal it collects is the light signal reflected back after the laser beam illuminates the target object.

[0077] In an embodiment of the present application, after using a camera, sensor, or other sensing device to determine that a user is operating in a certain command area and generating a corresponding user operation command, the user operation command must be transmitted to the infotainment system of the corresponding device, such as a vehicle's head unit. After verifying that the user operation command is valid, the system performs two operations: first, it immediately feeds back the verification result to the command area, causing the corresponding command area to change color, providing the user with the most intuitive operation feedback; second, it synchronizes the verified user operation command with images such as dance, entertainment games, and fitness, so that the objects in the image can execute the same command, thereby completing the synchronization of dance and fitness movements, as well as tasks such as scoring and passing levels in entertainment games. By enabling user interaction with projected content in this way, users can provide a more realistic and immersive entertainment experience while also meeting their exercise needs. The color of the command area is not fixed and can be personalized according to the user's preferences to meet their diverse needs. The objects include people, animals, and objects in the projected content. The above-mentioned infotainment system is a system that integrates multiple functions such as multimedia playback, communication functions, and voice control, which can improve the intelligence level of the corresponding device.

[0078] In some embodiments, the above-mentioned process of using sensing devices such as cameras, lidars, and infrared sensors to determine the command area and generate operation instructions, and then transmitting them to the infotainment system of the corresponding device for feedback, is also applicable to multi-user scenarios. In a multi-user scenario, each user selects a suitable sub-area to project the projection content of their choice. Users can interact with the projection content in the sub-area of their choice without worrying about conflicts or interference with the operations of other users. After receiving the operation instructions of multiple users, the system will perform efficient and accurate processing to ensure that each user's operation can receive timely and effective feedback. This adaptability to multi-user scenarios not only greatly improves the flexibility and scalability of image interaction, but also provides users with a more free and diverse entertainment experience, and can meet users' needs for exercise during entertainment.

[0079] In the embodiment of the present application, for a vehicle that supports image interaction, when the user determines the appropriate sub-area, selects an operation-type image, and determines its current state through the vehicle's gear state value, the vehicle controls the projected image and the specific process of the user interacting with the image, such as Figure 4 As shown, the following steps are included:

[0080] Step 401: Obtain the light intensity value of the vehicle projection area through the light sensor;

[0081] This step uses the characteristics of the light sensor to obtain the light intensity value of the area around the vehicle to prevent excessive light intensity from affecting the clarity of the vehicle's projected image.

[0082] Step 402: Determine whether the light intensity value is greater than a preset light intensity threshold;

[0083] On the basis of step 401 , the obtained light intensity value is compared with the preset light intensity value. If the value is greater than the preset light intensity value, step 403 is executed; otherwise, step 404 is executed.

[0084] Step 403: Do not start image interaction;

[0085] After determining in step 402 that the light intensity value of the area surrounding the vehicle is greater than the preset light intensity value, it is determined that the current area is not suitable for the vehicle to project an image, and image interaction is not started.

[0086] Step 404: determine whether the gear status of the vehicle is P gear;

[0087] In step 402, after determining that the illumination intensity value of the vehicle projection area is less than a preset illumination intensity value, the vehicle's gear status is further determined to be P, i.e., whether the vehicle is currently parked. If the gear status value is P, then the vehicle is currently in P, and step 406 is executed; otherwise, step 405 is executed. Different gears in the vehicle have different gear status values. For example, the P gear has a gear status value of 0, the D gear has a gear status value of 1, the R gear has a gear status value of 2, and the N gear has a gear status value of 3. The gear status values for different vehicles also vary. The vehicle's gear status can be obtained by the vehicle controller and sent to the vehicle computer. The vehicle computer then determines whether the gear status value is P. If it is P, subsequent operations are continued; otherwise, image interaction is not initiated.

[0088] Step 405: Do not start image interaction;

[0089] After determining that the gear status value of the vehicle is not the P gear status value in the above step 404, it is determined that the current vehicle is in a non-parking state. At this time, in order to avoid danger to the user, the image interaction is not started.

[0090] Step 406: Determine whether the vehicle key is within the preset detection area;

[0091] After determining in step 404 that the vehicle's gear position is the P gear position, the system further determines whether the vehicle key is within a preset detection area based on the vehicle key location information obtained by the keyless entry and start system. If the vehicle key is within the preset detection area, the system executes step 408; otherwise, the system executes step 407. The preset detection area is the distance range within which the vehicle key and the vehicle can communicate, for example, an area within 3 meters of the vehicle.

[0092] Step 407: Do not start image interaction;

[0093] If it is determined in step 406 that the vehicle key is outside the preset detection area, it indicates that the user does not have the authority to operate the vehicle. In this case, the image interaction is not started.

[0094] Step 408: Projecting an image according to the sub-area selected by the user;

[0095] After determining in step 406 that the vehicle key is within the preset detection area, operational projection content is projected into the sub-area selected by the user. The projection content includes dance, entertainment games, fitness, and other content, as well as at least two instruction areas for the user to interact with the projection content.

[0096] Step 409: Determine the instruction area selected by the user through the sensing device and generate a corresponding user operation instruction;

[0097] Based on step 408, after the user performs a corresponding operation in the instruction area, such as stepping on the corresponding instruction area, the vehicle's cameras, lidars, infrared sensors and other sensing devices use the data they collect, such as the user's motion signals, to perform data analysis, determine the instruction area selected by the user, and generate corresponding user operation instructions.

[0098] Step 410: Send the user operation instruction to the vehicle computer for verification;

[0099] The user operation instruction generated in step 409 will be sent to the vehicle computer for verification, that is, to verify whether the above user operation instruction is valid, and obtain a verification result, for example, verifying the validity of the user stepping on the left instruction area.

[0100] Step 411: Feedback the vehicle computer verification result to the command area;

[0101] Based on step 410, the verification result is immediately fed back to the command area, causing the color of the command area to change, providing intuitive operation feedback to the user. For example, after verifying that the user's stepping on the left command area is valid, the color of the left command area is changed to make it clear to the user that they have completed stepping on the left command area.

[0102] Step 412: Synchronize the verified user operation instruction to the object in the image;

[0103] On the basis of step 410, the verified valid user operation instruction is synchronized to the object in the dance, entertainment and fitness images, so that it performs the same operation as the user, for example, the person in the image moves to the left.

[0104] Step 413: End the image interaction.

[0105] In the embodiment of the present application, the number and position of projection equipment and sensing devices such as cameras, lidars, and infrared sensors configured on the vehicle can be configured in combination with the actual needs of the project to achieve high and low configurations of the vehicle, thereby adapting the vehicle to the needs of different users and markets.

[0106] When the user completes all interactions with the image, the vehicle projection ends. For example, after the user completes the entire dance, it is considered that the user has completed all interactions. At this time, if the user no longer selects other images, the image interaction ends.

[0107] In the embodiment of the present application, when the corresponding device is a vehicle, the system architecture to which the above-mentioned vehicle-mounted image interactive control method belongs is adopted, such as Figure 5 As shown, it is mainly composed of an input module 31, a control module 32 and an execution module 33, wherein the input module is used to send the acquired information, such as light intensity value, position of vehicle key, gear status value of vehicle and user operation instructions, to the vehicle computer, which includes a light sensor 311, a keyless entry and start system 312, a vehicle controller 313 and a sensing module 314; the control module mainly includes the vehicle computer 321, which is used to control the image interaction and its content according to the information input by the input module, and respond to the user operation instructions and synchronize these instructions to the corresponding objects in the image; the execution module includes a projection device 331, which projects the projection content fed back by the user to the vehicle computer and the corresponding instruction area in the sub-area specified by the user through the projection device, so that the user can interact with the projection content, so that the user's body movement can truly participate in the entertainment, realize the dual experience of entertainment and fitness, and increase the fitness usage scenario of the vehicle.

[0108] With the above Figures 1-4 Corresponding to the provided image interaction control method, the embodiments of the present application provide a corresponding device. Figure 6 FIG. 1 is a structural diagram of a control device for image interaction in an embodiment of the present application. Figure 6As shown, the image interaction control device includes a storage module 11, a detection module 12, a calculation module 13, and an output module 14, wherein the storage module 11 is used to store projection content; the detection module 12 is used to detect the ambient light intensity; the calculation module 13 is used to obtain the image from the storage module when the ambient light intensity is lower than the preset light intensity threshold; the output module 14 is used to project the image to the projection area.

[0109] As described above, controlling the projection of the corresponding device through the above-mentioned image interaction control device can not only enhance the user's entertainment experience, but also meet the user's fitness experience needs for real sports participation, thereby broadening the use scenarios of the corresponding device and better adapting it to the user's growing and diversified needs.

[0110] In some embodiments, if the corresponding device is a vehicle, it uses the vehicle-mounted image interaction control method to achieve image interaction control. In this case, the image interaction control device is a vehicle-mounted image interaction control device. Controlling the vehicle's projection through this vehicle-mounted image interaction control device not only enhances the user's entertainment experience but also meets the user's fitness needs through real-world exercise participation, thereby broadening the vehicle's usage scenarios and better adapting the vehicle to the growing and diverse needs of users.

[0111] In an embodiment of the present application, when the image interaction control device is an in-vehicle image interaction control device, the output module is specifically used to project images onto a projection area via a projection device, wherein the images include at least one of entertainment content, sports content, and welcome content. Specifically, the output module can project corresponding images onto the projection area surrounding the vehicle via the projection device configured for the vehicle based on the actual needs and instructions of the user to meet the needs of the user. Furthermore, when the device is applied to a multi-user scenario, the output module can project corresponding images onto multiple projection areas specified by multiple users. This adaptability to multi-user scenarios not only greatly enhances the flexibility and scalability of vehicles equipped with image interaction control devices, but also provides users with a more free and diverse entertainment experience, and can meet the user's needs for exercise during entertainment.

[0112] In some embodiments, the projection content projected by the control device includes operational content, that is, content that can interact with the user. Figure 7As shown, the image interaction control device further includes a sensing module 14, which is used to obtain user operation instructions generated by the user based on operational content. Specifically, when the projected content is operational content, the user can follow or interact with it. At this time, the sensing module will use relevant equipment, such as sensors, to obtain the user operation instructions generated when the user follows or interacts with the image. The obtained user operation instructions are then fed back to the vehicle computer, which controls the corresponding area to execute the user's operation. Through the coordinated operation of the sensing module and other modules, the device can better realize the control of image interaction, thereby meeting the dual needs of user entertainment and exercise while also expanding the application scenarios of the vehicle.

[0113] The present application also provides an electronic device, such as Figure 8 As shown, the electronic device includes: a processor 41 and a memory 42, the memory 42 stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the following are achieved: Figures 1-4 The steps of the image interaction control method.

[0114] The present application also provides a vehicle comprising Figure 6-Figure 7 The image interaction control device 51 is as follows: Figure 9 As shown, or as Figure 8 The electronic equipment shown, such as Figure 10 The vehicle's control device or electronic device based on the above-mentioned image interaction can expand the vehicle's application scenarios while meeting the dual needs of entertainment and sports training for different users.

[0115] The present application also provides a computer-readable storage medium, wherein a program or instruction is stored on the computer-readable storage medium, and when the program or instruction is executed by a processor, the following is realized: Figures 1-4 The steps of the image interaction control method.

[0116] The present application also provides a computer program product, which, when executed by a vehicle processor, implements the following Figures 1-4 The steps of the image interaction control method.

[0117] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0118] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general-purpose hardware platform, or of course, by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes a number of instructions for enabling a terminal or network-side device to execute the methods described in each embodiment of the present application.

[0119] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of this application and the scope of protection of the claims. These implementation methods are all within the protection of this application.

Claims

1. A method for controlling image interaction, characterized in that: include: Detect ambient light intensity; When the ambient light intensity is lower than a preset light intensity threshold, an image is projected onto the projection area.

2. The method according to claim 1, characterized in that The method is a control method for vehicle-mounted image interaction.

3. The method according to claim 2, characterized in that Before projecting the image onto the projection area, the method further includes at least one of the following: Detecting the driving state of the vehicle and determining that the vehicle is in a parked state; The position of the vehicle key is detected, and it is determined that the vehicle key is within a preset detection area.

4. The method according to any one of claims 1 to 3, characterized in that: Projecting an image onto the projection area includes: An image is projected onto the projection area by a projection device, wherein the image includes at least one of entertainment content, sports content, and welcome content.

5. The method according to claim 4, characterized in that The projection area includes at least two sub-areas, and projecting an image onto the projection area by the projection device includes: Projecting images onto the at least one sub-area using a projection device, wherein the images of each sub-area are the same or different; The sub-area is a sub-area specified by the user.

6. The method according to any one of claims 1 to 5, characterized in that: The image includes at least one of display content and operation content.

7. The method according to claim 6, characterized in that Also includes: The user operation instruction generated based on the operation content is acquired through the sensing module, and the user operation instruction is executed.

8. The method according to claim 7, characterized in that The operation content includes at least two instruction areas, and the acquiring, by the sensing module, a user operation instruction generated based on the operation content includes: Image analysis is performed based on the image captured by the camera to obtain the instruction area selected by the user, and a user operation instruction corresponding to the instruction area is generated.

9. The method according to claim 7, characterized in that The acquiring, by the sensing module, a user operation instruction generated based on the operation content includes: The command area selected by the user is determined based on the motion signal collected by the sensor, and a user operation instruction corresponding to the command area is generated.

10. The method according to claim 9, characterized in that The sensor includes a laser radar or an infrared sensor.

11. A control device for image interaction, characterized in that: include: A storage module, used for storing images; Detection module, used to detect ambient light intensity; a computing module, configured to acquire an image from the storage module when the ambient light intensity is lower than a preset light intensity threshold; The output module is used to project images onto the projection area.

12. The device according to claim 11, characterized in that The image interaction control device is a vehicle-mounted image interaction control device.

13. The device according to claim 12, characterized in that The output module includes a projection device, and the output module is specifically used to project an image onto a projection area through the projection device. The image includes at least one of entertainment content, sports content, and welcome content.

14. The device according to any one of claims 11 to 13, characterized in that: The image includes operation content, and the device further includes: The sensing module is used to obtain user operation instructions generated by the user based on the operation content.

15. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the image interaction control method as described in any one of claims 1 to 10 are implemented.

16. A vehicle, characterized in that: A control device for image interaction comprising any one of claims 12-14, or an electronic device according to claim 15.

17. A computer-readable storage medium, characterized in that The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the image interaction control method according to any one of claims 1 to 10 are implemented.

Images