Projection control method and vehicle

Abstract

The invention provides a projection control method and a vehicle. The projection control method comprises the following steps: detecting whether a target object is included in a vehicle; if the vehicle comprises the target object, obtaining related parameters of the target object; wherein the relevant parameters comprise one or more of the following items: body parameters; gaze parameters for the projection; behavior parameters; spatial parameters; projection within the vehicle is controlled based on the relevant parameters of the target object.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and in particular to a projection control method and a vehicle. Background Art

[0002] With the development of smart cockpit technology, vehicles are increasingly equipped with a variety of interactive methods, such as central control screens, rear entertainment screens, and augmented reality head-up displays (AR HUDs). However, users of related technologies are prone to eye fatigue when interacting with screens. Summary of the Invention

[0003] This application provides a projection control method and a vehicle. The technical solution of this application is implemented as follows:

[0004] In a first aspect, a projection control method is provided, which detects whether a target object is included in a vehicle; if the target object is included in the vehicle, obtains relevant parameters of the target object; wherein the relevant parameters include one or more of the following: body parameters; gaze parameters for the projection; behavioral parameters; spatial parameters; based on the relevant parameters of the target object, controls the projection in the vehicle; and the projection includes a holographic image.

[0005] In an embodiment of the present application, the relevant parameters of the target object included in the vehicle are used as control factors for the projection in the vehicle; in this way, the relevant parameters of the projection can be adjusted in a timely manner according to the actual parameters of the target object, thereby reducing the probability of visual fatigue of the target object; at the same time, the projection can be a holographic image formed by a non-direct light source, which has low blue light radiation and will not cause direct damage to the vision or retina of the target object, thereby helping to protect the vision or retina of the target object.

[0006] In some embodiments, the gaze parameter includes the duration of time the target object gazes at the projection; the controlling the projection in the vehicle based on the relevant parameters of the target object includes: if the duration exceeds a preset duration, performing one or more of the following operations: outputting a first notification message; wherein the first notification message is used to prompt the target object to stop staring at the projection; controlling the first resource currently being displayed by the projection to pause, and displaying a second resource; wherein the distance focus of the second resource is greater than the distance focus of the first resource; controlling the first resource currently being displayed by the projection to pause, and displaying a third resource; wherein the third resource is used to prompt the target object to stop staring at the projection.

[0007] In an embodiment of the present application, by detecting the gaze time of the target object in real time, if the gaze time is too long, an automatic rest reminder is given, the focus is switched between near and far, the line of sight is guided, and the playback of the content is interrupted to provide a reminder. In this way, prolonged eye strain is effectively prevented and a balance is achieved between immersive experience and vision health.

[0008] In some embodiments, the gaze parameter includes the distance between the target object and the projection; the controlling the projection within the vehicle based on the relevant parameters of the target object includes: if the distance is less than the minimum safety distance, performing one or more of the following operations: lowering the brightness of the projection; adjusting the display area of the projection to an area that matches the distance between the target object and the projection; outputting a second notification message; wherein the second notification message is used to prompt the target object to move backward a preset distance.

[0009] In an embodiment of the present application, the viewing distance of the target object is detected in real time. If the viewing distance is too close, the brightness is reduced, or the target object is prompted to move back, or the display area of the projection is adjusted to keep the distance between the target object and the projection within a safe distance, thereby effectively alleviating visual fatigue and eye adjustment burden caused by close viewing.

[0010] In some embodiments, the behavior parameters include the posture of the target object; controlling the projection in the vehicle based on the relevant parameters of the target object includes: if the posture meets the requirements, performing one or more of the following operations: outputting a third notification message; wherein the third notification message is used to prompt the target object to adjust the posture; adjusting the display area of the projection to an area that matches the posture.

[0011] In an embodiment of the present application, the posture of the target object is detected in real time. If the posture meets the requirements, the target object is prompted to adjust the posture, or the projected display area is adjusted to prompt the target object to adjust the bad posture and reduce the probability of visual fatigue of the target object.

[0012] In some embodiments, the physical parameters of the target object include one or more of the following: binocular corrected vision of the target object; the age of the target object; the age range of the target object; the controlling the projection in the vehicle based on the relevant parameters of the target object includes: determining the display resources of the projection, or the display interface of the projection, or the display parameters of each display resource based on one or more of the binocular corrected vision, age, and age range; wherein, target objects with different binocular corrected vision, age, and age range correspond to different display resources; or target objects with different binocular corrected vision, age, and age range correspond to different display interfaces; target objects with different binocular corrected vision, age, and age range have different display parameters for the same display resource.

[0013] In the embodiment of the present application, it supports automatic identification of the age or vision status of the target object, and customizes the interactive content and interface based on the age or vision status, which is highly personalized and age-appropriate.

[0014] In some embodiments, the spatial parameters corresponding to the target object include one or more of the following: the spatial position of the target object; the spatial relative height of the target object; controlling the projection within the vehicle based on the relevant parameters of the target object includes: determining the display area of the projection based on one or more of the spatial position and the spatial relative height; wherein the distance between the display area and the target object is within a safe distance range.

[0015] In an embodiment of the present application, it supports automatic identification of the position of the target object and dynamically adjusts the projected display area based on the position, effectively alleviating visual fatigue and eye adjustment burden caused by close viewing.

[0016] In some embodiments, the method further includes: acquiring environmental parameters and status parameters of the vehicle; and adjusting display parameters of the projection based on one or more of the environmental parameters and the status parameters.

[0017] In the embodiment of the present application, the accuracy of projection control can be improved by using actual environmental parameters and the actual status of the vehicle as the basis for adjusting the display parameters of the projection.

[0018] In some embodiments, controlling the projection displayed in the vehicle based on the first information includes: if there are multiple target objects, determining the first target object with the youngest age from the multiple target objects; and controlling the projection in the vehicle based on relevant parameters of the first target object.

[0019] In the embodiment of the present application, when there are multiple target objects, the relevant parameters corresponding to the youngest target object are used as the main control factors, which can effectively protect the vision or retina of the youngest target object.

[0020] In some embodiments, the method further includes: in response to a voice or gesture request of the target object, acquiring a target instruction of the voice or gesture request; and executing the target instruction to control the projection.

[0021] In the embodiments of the present application, by combining voice and gesture operations, the target object can complete the operation without touching the screen, providing a more natural and easier interactive experience; reducing the problem that the system in related technologies relies heavily on touch or remote control, requires long-term coordination between eyes and hands, and is prone to fatigue.

[0022] In a second aspect, a projection control device is provided, the projection control device comprising:

[0023] a processing unit, configured to detect whether a target object is included in a vehicle;

[0024] an acquisition unit, configured to acquire relevant parameters of the target object if the target object is included in the vehicle; wherein the relevant parameters include one or more of the following: body parameters; gaze parameters for projection; behavior parameters; and spatial parameters;

[0025] Based on the relevant parameters of the target object, a projection within the vehicle is controlled; the projection includes a holographic image.

[0026] According to a third aspect, a vehicle is provided, comprising: a memory for storing executable instructions; and a processor for implementing the steps of the above method when executing the executable instructions stored in the memory.

[0027] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented.

[0028] In a fifth aspect, a computer program product is provided, comprising a computer program or instructions, which implement some or all of the steps in the above method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 A schematic diagram of an implementation flow of a projection control method provided in an embodiment of the present application;

[0030] Figure 2 This is an architecture diagram of an in-vehicle holographic projection interactive system provided in an embodiment of the present application;

[0031] Figure 3 A schematic diagram of the structure of a projection control device provided in an embodiment of the present application;

[0032] Figure 4 This is a schematic diagram of a hardware entity of a vehicle in an embodiment of the present application. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions of this application are further elaborated in detail below with reference to the accompanying drawings and embodiments. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0034] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0035] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0036] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing this application only and are not intended to limit this application.

[0037] In order to solve the problem of easy visual fatigue of the target object in the related art, the embodiment of the present application provides a projection control method, which can be applied to the projection control device in the vehicle. In some embodiments, the projection control device can be located in the corresponding body of the vehicle.

[0038] Figure 1 A schematic diagram of the implementation flow of a projection control method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the projection control method can be implemented through steps 101 to 103:

[0039] Step 101: Detect whether a target object is included in a vehicle.

[0040] In an embodiment of the present application, the target objects include passengers who are riding in a vehicle and have a need to look at the projection; or, when the vehicle is stationary, the driver who has a need to look at the projection; for example, children sitting in child seats, or passengers of different ages sitting in the back seat or on the front passenger seat.

[0041] In the embodiment of the present application, the transportation vehicle includes a motor vehicle, a car, an airplane, a train, a submarine, a helicopter, a ship, a boat, an aircraft or any other transportation vehicle.

[0042] In an embodiment of the present application, a camera, such as a cabin camera, is configured in the vehicle to detect passengers and drivers in the vehicle, and further analyze the characteristics of the detected passengers or drivers to determine whether there is a target object.

[0043] Step 102: If the vehicle includes a target object, obtain relevant parameters of the target object.

[0044] The relevant parameters include one or more of the following: body parameters; gaze parameters for projection; behavioral parameters; and spatial parameters.

[0045] In some embodiments, if a target object is included in the vehicle, a target object vision protection mode, such as a children's vision protection mode, is activated, and further, relevant parameters of the target object are obtained.

[0046] Physical parameters include the target's body shape, facial features, arm length, and corrected visual acuity. Gaze parameters include the distance between the target and the projection, and the duration of the target's gaze on the projection. Behavioral parameters include parameters that characterize whether the target exhibits undesirable posture within the vehicle, such as running, jumping, crossing legs, or sitting sideways. Spatial parameters include the target's relative position and height in space.

[0047] It should be noted that if the content corresponding to the projection is being played, then the relevant parameters obtained include gaze parameters and behavioral parameters; if the content corresponding to the projection has not started playing, then the relevant parameters obtained include body parameters and space parameters; that is, body parameters and space parameters are used to determine the display area, display content, or display parameters of the projection before it is played; gaze parameters and behavioral parameters are used to adjust the display parameters or display content of the projection being played.

[0048] Step 103: Control the projection within the vehicle based on relevant parameters of the target object.

[0049] Wherein, the projection includes a holographic image.

[0050] In an embodiment of the present application, controlling the projection includes controlling the projection display area, the content to be displayed, and display parameters, such as brightness, contrast, clarity, blue light filtering percentage, and screen flickering frequency.

[0051] In the embodiments of the present application, projection can be understood as holographic projection. The holographic image included in the projection can be a single-frame image or a continuous multi-frame image, that is, a video.

[0052] In an embodiment of the present application, the relevant parameters of the target object included in the vehicle are used as control factors for the projection in the vehicle; in this way, the relevant parameters of the projection can be adjusted in a timely manner according to the actual parameters of the target object, thereby reducing the probability of visual fatigue of the target object; at the same time, the projection can be a holographic image formed by a non-direct light source, which has low blue light radiation and will not cause direct damage to the vision or retina of the target object, thereby helping to protect the vision or retina of the target object.

[0053] In some embodiments, the above step 102 may be implemented through step A1, or through step A2, or through step A3, or through step A4, or through step A5:

[0054] Step A1: If the target object gazes at the projection for a time period exceeding a preset time period, perform one or more of the following operations;

[0055] Outputting a first notification message; wherein the first notification message is used to prompt the target object to stop looking at the projection;

[0056] Controlling the projection to pause the first resource currently being displayed and display a second resource; wherein the distance focus of the second resource is greater than the distance focus of the first resource;

[0057] The first resource currently being projected is controlled to pause, and a third resource is displayed; wherein the third resource is used to prompt the target object to stop looking at the projection.

[0058] In the embodiment of the present application, outputting the first notification message may include, but is not limited to, outputting color, outputting text, outputting sound, outputting graphics, outputting symbols, outputting pictures, and the like, all of which are convenient for prompting the target object to stop looking at the projection.

[0059] In the embodiment of the present application, the distance focus of a resource can be understood as the viewing angle corresponding to the resource. Then, the distance focus of the second resource is greater than the distance focus of the first resource, which can be understood as: the viewing angle corresponding to the second resource is farther than the viewing angle corresponding to the first resource. For example, the first resource is a near viewing angle, and the second resource is a far viewing angle.

[0060] In an embodiment of the present application, the first resource is a normally played video or picture, the second resource is an inserted long-angle viewing angle resource, and the third resource is a resource corresponding to the eye protection countdown.

[0061] In some embodiments, if the target object stares at the projection for more than a first preset time, only a first notification message is output; if the target object stares at the projection for more than a second preset time, the first notification message is output, and the first resource currently being displayed by the projection is controlled to be paused, and the second resource is displayed; if the target object stares at the projection for more than a third preset time, the first notification message is output, and the first resource currently being displayed by the projection is controlled to be paused, and the third resource is displayed. Here, the first preset time is less than the second preset time, and the second preset time is less than the third preset time.

[0062] This application simulates the eye adjustment process by alternately presenting far and near focal length images, thereby alleviating visual fatigue and achieving near and far focusing training (Accommodation Alternation).

[0063] This application can dynamically control content insertion, pause and switching based on user eye status and system rules through a related content scheduling module (Content Scheduling Submodule).

[0064] In an embodiment of the present application, by detecting the gaze time of the target object in real time, if the gaze time is too long, an automatic rest reminder is given, the focus is switched between near and far, the line of sight is guided, and the playback of the content is interrupted to provide a reminder. In this way, prolonged eye strain is effectively prevented and a balance is achieved between immersive experience and vision health.

[0065] Step A2: If the distance between the target object and the projection is less than the minimum safe distance, perform one or more of the following operations;

[0066] Lower the brightness of the projection;

[0067] Adjusting the display area of the projection to an area that matches the distance between the target object and the projection;

[0068] Output a second notification message; wherein the second notification message is used to prompt the target object to move backward a preset distance.

[0069] In some embodiments, if the distance between the target object and the projection is less than the minimum safety distance, the brightness is first lowered and a second notification message is output; if the time duration for which the distance between the target object and the projection is less than the minimum safety distance exceeds a preset value, the display area of the projection is adjusted to an area that matches the distance between the target object and the projection.

[0070] In the embodiment of the present application, the preset distance plus the current distance between the target object and the projection equals a distance value within a safe distance range, for example, within a range of 0.5 meters to 0.8 meters.

[0071] In the embodiment of the present application, outputting the second notification message may include, but is not limited to, outputting color, outputting text, outputting sound, outputting graphics, outputting symbols, outputting pictures, and the like, all of which are convenient for prompting the target object to move backward a preset distance.

[0072] In an embodiment of the present application, the viewing distance of the target object is detected in real time. If the viewing distance is too close, the brightness is reduced, or the target object is prompted to move back, or the display area of the projection is adjusted to keep the distance between the target object and the projection within a safe distance, thereby effectively alleviating visual fatigue and eye adjustment burden caused by close viewing.

[0073] In the embodiment of the present application, if the distance between the target object and the projection is greater than the maximum safe distance, one or more of the following operations are performed;

[0074] Increase the brightness of the projection;

[0075] Adjusting the display area of the projection to an area that matches the distance between the target object and the projection;

[0076] Output a fourth notification message; wherein the fourth notification message is used to prompt the target object to move forward a preset distance.

[0077] Here, the distance between the target object and the projection minus the preset distance is equal to a distance value within a safe distance range, for example, within a range of 0.5 meters to 0.8 meters.

[0078] In the embodiment of the present application, outputting the fourth notification message may include, but is not limited to, outputting color, outputting text, outputting sound, outputting graphics, outputting symbols, outputting pictures, and the like, all of which are convenient for prompting the target object to move forward a preset distance.

[0079] In an embodiment of the present application, the viewing distance of the target object is detected in real time. If the viewing distance is too far, the brightness is increased, or the target object is prompted to move forward, or the display area of the projection is adjusted to keep the distance between the target object and the projection within a safe distance, thereby effectively alleviating visual fatigue and eye adjustment burden caused by close viewing.

[0080] Step A3: If the posture of the target object meets the requirements, perform one or more of the following operations:

[0081] Outputting a third notification message; wherein the third notification message is used to prompt the target object to adjust its posture;

[0082] Adjust the projection's display area to match the pose.

[0083] In the embodiment of the present application, if the posture is a bad posture, then the posture meets the requirements, and the bad posture refers to running, jumping, crossing legs, and sitting sideways in the vehicle.

[0084] In the embodiment of the present application, outputting the third notification message may include, but is not limited to, outputting color, outputting text, outputting sound, outputting graphics, outputting symbols, outputting pictures, and the like, all of which are convenient for prompting the target object to adjust its posture.

[0085] In an embodiment of the present application, the posture of the target object is detected in real time. If the posture meets the requirements, the target object is prompted to adjust the posture, or the projected display area is adjusted to prompt the target object to adjust the bad posture and reduce the probability of visual fatigue of the target object.

[0086] Step A4: determining a display resource corresponding to the projection, or a display interface of the projection, or display parameters of each display resource based on one or more of the target subject's binocular corrected visual acuity, the target subject's age, and the target subject's age range;

[0087] Among them, target objects with different binocular corrected vision, ages, and age ranges correspond to different display resources; or target objects with different binocular corrected vision, ages, and age ranges correspond to different display interfaces; target objects with different binocular corrected vision, ages, and age ranges have different display parameters for the same display resource.

[0088] In the embodiments of the present application, the degree of the screen's impact on the target subject's vision is affected not only by the ambient light, but also by multiple display parameters such as blue light, screen flicker, and screen brightness. Furthermore, target subjects of different age groups have different tolerances to these display parameters. Therefore, a mapping relationship between age and display parameters can be established in advance based on the target subject's different tolerances to these display parameters at different age groups. The display parameters include at least one of the blue light filtering percentage, screen brightness range, and screen flicker frequency range. In the above mapping relationship, different age groups of the target subject have corresponding display parameter values with different ranges.

[0089] In an embodiment of the present application, it supports automatic identification of the position of the target object and dynamically adjusts the projected display area based on the position, effectively alleviating visual fatigue and eye adjustment burden caused by close viewing.

[0090] Step A5: Determine the display area or display orientation of the projection based on one or more of the spatial position of the target object and the spatial relative height of the target object.

[0091] The distance between the display area and the target object is within a safe distance range.

[0092] In the embodiment of the present application, the spatial position includes a position represented by longitude and latitude, or a relative position relative to a reference point. The spatial relative height of the target object includes the relative height of the target object compared to the seat it sits in when it is sitting in a vehicle.

[0093] In an embodiment of the present application, it supports automatic identification of the position of the target object and dynamically adjusts the projected display area based on the position, effectively alleviating visual fatigue and eye adjustment burden caused by close viewing.

[0094] In some embodiments, the above step 102 can be implemented by steps B1 and B2:

[0095] Step B1: If there are multiple target objects, determine the first target object with the youngest age from the multiple target objects.

[0096] Step B2: Control the projection within the vehicle based on the relevant parameters of the first target object.

[0097] In the embodiment of the present application, projections can be presented in the area corresponding to each target object, but in most cases, only a limited number of projections will be set up in a vehicle. When the number of target objects is greater than the maximum number of projections in the vehicle, then, for a projection, the relevant parameters of the youngest target object in the projection service area are used as the control factor, because the vision of the target object gradually develops and matures. The visual system of the target object has considerable plasticity during the gradual formation and maturation of visual functions at all levels after birth, especially before the age of 3 is the critical period of visual development, and before the age of 12 is the sensitive period. If there are adverse factors during the visual development period, it will hinder the normal development of vision. Therefore, when there are multiple target objects, using the relevant parameters corresponding to the youngest target object as the main control factor can effectively protect the vision or retina of the youngest target object.

[0098] In some embodiments, the method to be protected by this application further includes the following:

[0099] Acquire environmental parameters and status parameters of the vehicle; and adjust the display parameters of the projection based on the environmental parameters inside and outside the vehicle.

[0100] In the embodiment of the present application, the environmental parameters include illumination, interior light, temperature, and humidity. The state parameters of the vehicle include whether the vehicle is moving or stationary.

[0101] In the embodiment of the present application, the accuracy of projection control can be improved by using actual environmental parameters and the actual status of the vehicle as the basis for adjusting the display parameters of the projection.

[0102] This application can realize ambient-adaptive display, that is, automatically adjust display parameters according to changes in ambient light to improve viewing comfort and clarity.

[0103] In some embodiments, the method to be protected by this application further includes the following:

[0104] In response to a voice or gesture request from the target object, a target instruction corresponding to the voice or gesture request is acquired; and the target instruction is executed to control the projection.

[0105] In the embodiments of the present application, by combining voice and gesture operations, the target object can complete the operation without touching the screen, providing a more natural and easier interactive experience; reducing the problem that the system in related technologies relies heavily on touch or remote control, requires long-term coordination between eyes and hands, and is prone to fatigue.

[0106] The following describes the application of the projection control method provided in the embodiment of the present application in actual scenarios:

[0107] Figure 2This is an architecture diagram of an in-vehicle holographic projection interactive system based on children's vision protection provided in an embodiment of the present application; here, holographic projection refers to a technology that realizes three-dimensional suspended image display based on the principles of interference and diffraction, including forms such as laser interference and volume grating.

[0108] like Figure 2 As shown in the figure, the main control system in the in-vehicle holographic projection interactive system based on child vision protection coordinates the following modules through the central control host, and dynamically manages the startup logic and content push of the holographic projection in combination with the vehicle condition / environmental data (whether driving, lighting environment) obtained from the relevant interfaces:

[0109] Holographic projection display mode: installed on the back of the front headrest, roof or rear side wall, it uses laser / volume grating method to form suspended projection content in space, and controls the focal length to be above 0.5 meters.

[0110] Child Recognition Module: The cabin camera detects the passenger's body shape, facial features and position to determine the presence of child passengers and activate child mode.

[0111] Interactive Input Module: This module includes a microphone array and an infrared camera / Time-of-Flight (ToF) camera, enabling voice control and gesture recognition, while also preventing prolonged eye and hand focus on the screen. ToF cameras, which emit infrared light and measure distance to obtain depth information, are commonly used for gesture recognition and spatial perception. Infrared cameras capture infrared images and can identify faces, gestures, and other information in low-light environments.

[0112] Children's content control module: limits continuous viewing time, integrates content with alternating focus between near and far (such as games and learning tasks with focal length changes), and reduces adjustment fatigue.

[0113] Vision Protection Module: Dynamically adjusts projection brightness, contrast, and refresh rate based on the child's viewing distance, posture, and gaze duration, and periodically outputs "eyesight rest reminders" or automatically interrupts content playback. This module involves using eye features to analyze gaze direction and gaze duration to identify eye behavior (Gaze Tracking), and posture recognition (Posture Recognition) to determine the user's posture through image recognition algorithms to assess correct sitting posture.

[0114] Among them, the vision protection module includes the following sub-modules:

[0115] The input of the Gaze Tracking Submodule includes: face image stream from infrared / ToF camera; timestamp;

[0116] The processing logic of the gaze behavior monitoring submodule is as follows: using the eye feature points extracted by face recognition, the gaze direction is determined based on the position of the eye center relative to the head; and the cumulative time spent gazing at the projection area is counted.

[0117] The outputs of the gaze behavior monitoring submodule include: gaze time (in seconds); whether the continuous gaze exceeds the set threshold (e.g., 10 minutes);

[0118] The gaze behavior monitoring submodule performs an action: if the gaze times out, that is, exceeds the threshold, a rest prompt request is sent to the "prompt feedback submodule".

[0119] The input of the Viewing Distance Submodule includes: camera image and ToF ranging data;

[0120] The processing logic of the viewing distance recognition submodule is as follows: calculate the distance between the head and the projection plane through binocular / ToF; determine whether it is within the recommended safe distance range (0.5m to 0.8m);

[0121] The output of the viewing distance recognition submodule includes: the current viewing distance; whether it is in a close-range overexposure state;

[0122] The viewing distance recognition submodule performs an action: if the detection distance is less than 0.5m, that is, the distance is too close, a brightness reduction instruction is sent to the "environmental adaptation submodule" and a prompt is given to retreat.

[0123] The input of the Posture Evaluation Submodule includes: images from the in-vehicle camera;

[0124] The processing logic of the posture assessment submodule is as follows: using a convolutional neural network model to analyze the child's sitting posture (normal / skewed / prone, etc.);

[0125] The outputs of the posture assessment submodule include: sitting posture classification results; whether it is an unhealthy eye posture;

[0126] The execution action of the posture assessment submodule: If the posture is abnormal, such as poor sitting posture, a request to sit down and watch the content is sent to the "prompt feedback submodule", that is, a voice prompt "Please sit down and watch the content" is output.

[0127] The inputs of the Ambient Adaptation Submodule include: data from the ambient light sensor inside the vehicle; external lighting information (which can be connected to the vehicle CAN or environmental sensors);

[0128] The processing logic of the environmental adaptation submodule is to compare the current ambient light value with the preset projection clarity standard; adjust the projection brightness, contrast, and color temperature;

[0129] The outputs of the environmental adaptation submodule include: display parameter settings (e.g., brightness = 60%, color temperature = warm);

[0130] The environmental adaptation submodule performs the following actions: controlling the display device parameters of the "holographic projection display module".

[0131] The inputs of the Content Scheduling Submodule include: fixation time; current content type (such as video, game, animation);

[0132] The processing logic of the content scheduling submodule is to determine whether it is necessary to insert vision protection animation (such as distance viewing training); determine whether it is necessary to switch to distance focus content;

[0133] The output of the content scheduling submodule includes: content switching instructions;

[0134] The content scheduling submodule performs an action: pausing the current content and playing a far-focus animation (such as a bird flying far away) through the "projection content controller" for 30 seconds.

[0135] The input of the prompt feedback submodule includes: the status of each submodule;

[0136] Prompt feedback submodule processing logic: determine whether a prompt is needed; select the prompt method (image layer, voice, sound effect);

[0137] The output of the prompt feedback submodule includes: prompt content (text, voice);

[0138] The prompt feedback submodule performs the following actions: inserting eye protection content, such as superimposing prompt information in the projected content (for example, "Please rest your eyes"); voice broadcast: "You have been watching for a long time, take a break", or sending relevant image prompt instructions to the holographic projection display module.

[0139] The holographic projection display module receives the image prompt instruction sent by the prompt feedback submodule and the relevant instructions for adjusting the brightness / color temperature sent by the environment adaptation module, and responds to the relevant instructions.

[0140] It should be noted that the execution order of the main control system can be illustrated by the following example: when the child recognition module is activated, the vision protection module is started; the posture, viewing distance and gaze duration are collected every 5 seconds; if the gaze times out, the content scheduling submodule is called and the "distant viewing animation" is inserted; if the distance is too close, the environment adaptation module reduces the brightness and prompts to retreat; if the posture is not good, the feedback module gives a voice reminder; if used continuously for 20 minutes, the content is forced to pause and a countdown for a break is performed.

[0141] Figure 3 A schematic diagram of the structure of a projection control device provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the projection control device 300 includes:

[0142] The processing unit 301 is configured to detect whether a target object is included in a vehicle;

[0143] The acquisition unit 302 is configured to acquire relevant parameters of the target object if the vehicle includes the target object; wherein the relevant parameters include one or more of the following: body parameters; gaze parameters for projection; behavior parameters; and spatial parameters.

[0144] The processing unit 301 is configured to control the projection in the vehicle based on relevant parameters of the target object; the projection includes a holographic image.

[0145] In some embodiments, the gaze parameter includes the duration of time the target object gazes at the projection; the processing unit 301 is used to perform one or more of the following operations if the duration exceeds a preset duration: output a first notification message; wherein the first notification message is used to prompt the target object to stop looking at the projection; control the first resource currently being displayed by the projection to pause, and display a second resource; wherein the distance focus of the second resource is greater than the distance focus of the first resource; control the first resource currently being displayed by the projection to pause, and display a third resource; wherein the third resource is used to prompt the target object to stop looking at the projection.

[0146] In some embodiments, the gaze parameter includes the distance between the target object and the projection, and the processing unit 301 is used to perform one or more of the following operations if the distance is less than the minimum safety distance: lowering the brightness of the projection; adjusting the display area of the projection to an area that matches the distance between the target object and the projection; outputting a second notification message; wherein the second notification message is used to prompt the target object to move backward a preset distance.

[0147] In some embodiments, the behavior parameters include the posture of the target object, and the processing unit 301 is used to perform one or more of the following operations if the posture meets the requirements: output a third notification message; wherein the third notification message is used to prompt the target object to adjust the posture to the target posture; adjust the projected display area to an area that matches the posture.

[0148] In some embodiments, the physical parameters of the target object include one or more of the following: binocular corrected vision of the target object; the age of the target object; the age range of the target object; the processing unit 301 is used to determine the projected display resources, or the projected display interface, or the display parameters of each display resource based on one or more of binocular corrected vision, age, and age range; wherein, target objects with different binocular corrected vision, age, and age range correspond to different display resources; or target objects with different binocular corrected vision, age, and age range correspond to different display interfaces; target objects with different binocular corrected vision, age, and age range have different display parameters for the same display resource.

[0149] In some embodiments, the spatial parameters corresponding to the target object include one or more of the following: the spatial position of the target object; the spatial relative height of the target object; the processing unit 301 is used to determine the display area of the projection based on one or more of the spatial position and the spatial relative height; wherein the distance between the display area and the target object is within a safe distance range.

[0150] In some embodiments, the acquisition unit 302 is configured to acquire environmental parameters and state parameters of a vehicle;

[0151] The processing unit 301 is configured to adjust display parameters of the projection based on one or more of the environmental parameters and the state parameters.

[0152] In some embodiments, the processing unit 301 is configured to, if there are multiple target objects, determine a first target object with the youngest age from the multiple target objects; and control the projection in the vehicle based on relevant parameters of the first target object.

[0153] In some embodiments, the acquiring unit 302 is configured to respond to a voice or gesture request from a target object and acquire a target instruction corresponding to the voice or gesture request;

[0154] The processing unit 301 is configured to execute target instructions to control projection.

[0155] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0156] It should be noted that, in the embodiment of the present application, if the above-mentioned projection control method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods of each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software and firmware.

[0157] An embodiment of the present application provides a computer device including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0158] The present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements some or all of the steps in the above method. The computer-readable storage medium may be transient or non-transient.

[0159] An embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code runs in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0160] The present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented in hardware, software, or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (SDK).

[0161] It should be noted that the descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or similarities can be referenced to each other. The descriptions of the above device, storage medium, computer program, and computer program product embodiments are similar to the descriptions of the above method embodiments and have similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of this application, please refer to the description of the method embodiments of this application for understanding.

[0162] Figure 4 A schematic diagram of a hardware entity of a vehicle in an embodiment of the present application is shown in FIG. Figure 4 As shown, the hardware entity of the vehicle 400 includes: a processor 401, a communication interface 402 and a memory 403, wherein:

[0163] The processor 401 generally controls the overall operation of the vehicle 400. The overall operation may be to implement the projection control method provided in the embodiment of the present application, for example, Figure 1 The method shown.

[0164] The communication interface 402 enables the computer device to communicate with other terminals or servers through a network.

[0165] Memory 403 is configured to store instructions and applications executable by processor 401 and to cache data to be processed or processed by processor 401 and various modules in vehicle 400 (e.g., image data, audio data, voice communication data, and video communication data). This can be implemented using flash memory (FLASH) or random access memory (RAM). Data can be transmitted between processor 401, communication interface 402, and memory 403 via bus 404.

[0166] An embodiment of the present application provides a computer storage medium, which stores one or more programs. The one or more programs can be executed by one or more processors to implement the steps of the projection control method of any of the above embodiments.

[0167] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0168] The processor may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device that implements the functions of the processor may also be other electronic devices, which are not specifically limited in the embodiments of the present application.

[0169] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0170] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0171] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0172] The above are only implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the protection scope of the present application.

Claims

1. A projection control method, characterized in that: The method comprises: Detecting whether a target object is included in a vehicle; If the target object is included in the vehicle, obtain relevant parameters of the target object; wherein the relevant parameters include one or more of the following: body parameters; gaze parameters for projection; behavior parameters; space parameters; Based on the relevant parameters of the target object, a projection within the vehicle is controlled; the projection includes a holographic image.

2. The method according to claim 1, characterized in that The gaze parameter includes a duration for which the target object gazes at the projection; The controlling the projection in the vehicle based on the relevant parameters of the target object includes: If the duration exceeds the preset duration, perform one or more of the following operations: Outputting a first notification message; wherein the first notification message is used to prompt the target object to stop looking at the projection; Controlling the projection to pause the first resource currently being displayed and display a second resource; wherein the distance focus of the second resource is greater than the distance focus of the first resource; The first resource currently being displayed by the projection is controlled to pause, and a third resource is displayed; wherein the third resource is used to prompt the target object to stop looking at the projection.

3. The method according to claim 1, characterized in that The gaze parameter includes a distance between the target object and the projection; The controlling the projection in the vehicle based on the relevant parameters of the target object includes: If the distance is less than the minimum safe distance, perform one or more of the following operations: reducing the brightness of the projection; Adjusting the display area of the projection to an area that matches the distance between the target object and the projection; Output a second notification message; wherein, the second notification message is used to prompt the target object to move backward a preset distance.

4. The method according to claim 1, wherein The behavior parameter includes the posture of the target object; The controlling the projection in the vehicle based on the relevant parameters of the target object includes: If the posture meets the requirements, perform one or more of the following operations: Outputting a third notification message; wherein the third notification message is used to prompt the target object to adjust the posture; The display area of the projection is adjusted to an area matching the gesture.

5. The method according to claim 1, wherein The physical parameters of the target object include one or more of the following: binocular corrected vision of the target object; age of the target object; age range of the target object; The controlling the projection in the vehicle based on the relevant parameters of the target object includes: Determining the display resource of the projection, or the display interface of the projection, or display parameters of each display resource based on one or more of the binocular corrected visual acuity, age, and age range; Among them, target objects with different binocular corrected vision, ages, and age ranges correspond to different display resources; or target objects with different binocular corrected vision, ages, and age ranges correspond to different display interfaces; target objects with different binocular corrected vision, ages, and age ranges have different display parameters for the same display resource.

6. The method according to claim 1, characterized in that The spatial parameters corresponding to the target object include one or more of the following: the spatial position of the target object; the spatial relative height of the target object; The controlling the projection in the vehicle based on the relevant parameters of the target object includes: Determining a display area of the projection based on one or more of the spatial position and the spatial relative height; The distance between the display area and the target object is within a safe distance range.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: Acquiring environmental parameters and status parameters of the vehicle; Based on one or more of the environmental parameters and the state parameters, the display parameters of the projection are adjusted.

8. The method according to any one of claims 1 to 6, characterized in that The controlling the projection in the vehicle based on the relevant parameters of the target object includes: If there are multiple target objects, determine a first target object with the youngest age from the multiple target objects; The projection within the vehicle is controlled based on the relevant parameters of the first target object.

9. The method according to any one of claims 1 to 6, characterized in that The method further comprises: In response to a voice or gesture request of the target object, obtaining a target instruction corresponding to the voice or gesture request; The target instruction is executed to control the projection.

10. A means of transport, characterized in that: The transportation means include: a memory for storing executable instructions; The processor is configured to implement the steps of the projection control method according to any one of claims 1 to 9 when executing the executable instructions stored in the memory.

Images