Light adjusting method and device, electronic equipment and storage medium

Abstract

The invention discloses a light adjusting method and device, electronic equipment and a storage medium, and relates to the technical field of vehicles, and the method comprises the steps: obtaining first state data of a passenger in a vehicle, second state data of a reading object, and illumination data of a target position where the passenger in the vehicle is located, namely, the state data of an environment where the passenger is located; calculating according to the obtained data to obtain an optimal illumination angle and illumination intensity at the target position, and determining the light emitting information of each light source in a target position light source array corresponding to the illumination angle and the illumination intensity from a preset mapping relationship between the illumination angle and the illumination intensity and the light emitting information of each light source, light emitting control is conducted on all light sources in the target position light source array on the basis of the light emitting information, so that the light source array emits light meeting the illumination intensity and the illumination angle, and therefore illumination is provided according to the state of passengers in the vehicle.

Description

Technical Field

[0001] The present disclosure relates to the technical field of vehicles, and in particular, to a method and device for adjusting lighting, an electronic device, and a storage medium. Background Art

[0002] Currently, the in-vehicle reading lamp systems of passenger cars mostly have a small number of point light sources, and the control of the light intensity requires manual operation. With the increasing demand for viewing mobile phones, computers, and reading books and texts in the vehicle, the current in-vehicle reading lamps are becoming increasingly insufficient in usability and cannot provide sufficient and appropriate lighting, reducing the riding experience of passengers. Summary of the Invention

[0003] The present disclosure provides a method and device for adjusting lighting, an electronic device, and a storage medium. Its main purpose is to provide sufficient and appropriate lighting according to the state of the user in the vehicle to improve the riding experience of in-vehicle passengers.

[0004] According to a first aspect of the present disclosure, there is provided a method for adjusting lighting, which includes:

[0005] Obtain first state data of an in-vehicle occupant, second state data of a reading material, and lighting data of a target position where the in-vehicle occupant is located, where the first state data at least includes the position information and sitting posture information of the occupant, the second state data at least includes the position and angle of the reading material, and the lighting data at least includes the light irradiation intensity and angle;

[0006] Input the first state data, the second state data, and the lighting data into a pre-trained recognition model to obtain the optimal lighting angle and lighting intensity at the target position;

[0007] Determine the lighting information of each light source in the target position light source array corresponding to the lighting angle and the lighting intensity from the preset mapping relationships between the lighting angle and lighting intensity and the lighting information of each light source, where the lighting information at least includes the switch state information of the light source;

[0008] Perform lighting control on each light source in the target position light source array based on the lighting information of each light source in the target position light source array.

[0009] Optionally, the inputting the first state data, the second state data, and the lighting data into a pre-trained recognition model to obtain the optimal lighting angle and lighting intensity at the target position includes:

[0010] Calculate the first difference information between the position information of the occupant and the position of the reading material, and the second difference information between the sitting posture information of the occupant and the angle of the reading material in the pre-trained recognition model, and obtain the target result. Determine the target position light source array from the preset mapping relationships between the illumination angle and illumination intensity and the light emission information of each light source respectively. The target result includes the relative position relationship, angular relationship between the reading material and the occupant, and the viewing angle information of the occupant;

[0011] Based on the target position, determine the occlusion information of the occupant with respect to the light source array from the preset relationship between the occupant position and the position area covered by the light beams emitted by the light source array. The position area is determined based on pre-calibration;

[0012] Call a preset image recognition algorithm, and calculate based on the relative position relationship, angular relationship between the reading material and the occupant, and the viewing angle information of the occupant and the occlusion information of the occupant with respect to the light source array to obtain the optimal illumination angle and illumination intensity at the target position.

[0013] Optionally, the light emission control of each light source in the target position light source array based on the light emission information of each light source in the target position light source array includes:

[0014] Generate a light source emission control command based on the light emission information of each light source in the target position light source array;

[0015] Drive each light source in the target position light source array to emit light according to the light source emission control command.

[0016] Optionally, before obtaining the first state data of the vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the vehicle occupant is located, the method includes:

[0017] Determine whether there is a reading behavior of the vehicle occupant;

[0018] The obtaining of the first state data of the vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the vehicle occupant is located includes:

[0019] If there is a reading behavior, then execute the obtaining of the first state data of the vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the vehicle occupant is located.

[0020] Optionally, the determining whether there is a reading behavior of the vehicle occupant includes:

[0021] Determine whether there is a reading behavior of the vehicle occupant by analyzing the video images collected in the cockpit;

[0022] Alternatively, it is determined whether the in-vehicle occupant has a reading behavior by monitoring whether the reading shortcut key is activated;

[0023] Alternatively, it is determined whether the in-vehicle occupant has a reading behavior by analyzing the interactive voice.

[0024] Optionally, the obtaining of the first state data of the in-vehicle occupant, the second state data of the reading material, and the light data of the target position where the in-vehicle occupant is located includes:

[0025] The target image information is recognized by the preset deep learning algorithm to obtain the first state data, the second state data, and the light data.

[0026] Optionally, after controlling the light emission of each light source in the target position light source array based on the light emission information of each light source in the target position light source array, the method includes:

[0027] Monitoring whether the first state data changes during the reading process of the in-vehicle occupant;

[0028] If the posture of the in-vehicle occupant changes during the reading process, the light emission information of each light source in the target position light source array corresponding to the first state data is re-determined, and the light emission of each light source in the target position light source array is controlled based on the light emission information of each light source in the target position light source array.

[0029] According to the second aspect of the present disclosure, a lighting adjustment device is provided, including:

[0030] An obtaining unit, configured to obtain the first state data of the in-vehicle occupant, the second state data of the reading material, and the light data of the target position where the in-vehicle occupant is located, where the first state data at least includes the position information and sitting posture information of the occupant, the second state data at least includes the position and angle of the reading material, and the light data at least includes the light irradiation intensity and angle;

[0031] A calculation unit, configured to input the first state data, the second state data, and the light data into a pre-trained recognition model to obtain the optimal light angle and light intensity at the target position;

[0032] A first determination unit, configured to determine the light emission information of each light source in the target position light source array corresponding to the light angle and the light intensity from a preset mapping relationship between the light angle and light intensity and the light emission information of each light source, where the light emission information at least includes the on / off state information of the light source;

[0033] A first control unit, configured to control the light emission of each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

[0034] Optionally, the computing unit includes:

[0035] A first computing module, configured to calculate first difference information between the position information of the occupant and the position of the reading material, and second difference information between the sitting posture information of the occupant and the angle of the reading material in the pre-trained recognition model, to obtain a target result, where the target result includes the relative position relationship, angle relationship between the reading material and the occupant, and the perspective information of the occupant;

[0036] A second computing module, configured to determine the occlusion information of the occupant with respect to the light source array based on the target position from a preset relationship between the occupant position and the position area covered by the light beams emitted by the light source array, where the position area is determined based on pre-calibration;

[0037] A third computing module, configured to call a preset image recognition algorithm to calculate the best illumination angle and illumination intensity at the target position based on the relative position relationship, angle relationship between the reading material and the occupant, and the occlusion information of the occupant with respect to the light source array.

[0038] Optionally, the first control unit includes:

[0039] A generation module, configured to generate a light source emission control instruction based on the light emission information of each light source in the target position light source array;

[0040] A driving module, configured to drive each light source in the target position light source array to emit light according to the light source emission control instruction.

[0041] Optionally, the device includes:

[0042] A second determination unit, configured to determine whether there is a reading behavior of the in-vehicle occupant before the acquisition unit acquires the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located;

[0043] The acquisition unit is further configured to, when there is a reading behavior, execute the acquisition of the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located.

[0044] Optionally, the second determination unit includes:

[0045] An analysis module, configured to determine whether there is a reading behavior of the in-vehicle occupant by analyzing the video images collected in the cockpit;

[0046] A detection module, configured to determine whether there is a reading behavior of the in-vehicle occupant by monitoring whether a reading shortcut key is activated;

[0047] The analysis module is further configured to determine whether there is a reading behavior of the vehicle occupant by analyzing the interactive voice.

[0048] Optionally, the obtaining unit is further configured to:

[0049] Identify the target image information through the preset deep learning algorithm to obtain the first state data, the second state data, and the illumination data.

[0050] Optionally, the device further includes:

[0051] A monitoring unit, configured to monitor whether the first state data changes during the reading process of the vehicle occupant;

[0052] A second control unit, configured to re-determine the light emission information of each light source in the target position light source array corresponding to the first state data when the posture of the vehicle occupant changes during the reading process, and perform light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

[0053] According to a third aspect of the present disclosure, a vehicle is provided, including the lighting adjustment device described in the second aspect above.

[0054] According to a fourth aspect of the present disclosure, an electronic device is provided, including:

[0055] At least one processor; and

[0056] A memory communicatively connected to the at least one processor; wherein,

[0057] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the first aspect above.

[0058] According to a fifth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in the first aspect above.

[0059] According to a sixth aspect of the present disclosure, a computer program product is provided, including a computer program, and the computer program realizes the method described in the first aspect above when executed by a processor.

[0060] The lighting adjustment method and device, electronic device, and storage medium provided by the present disclosure obtain first state data of an in-vehicle occupant, second state data of a reading material, and lighting data of a target position where the in-vehicle occupant is located. The first state data at least includes the position information and sitting posture information of the occupant, the second state data at least includes the position and angle of the reading material, and the lighting data at least includes the light irradiation intensity and angle. Input the first state data, the second state data, and the lighting data into a pre-trained recognition model to obtain the optimal lighting angle and lighting intensity at the target position. From the preset mapping relationships between the lighting angle and lighting intensity and the lighting information of each light source, determine the lighting information of each light source in the target position light source array corresponding to the lighting angle and the lighting intensity. The lighting information at least includes the on / off state information of the light source. Perform lighting control on each light source in the target position light source array based on the lighting information of each light source in the target position light source array. Compared with the related art, by obtaining the first state data of the in-vehicle occupant, the second state data of the reading material, and the lighting data of the target position where the in-vehicle occupant is located, that is, the environmental state data where the occupant is located, calculate the optimal lighting angle and lighting intensity at the target position according to the data obtained above. From the preset mapping relationships between the lighting angle and lighting intensity and the lighting information of each light source, determine the lighting information of each light source in the target position light source array corresponding to the lighting angle and the lighting intensity. Perform lighting control on each light source in the target position light source array based on the lighting information, so that the light source array emits light that conforms to the lighting intensity and the lighting angle, thereby realizing providing lighting according to the state of the in-vehicle occupant.

[0061] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present application, nor is it used to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The drawings are used to better understand the solution and do not constitute a limitation to the present disclosure. Among them:

[0063] Figure 1 is a schematic flowchart of a lighting adjustment method provided by an embodiment of the present disclosure;

[0064] Figure 2 is a schematic diagram of calculating the optimal lighting angle at the target position provided by an embodiment of the present application;

[0065] Figure 3 is a schematic diagram of a preset mapping relationship between the occupant position and the lighting information of the light source provided by an embodiment of the present application;

[0066] Figure 4Schematic structural diagram of a lighting adjustment system provided by an embodiment of the present disclosure;

[0067] Figure 5 Schematic structural diagram of a lighting adjustment device provided by an embodiment of the present disclosure;

[0068] Figure 6 Schematic structural diagram of another lighting adjustment device provided by an embodiment of the present disclosure;

[0069] Figure 7 Schematic block diagram of an exemplary electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0070] The following describes exemplary embodiments of the present disclosure with reference to the accompanying drawings. Various details of the embodiments of the present disclosure are included to facilitate understanding, and they should be considered merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, descriptions of well-known functions and structures are omitted below for clarity and conciseness.

[0071] The following describes a lighting adjustment method, device, electronic device, and storage medium according to embodiments of the present disclosure with reference to the accompanying drawings.

[0072] Figure 1 Flowchart of a lighting adjustment method provided by an embodiment of the present disclosure.

[0073] As Figure 1 shown, the method includes the following steps:

[0074] Step 101: Obtain first state data of an in-vehicle occupant, second state data of a reading material, and illumination data of a target position where the in-vehicle occupant is located. The first state data includes at least the position information and sitting posture information of the occupant, the second state data includes at least the position and angle of the reading material, and the illumination data includes at least the light irradiation intensity and angle.

[0075] As a refinement of the above step 101, in response to an on instruction of an in-vehicle reading light, in order to make the reading light provide sufficient illumination that conforms to the current state of the in-vehicle occupant, it is necessary to obtain the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located, that is, obtain the position information and sitting posture information of the occupant, the position and angle of the reading material, and the intensity and angle of the light irradiating the target position at the current moment. Generally speaking, it is to obtain the state data of the in-vehicle occupant and the environmental data around the in-vehicle occupant.

[0076] Step 102: Input the first status data, the second status data, and the illumination data into a pre-trained recognition model to obtain the optimal illumination angle and illumination intensity at the target position.

[0077] As a refinement of the above Step 102, by analyzing and calculating the first status data, the second status data, and the illumination data obtained in Step 101, the optimal illumination angle and illumination intensity at the target position are obtained. The algorithm for analyzing and calculating the foregoing data can adopt but is not limited to a preset deep learning algorithm. The target position is the position inside the vehicle cockpit where the vehicle occupant is located, that is, any position inside the vehicle cockpit.

[0078] When calculating the optimal illumination angle and illumination intensity, it is performed through a pre-trained recognition model, and its recognition principle includes: in a three-dimensional coordinate system, according to the principle of light reflection, calculate the position of the incident light source, and then determine the optimal illumination angle and illumination intensity. Specifically, according to the first status data, determine the position of the occupant's face, which is used as the end point of the reflected light. The reading material is used as the reflecting surface. The second status data of the reading material (including the position and inclination data of the reading material) has been calculated through image recognition for the reflected light. Calculate the position of the required incident light source. This incident light source position is the optimal illumination angle at the target position, and calculate the illumination intensity according to the illumination data at the target position where the vehicle occupant is located.

[0079] When calculating the optimal illumination angle at the target position, use the light source (lamp bead position) as the light-emitting point of the light ray, and the reader's face as the incident point of the light ray. Calculate the incident angle according to the reflection principle, and this incident angle is the optimal illumination angle at the target position. Reference can be made to Figure 2 , Figure 2 FIG. 13 is a schematic diagram for calculating the optimal illumination angle at the target position provided by an embodiment of the present application.

[0080] When calculating the illumination intensity, it can be determined by searching through the preset mapping relationship between the illumination data at the target position where the vehicle occupant is located and the illumination intensity. The illumination data at the target position where the vehicle occupant is located is negatively correlated with the illumination intensity, that is, the smaller the illumination data at the target position where the vehicle occupant is located (indicating that the current environment of the occupant is darker), the greater the corresponding illumination intensity.

[0081] It should be noted that the surface of the reading material is generally a certain degree of diffuse reflection, that is, light rays emitted from the light source will be scattered to a certain extent after reflection, but the overall illumination direction conforms to the reflection principle.

[0082] Step 103: Determine the light-emitting information of each light source in the target position light source array corresponding to the illumination angle and the illumination intensity from the preset mapping relationship between the illumination angle and the illumination intensity and the light-emitting information of each light source.

[0083] As a refinement of the above step 103, according to the illumination angle and the illumination intensity calculated via step 102, look up the light emission information of each light source in the target position light source array corresponding to the illumination angle and the illumination intensity determined in step 102 from a preset mapping table (preset mapping relationship) established in advance. The target position light source array is the light source array corresponding to the target position where the vehicle occupant is located. The light source array is composed of a plurality of light emitting units arranged in series, and the light emission intensity and the light emission angle of each light emitting unit are independently controlled. The light source array can form a variety of the light emission combinations. The light emitting unit can be, but is not limited to, an LED lamp. The determined light emission information is the light emission angle and the light emission intensity of each light emitting unit.

[0084] For the convenience of understanding the multiple preset mapping tables, as Figure 3 shown, after determining the optimal illumination angle and illumination intensity at the target position based on the position information and sitting posture information of the occupant, according to the reflection principle, light up the corresponding light strip light emitting area. The light strip light emitting area here is the light emission information of each light source in the target position light source array, and the light emission information at least includes the switch state information of the light source. In the preset mapping relationship, for example, when the facial position 1 of the passenger is recognized, light up the light emitting area 1 of the light strip, that is, the switch state information of the light source corresponding to the light emitting area 1 is on, and according to the determined light emission intensity, adjust the light emission intensity corresponding to the light emitting area 1; the switch state information of the light source corresponding to the light emitting area 2 is on, and according to the determined light emission intensity, adjust the light emission intensity corresponding to the light emitting area 2; the switch state information of the light source corresponding to the light emitting area 3 is on, and according to the determined light emission intensity, adjust the light emission intensity corresponding to the light emitting area 3; specifically, the preset mapping relationship in the embodiments of the present application is not limited.

[0085] In practical applications, the body controller drives the light emission information of each light source in the target position light source array according to the control instructions on the vehicle bus to emit light at the specified light emission intensity, so as to generate a suitable illumination angle and brightness.

[0086] Step 104, perform light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

[0087] As a refinement of the above step 104, after determining the light emission information of each light source in the target position light source array via step 103, perform light emission control on each light source included in the target position light source array, that is, the light emitting unit, according to the light emission information, so that the target position light source array emits light that conforms to the illumination angle and the illumination intensity.

[0088] The lighting adjustment method provided by the present disclosure obtains the first state data of the vehicle occupants, the second state data of the reading material, and the lighting data of the target position where the vehicle occupants are located. The first state data at least includes the position information and sitting posture information of the occupants, the second state data at least includes the position and angle of the reading material, and the lighting data at least includes the light irradiation intensity and angle; input the first state data, the second state data, and the lighting data into a pre-trained recognition model to obtain the optimal lighting angle and lighting intensity at the target position; determine the lighting information of each light source in the target position light source array corresponding to the lighting angle and the lighting intensity from the preset mapping relationships between the lighting angle and lighting intensity and the lighting information of each light source respectively, and the lighting information at least includes the on / off state information of the light source; perform lighting control on each light source in the target position light source array based on the lighting information of each light source in the target position light source array. Compared with the related art, by obtaining the first state data of the vehicle occupants, the second state data of the reading material, and the lighting data of the target position where the vehicle occupants are located, that is, the environmental state data where the occupants are located, calculating the optimal lighting angle and lighting intensity at the target position according to the data obtained above, determining the lighting information of each light source in the target position light source array corresponding to the lighting angle and the lighting intensity from the preset mapping relationships between the lighting angle and lighting intensity and the lighting information of each light source respectively, and performing lighting control on each light source in the target position light source array based on the lighting information, so that the light source array emits light that conforms to the lighting intensity and the lighting angle, thereby realizing providing lighting according to the state of the vehicle occupants.

[0089] As a refinement of the embodiments of the present disclosure, when performing step 102 of inputting the first state data, the second state data, and the illumination data into a pre-trained recognition model to obtain the optimal illumination angle and illumination intensity at the target position, the following implementation manners may be adopted, but are not limited to, for example: calculating first difference information between the position information of the occupant and the position of the reading material, and second difference information between the sitting posture information of the occupant and the angle of the reading material in the pre-trained recognition model to obtain a target result; determining the light emission information of each light source in the target position light source array from the preset mapping relationship between the illumination angle and illumination intensity and the light emission information of each light source respectively, where the target result includes the relative position relationship, angle relationship between the reading material and the occupant, and the viewing angle information of the occupant; determining the occlusion information of the occupant with respect to the light source array based on the target position from the preset relationship between the occupant position and the position area covered by the light beams emitted by the light source array, where the position area is determined based on pre-calibration; calling a preset image recognition algorithm to calculate the optimal illumination angle and illumination intensity at the target position based on the relative position relationship, angle relationship between the reading material and the occupant, and the occlusion information of the occupant with respect to the light source array.

[0090] Since the light beams emitted by the light source array irradiate the occupant in a straight line, according to the principle of direct light beam irradiation, in the preset relationship, when the occupant is on the right side of the light source array, the position area covered by the light beams emitted by the light source array is the right side area of the occupant, and the size of this position area is proportional to the height of the occupant, that is, the higher the height, the larger the position area, and the lower the height, the smaller the position area. When the occupant is on the left side of the light source array, the position area covered by the light beams emitted by the light source array is the left side area of the occupant. The embodiments of the present application do not limit the preset relationship.

[0091] As a refinement of the above embodiments, the relative position relationship, angular relationship between the reading material and the occupant, and the viewing angle information of the occupant, i.e., the target result, are calculated through the first state data and the second state data. And from the preset relationship between the occupant position and the position area covered by the light beams emitted by the light source array, the occlusion information of the occupant with respect to the light source array is determined based on the target position. The position area is determined based on pre-calibration. There is an easier-to-understand introduction to the calculation of the occlusion information as follows: Since a single light source generally emits a conical light beam, the position area of the conical light beam emitted by each light source can be determined through pre-calibration. After the image recognition determines that a person is within the position area of the light beam, the occlusion information can be calculated. Call the preset image recognition algorithm to calculate the occlusion information of the occupant with respect to the light source array based on the relative position relationship, angular relationship between the reading material and the occupant, and the viewing angle information of the occupant, so as to obtain the optimal illumination angle and illumination intensity at the target position.

[0092] As a refinement of the above embodiments, when performing the step 105 of controlling the light emission of each light source in the target position light source array based on the light emission information of each light source in the target position light source array, the following implementation manners can be adopted but are not limited to, for example: generating a light source light emission control instruction based on the light emission information of each light source in the target position light source array; driving each light source in the target position light source array to emit light according to the light source light emission control instruction.

[0093] As a refinement of the above embodiments, the control instruction for controlling the target position light source array is generated by the domain controller corresponding to the vehicle cockpit, that is, the vehicle domain controller generates a light source light emission control instruction based on the light emission information of each light source in the target position light source array, and the control instruction is transmitted to the body control module of the vehicle, and the body control module drives each light source in the target position light source array to emit light in response to the control instruction.

[0094] In some embodiments, the number of the target position light source arrays and the positions set in the vehicle cockpit are not limited in the present disclosure. They can be set in the ceiling areas above the co-pilot, the left seat in the second row, and the right seat in the second row to form top light sources; at the same time, they are also arranged in the positions of the upper right armrest of the co-pilot and the upper armrest areas on both sides of the second row to form side light sources, etc. The above setting manners of the target position light source arrays are only exemplary, and the present embodiment does not limit this.

[0095] As a refinement of the above embodiments, the method further includes: determining whether there is a reading behavior of the vehicle occupant; if there is a reading behavior, then performing the steps of obtaining the first state data of the vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the vehicle occupant is located.

[0096] As a refinement of the above embodiments, in order to save the computing resources of the in-vehicle computer, it is pre-determined whether the vehicle occupants have a reading behavior. The determination of whether there is a reading behavior can be realized based on image recognition. When it is determined that there is a reading behavior, the first state data of the vehicle occupants, the second state data of the reading material, and the light data of the target position where the vehicle occupants are located are acquired to perform the next calculation of the light intensity and light angle.

[0097] In some embodiments, the determination of whether the vehicle occupants have a reading behavior can also be implemented in but not limited to the following ways. For example, it is determined whether the vehicle occupants have a reading behavior by analyzing the video images collected in the cockpit; or it is determined whether the vehicle occupants have a reading behavior by monitoring whether the reading shortcut key is activated; or it is determined whether the vehicle occupants have a reading behavior by analyzing the interactive voice.

[0098] In short, it is determined whether there is the reading behavior through image recognition; it is determined whether there are the reading occupants by whether the vehicle occupants turn on the switch of the reading light in the vehicle. For example, if the switch is turned on, it is determined that there is a reading behavior; if not, it is determined that there is no reading behavior. In addition, it can also be determined according to voice recognition. The above determination of the reading behavior is only exemplary, and this embodiment does not limit it.

[0099] As a refinement of the above embodiments, when performing step 101 to acquire the first state data of the vehicle occupants, the second state data of the reading material, and the light data of the target position where the vehicle occupants are located, it can be implemented in but not limited to the following ways. For example, the target image information is recognized by the preset deep learning algorithm to obtain the first state data, the second state data, and the light data.

[0100] It should be understood that the target image information is the image information of the vehicle cockpit collected by the camera inside the vehicle. The target image information is recognized by using the preset deep learning algorithm to obtain the first state data, the second state data, and the light data. In practical applications, after the cockpit domain controller reads the target image information, it first performs digital image processing to extract the light irradiation intensity of each target position where the vehicle occupants are located. Further, the irradiation angle information of the external light source at this time can be extracted. The preset deep learning algorithm can adopt any implementation manner in related technologies. Specifically, this application embodiment does not limit it.

[0101] As a refinement of the above embodiments, after controlling the light emission of each light source in the target position light source array based on the light emission information of each light source in the target position light source array, the method may also adopt, but is not limited to, the following implementation manners. For example: monitoring whether the first state data changes during the reading process of the vehicle occupant; if the posture of the vehicle occupant changes during the reading process, re-determining the light emission information of each light source in the target position light source array corresponding to the first state data, and controlling the light emission of each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

[0102] As a refinement of the above embodiments, that is, implementing the monitoring of the state change of the vehicle occupant. When the position of the vehicle occupant changes, re-determine the light emission information of each light source in the target position light source array corresponding to the first state data, and control the light emission of each light source in the target position light source array based on the light emission information of each light source in the target position light source array. The process of this light emission control can refer to Figure 1 the detailed description. The embodiments of the present application will not be elaborated herein. To achieve real-time adjustment of the target position light source array. Further, monitoring the state change of the vehicle occupant can also adopt the method of monitoring the state change of the vehicle occupant at intervals of a preset time period, where the value of the preset time period is not limited in this embodiment.

[0103] Corresponding to the above method for adjusting the light, the present invention also provides a system for adjusting the light. Since the system embodiments of the present invention correspond to the above method embodiments, for the details not disclosed in the device embodiments, reference may be made to the above method embodiments, and the present invention will not be elaborated herein.

[0104] Figure 4 FIG. is a schematic structural diagram of a system for adjusting the light provided by an embodiment of the present disclosure. As Figure 4 shown, it includes: an image acquisition device, a domain controller, a body controller, and a light source;

[0105] The image acquisition device is connected to the domain controller, and is used to acquire target image information inside the cockpit and send the target image information to the domain controller; the domain controller is connected to the body controller, and a preset deep learning algorithm is set in the domain controller. The domain controller is used to identify and process the received target image information, and generate a control instruction according to the identification and processing result and send it to the body controller; the body controller is connected to the light source, and is used to receive the control instruction, generate a corresponding pulse width modulation signal according to the control instruction, and drive the light source to emit light conforming to the control command through the pulse width modulation signal. The light source is used to perform corresponding light intensity and light angle light display in response to the pulse width modulation signal. The image acquisition device can use a camera set inside the vehicle.

[0106] Further, the light source includes a light source array, the light source array is composed of a plurality of light emitting units arranged in series, and the light emitting intensity and light emitting angle of each light emitting unit are independently controlled. The light source array can form a variety of the light emitting combinations, and the formation of the light emitting combinations of the light source array is determined according to the control instruction.

[0107] In summary, this embodiment can achieve the following effects, for example:

[0108] 1. Provide sufficient and appropriate lighting according to the state of the user inside the vehicle to improve the riding experience of the occupants inside the vehicle.

[0109] 2. The hardware solution is simple, the cost increase is small, the change to the cockpit solution of the existing vehicle is small, and the feasibility is high.

[0110] Corresponding to the above-mentioned method for adjusting the light, the present invention also proposes a device for adjusting the light. Since the device embodiment of the present invention corresponds to the above-mentioned method embodiment, for the details not disclosed in the device embodiment, reference can be made to the above-mentioned method embodiment, and the present invention will not be elaborated herein.

[0111] Figure 5 It is a schematic structural diagram of a device for adjusting the light provided by an embodiment of the present disclosure. As Figure 5 shown, it includes:

[0112] An acquisition unit 21, configured to acquire first state data of the occupant inside the vehicle, second state data of the reading material, and light data of the target position where the occupant inside the vehicle is located. The first state data at least includes the position information and sitting posture information of the occupant, the second state data at least includes the position and angle of the reading material, and the light data at least includes the light irradiation intensity and angle;

[0113] A calculation unit 22, configured to input the first state data, the second state data, and the illumination data into a pre-trained recognition model to obtain the optimal illumination angle and illumination intensity at a target position;

[0114] A first determination unit 23, configured to determine, from a preset mapping relationship between the illumination angle and illumination intensity and the light emission information of each light source, the light emission information of each light source in the target position light source array corresponding to the illumination angle and the illumination intensity, where the light emission information at least includes the switch state information of the light source;

[0115] A first control unit 24, configured to perform light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

[0116] The lighting adjustment device provided by the present disclosure acquires the first state data of the vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the vehicle occupant is located. The first state data at least includes the position information and sitting posture information of the occupant, the second state data at least includes the position and angle of the reading material, and the illumination data at least includes the light irradiation intensity and angle; inputs the first state data, the second state data, and the illumination data into a pre-trained recognition model to obtain the optimal illumination angle and illumination intensity at the target position; determines, from a preset mapping relationship between the illumination angle and illumination intensity and the light emission information of each light source, the light emission information of each light source in the target position light source array corresponding to the illumination angle and the illumination intensity, where the light emission information at least includes the switch state information of the light source; and performs light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array. Compared with the related art, by acquiring the first state data of the vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the vehicle occupant is located, that is, the environmental state data where the occupant is located, calculates the optimal illumination angle and illumination intensity at the target position according to the data obtained above, determines, from a preset mapping relationship between the illumination angle and illumination intensity and the light emission information of each light source, the light emission information of each light source in the target position light source array corresponding to the illumination angle and the illumination intensity, and performs light emission control on each light source in the target position light source array based on the light emission information, so that the light source array emits light that conforms to the illumination intensity and the illumination angle, thereby realizing providing illumination according to the state of the vehicle occupant.

[0117] Further, in a possible implementation manner of this embodiment, as Figure 6 shown, the calculation unit 22 includes:

[0118] The first calculation module 221 is configured to calculate the first difference information between the position information of the occupant and the position of the reading material, and the second difference information between the sitting posture information of the occupant and the angle of the reading material in the pre-trained recognition model, so as to obtain a target result, where the target result includes the relative position relationship, angle relationship between the reading material and the occupant, and the perspective information of the occupant;

[0119] The second calculation module 222 is configured to determine the occlusion information of the occupant with respect to the light source array based on the target position from a preset relationship between the occupant position and the position area covered by the light beams emitted by the light source array, where the position area is determined based on pre-calibration;

[0120] The third calculation module 223 is configured to call a preset image recognition algorithm to calculate the best illumination angle and illumination intensity at the target position based on the relative position relationship, angle relationship between the reading material and the occupant, and the occlusion information of the occupant with respect to the light source array of the perspective information of the occupant.

[0121] Further, in a possible implementation manner of this embodiment, as Figure 6 shown, the first control unit 24 includes:

[0122] The generation module 241 is configured to generate a light source emission control instruction based on the light emission information of each light source in the target position light source array;

[0123] The driving module 242 is configured to drive each light source in the target position light source array to emit light according to the light source emission control instruction.

[0124] Further, in a possible implementation manner of this embodiment, as Figure 6 shown, the device includes:

[0125] The second determination unit 25 is configured to determine whether there is a reading behavior of the in-vehicle occupant before the acquisition unit 21 acquires the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located;

[0126] The acquisition unit 21 is further configured to, when there is a reading behavior, execute the acquisition of the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located.

[0127] Further, in a possible implementation manner of this embodiment, as Figure 6 shown, the second determination unit 25 includes:

[0128] The analysis module 251 is configured to determine whether there is a reading behavior of the in-vehicle occupant by analyzing the video images collected in the cockpit;

[0129] A detection module 252, configured to determine whether there is a reading behavior of the vehicle occupant by monitoring whether a reading shortcut key is activated;

[0130] The analysis module is further configured to determine whether there is a reading behavior of the vehicle occupant by analyzing the interactive voice.

[0131] Further, in a possible implementation manner of this embodiment, as Figure 6 shown, the obtaining unit 21 is further configured to:

[0132] Identify the target image information through the preset deep learning algorithm to obtain the first state data, the second state data, and the illumination data.

[0133] Further, in a possible implementation manner of this embodiment, as Figure 6 shown, the apparatus further includes:

[0134] A monitoring unit 26, configured to monitor whether the first state data changes during the reading process of the vehicle occupant;

[0135] A second control unit 27, configured to re-determine the light emission information of each light source in the target position light source array corresponding to the first state data when the posture of the vehicle occupant changes during the reading process, and perform light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

[0136] It should be noted that the foregoing explanation of the method embodiment also applies to the apparatus of this embodiment, and the principles are the same, and are not limited in this embodiment.

[0137] According to an embodiment of the present disclosure, the present disclosure further provides an electronic device, a readable storage medium, and a computer program product.

[0138] Figure 5 FIG. shows a schematic block diagram of an exemplary electronic device 300 that can be used to implement the embodiments of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, a personal digital processing, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0139] As Figure 5As shown, device 300 includes a computing unit 301, which can perform various appropriate actions and processes according to computer programs stored in a ROM (Read-Only Memory) 302 or computer programs loaded from a storage unit 308 into a RAM (Random Access Memory) 303. In the RAM 303, various programs and data required for the operation of device 300 can also be stored. The computing unit 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An I / O (Input / Output) interface 305 is also connected to the bus 304.

[0140] Multiple components in device 300 are connected to the I / O interface 305, including: an input unit 306, such as a keyboard, a mouse, etc.; an output unit 307, such as various types of displays, speakers, etc.; a storage unit 308, such as a magnetic disk, an optical disc, etc.; and a communication unit 309, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 309 allows device 300 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0141] The computing unit 301 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 301 include but are not limited to a CPU (Central Processing Unit), a GPU (Graphic Processing Units), various dedicated AI (Artificial Intelligence) computing chips, various computing units running machine learning model algorithms, a DSP (Digital Signal Processor), and any appropriate processor, controller, microcontroller, etc. The computing unit 301 executes the various methods and processes described above, such as the method for adjusting lights. For example, in some embodiments, the method for adjusting lights can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as the storage unit 308. In some embodiments, part or all of the computer program can be loaded and / or installed onto device 300 via the ROM 302 and / or the communication unit 309. When the computer program is loaded into the RAM 303 and executed by the computing unit 301, one or more steps of the method described above can be executed. Alternatively, in other embodiments, the computing unit 301 can be configured to execute the aforementioned method for adjusting lights in any other appropriate manner (e.g., by means of firmware).

[0142] The various embodiments of the systems and techniques described above in this document can be implemented in digital electronic circuitry, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application Specific Standard Products), SoCs (System On Chip), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special-purpose or general-purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0143] The program code for implementing the methods of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowchart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0144] In the context of this disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a RAM, a ROM, an EPROM (Electrically Programmable Read-Only Memory), or a flash memory, an optical fiber, a CD-ROM (Compact Disc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0145] To provide for interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can also be used to provide for interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, speech input, or tactile input).

[0146] The systems and techniques described herein can be implemented in a computing system that includes backend components (such as, for example, a data server), or a computing system that includes middleware components (such as, for example, an application server), or a computing system that includes frontend components (such as, for example, a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (such as, for example, a communication network). Examples of a communication network include: a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, and a blockchain network.

[0147] A computer system may include a client and a server. The client and the server are generally far from each other and usually interact via a communication network. The relationship between the client and the server is generated by computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, solving the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system or a server combined with a blockchain.

[0148] Among them, it should be noted that artificial intelligence is a discipline that studies how to make a computer simulate certain thinking processes and intelligent behaviors of humans (such as learning, reasoning, thinking, planning, etc.), and there are both hardware-level technologies and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include several major directions such as computer vision technology, speech recognition technology, natural language processing technology, and machine learning / deep learning, big data processing technology, and knowledge graph technology.

[0149] It should be understood that various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and no limitations are imposed herein.

[0150] The above specific embodiments do not constitute a limitation on the protection scope of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the protection scope of this disclosure.

Claims

1. A lighting adjustment method, characterized in that, it includes: Obtain the first status data of the vehicle occupants, the second status data of the reading material, and the lighting data of the target position where the vehicle occupants are located. The first status data includes at least the position information and sitting posture information of the occupants, the second status data includes at least the position and angle of the reading material, and the lighting data includes at least the light irradiation intensity and angle; Input the first status data, the second status data, and the lighting data into a pre-trained recognition model to obtain the optimal lighting angle and lighting intensity at the target position; From the preset mapping relationships between the lighting angle and lighting intensity and the lighting information of each light source respectively, determine the lighting information of each light source in the target position light source array corresponding to the lighting angle and the lighting intensity. The lighting information at least includes the on / off status information of the light source; Perform lighting control on each light source in the target position light source array based on the lighting information of each light source in the target position light source array.

2. The method according to claim 1, characterized in that, The calculating the first status data, the second status data, and the lighting data to obtain the optimal lighting angle and lighting intensity at the target position includes: Calculate the first difference information between the position information of the occupant and the position of the reading material, and the second difference information between the sitting posture information of the occupant and the angle of the reading material in the pre-trained recognition model to obtain a target result. The target result includes the relative position relationship, angle relationship between the reading material and the occupant, and the viewing angle information of the occupant; Determine the occlusion information of the occupant with respect to the light source array based on the target position from the preset relationship between the occupant position and the position area covered by the light beams emitted by the light source array. The position area is determined based on pre-calibration; Call a preset image recognition algorithm to calculate the optimal lighting angle and lighting intensity at the target position based on the relative position relationship, angle relationship between the reading material and the occupant, and the occlusion information of the occupant with respect to the light source array.

3. The method according to claim 1, characterized in that, Before obtaining the first status data of the vehicle occupants, the second status data of the reading material, and the lighting data of the target position where the vehicle occupants are located, the method includes: Determine whether there is a reading behavior of the vehicle occupants; The obtaining the first status data of the vehicle occupants, the second status data of the reading material, and the lighting data of the target position where the vehicle occupants are located includes: If there is a reading behavior, then execute the obtaining of the first status data of the vehicle occupants, the second status data of the reading material, and the lighting data of the target position where the vehicle occupants are located.

4. The method according to claim 3, characterized in that, The determining whether there is a reading behavior of the vehicle occupants includes: Determine whether there is a reading behavior of the vehicle occupants by analyzing the video images collected in the cockpit; Or determine whether there is a reading behavior of the vehicle occupants by monitoring whether the reading shortcut key is activated; Alternatively, determine whether the in-vehicle occupant has a reading behavior by analyzing the interactive voice.

5. The method according to claim 1, wherein, the obtaining of the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located includes: identifying the target image information through the preset deep learning algorithm to obtain the first state data, the second state data, and the illumination data.

6. The method according to claim 1, wherein, the light emission control of each light source in the target position light source array based on the light emission information of each light source in the target position light source array includes: monitoring whether the first state data changes during the reading process of the in-vehicle occupant; if the posture of the in-vehicle occupant changes during the reading process, re-determine the light emission information of each light source in the target position light source array corresponding to the first state data, and perform light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

7. A lighting adjustment device, wherein, it includes: an acquisition unit for acquiring the first state data of the in-vehicle occupant, the second state data of the reading material, and the illumination data of the target position where the in-vehicle occupant is located, the first state data at least including the position information and sitting posture information of the occupant, the second state data at least including the position and angle of the reading material, and the illumination data at least including the light irradiation intensity and angle; a calculation unit for inputting the first state data, the second state data, and the illumination data into a pre-trained recognition model to obtain the optimal illumination angle and illumination intensity at the target position; a first determination unit for determining the light emission information of each light source in the target position light source array corresponding to the illumination angle and the illumination intensity from the preset mapping relationships between the illumination angle and illumination intensity and the light emission information of each light source, the light emission information at least including the on / off state information of the light source; a first control unit for performing light emission control on each light source in the target position light source array based on the light emission information of each light source in the target position light source array.

8. The device according to claim 7, wherein, the calculation unit includes: a first calculation module for calculating a first difference information between the position information of the occupant and the position of the reading material, and a second difference information between the sitting posture information of the occupant and the angle of the reading material in the pre-trained recognition model to obtain a target result, the target result including the relative position relationship, angle relationship between the reading material and the occupant, and the viewing angle information of the occupant; a second calculation module for determining the occlusion information of the occupant with respect to the light source array based on the target position from the preset relationship between the occupant position and the position area covered by the light beam emitted by the light source array, the position area being determined based on pre-calibration; A third computing module, configured to call a preset image recognition algorithm, calculate the occlusion information of the light source array by the occupant based on the relative position relationship, angular relationship between the reading material and the occupant, and the perspective information of the occupant, so as to obtain the optimal illumination angle and illumination intensity at the target position.

9. A vehicle, characterized in that it includes the lighting adjustment device according to claim 7 or 8.

10. An electronic device, characterized in that it includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1-6.

Images