Shooting method, device, equipment and vehicle

Abstract

The invention is suitable for the technical field of vehicles, and provides a shooting method, device and equipment and a vehicle, and the method comprises the steps: when a shooting instruction is received, responding to the shooting instruction, obtaining the environment information of a plurality of standing positions in the surrounding area of the vehicle, and based on a preset shooting environment evaluation standard, according to the environment information corresponding to each standing position, obtaining a shooting environment; evaluating whether each standing position is suitable for shooting or not to obtain an environment evaluation result of each standing position, determining at least one target standing position most suitable for shooting according to the environment evaluation results of the plurality of standing positions, and identifying the target standing position through a vehicle-mounted projection device to remind a user to move to the target standing position. And under the condition that the user moves to the target standing position, executing the shooting instruction through the vehicle-mounted shooting equipment. According to the invention, the problem that the user needs to repeatedly adjust the standing position in the self-photographing or group photo process during travel, so that the photographing operation is inconvenient, time-consuming and labor-consuming can be solved.

Description

Technical Field

[0001] This application belongs to the technical field of vehicles, and particularly relates to a photographing method, apparatus, device, and vehicle. Background Art

[0002] When a person or the whole family travels to a tourist attraction, there are often a large number of photographing needs, such as selfies or group photos. Moreover, people's requirements for the picture quality of photography are getting higher and higher. In order to take wonderful photos, when taking selfies or group photos, it is necessary to rely on special equipment or ask others for help to complete, and the operation is very inconvenient.

[0003] In addition, the picture quality of the photographing is affected by uncertain factors such as the environment and light, and it is necessary to repeatedly adjust the photographing position according to the photographing quality each time to take a photo that satisfies the user. The entire photographing process is time-consuming and laborious, and the operation is inconvenient. Therefore, how to take a photo that satisfies the user has become an urgent technical problem to be solved. Summary of the Invention

[0004] Embodiments of this application provide a photographing method, apparatus, device, and computer program product, which can solve the problem of inconvenient and time-consuming and laborious photographing operations caused by repeatedly adjusting the standing position during the process of users taking selfies or group photos when traveling.

[0005] In a first aspect, embodiments of this application provide a photographing method applied to an in-vehicle photographing device, including:

[0006] When a photographing instruction is received, in response to the photographing instruction, obtain the environmental information of multiple standing positions within the vehicle surrounding area, where the vehicle surrounding area is used to represent an area within a preset range from the vehicle, and the standing position is used to characterize the position where the user is expected to stand when photographing the user;

[0007] Based on a preset photographing environment evaluation criterion, evaluate whether each of the standing positions is suitable for photographing according to the environmental information corresponding to each of the standing positions, and obtain the environmental evaluation results of each of the standing positions;

[0008] Determine at least one target standing position that is most suitable for photographing according to the environmental evaluation results of the multiple standing positions;

[0009] Identify the target standing position through an in-vehicle projection device to remind the user to move to the target standing position, and when the user moves to the target standing position, execute the photographing instruction through the in-vehicle photographing device.

[0010] In a possible implementation manner of the first aspect, the environmental information includes the background color information and environmental light information of the standing position;

[0011] The shooting environment evaluation criteria include background color evaluation criteria and environmental light evaluation criteria;

[0012] Based on the preset shooting environment evaluation criteria, and according to the environmental information corresponding to each of the standing positions, evaluate whether each of the standing positions is suitable for shooting, and obtain the environmental evaluation results of each of the standing positions, including:

[0013] Obtain the clothing information of the user;

[0014] Based on the background color evaluation criteria, and according to the background color information of each of the standing positions and the clothing information of the user, calculate the background color scores corresponding to each of the standing positions;

[0015] Based on the environmental light evaluation criteria, and according to the environmental light information of each of the standing positions, calculate the environmental light scores corresponding to each of the standing positions;

[0016] According to the background color scores and the environmental light scores corresponding to each of the standing positions, obtain the environmental evaluation results corresponding to each of the standing positions.

[0017] In a possible implementation manner of the first aspect, the background color information includes an environmental hue value and an environmental brightness value;

[0018] The clothing information includes a clothing hue value;

[0019] The calculating, based on the background color evaluation criteria, the background color scores corresponding to each of the standing positions according to the background color information of each of the standing positions and the clothing information of the user includes:

[0020] Based on the background color evaluation criteria, and according to the environmental hue value and the clothing hue value of each of the standing positions, calculate the hue scores corresponding to each of the standing positions;

[0021] According to the environmental brightness value of each of the standing positions, calculate the brightness scores corresponding to each of the standing positions;

[0022] According to the hue scores and the brightness scores corresponding to each of the standing positions, calculate the background color scores corresponding to each of the standing positions.

[0023] In a possible implementation manner of the first aspect, the environmental light information includes light intensity and light angle;

[0024] Based on the ambient light evaluation criteria, according to the ambient light information of each of the standing positions, calculating the ambient light score corresponding to each of the standing positions, including:

[0025] Based on the ambient light evaluation criteria, calculating the light intensity score corresponding to each of the standing positions according to the light intensity of each of the standing positions;

[0026] Calculating the light angle score corresponding to each of the standing positions according to the light angle of each of the standing positions;

[0027] Calculating the ambient light score corresponding to each of the standing positions respectively according to the light intensity score and the light angle score corresponding to each of the standing positions.

[0028] In a possible implementation manner of the first aspect, after determining at least one target standing position that is most suitable for shooting, the method further includes:

[0029] Determining the orientation of the user according to the target standing position and the ambient information of the target standing position.

[0030] In a possible implementation manner of the first aspect, the determining the orientation of the user according to the target standing position and the ambient information of the target standing position includes:

[0031] Determining the orientation of the user based on the light angle of the target standing position and based on a preset included angle threshold, where the included angle threshold is used to represent the threshold of the included angle between the light and the orientation of the user.

[0032] In a possible implementation manner of the first aspect, the method further includes:

[0033] Receiving the voice information or body information of the user;

[0034] When receiving the voice information of the user, performing semantic recognition on the voice information to identify whether the voice information contains words for indicating shooting;

[0035] Or, when receiving the body information of the user, performing body language recognition on the body information to identify whether the body information contains body movements for indicating shooting;

[0036] In the case of identifying that the voice information contains words for indicating shooting, or identifying that the body information contains body movements for indicating shooting, generating the shooting instruction of the user.

[0037] Second aspect, an embodiment of the present application provides a photographing device, including:

[0038] An information acquisition module, configured to, when receiving a photographing instruction, in response to the photographing instruction, acquire environmental information of a plurality of standing positions within the vehicle surrounding area, where the vehicle surrounding area is used to represent an area within a preset range of the distance from the vehicle, and the standing position is used to characterize the position where the user is expected to stand when photographing the user;

[0039] An environmental evaluation module, configured to evaluate whether each of the standing positions is suitable for photographing based on a preset photographing environment evaluation criterion according to the environmental information corresponding to each of the standing positions, to obtain an environmental evaluation result of each of the standing positions;

[0040] A target standing position confirmation module, configured to determine at least one target standing position that is most suitable for photographing according to the environmental evaluation results of the plurality of standing positions;

[0041] A position identification module, configured to identify the target standing position through an in-vehicle projection device to remind the user to move to the target standing position, and execute the photographing instruction through the in-vehicle photographing device when the user moves to the target standing position.

[0042] Third aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the method described in any one of the above when executing the computer program.

[0043] Fourth aspect, an embodiment of the present application provides a vehicle, including an in-vehicle projection device, and an in-vehicle photographing device that executes the method described in any one of the above.

[0044] Fifth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program implements the method described in any one of the above when executed by a processor.

[0045] Sixth aspect, an embodiment of the present application provides a computer program product, which, when running on a control device of a trailer power take-off port cover, causes the control device of the trailer power take-off port cover to execute the method described in any one of the above.

[0046] The beneficial effects of the embodiments of the present application compared with the prior art are as follows: When a shooting instruction is received, in response to the shooting instruction, environmental information of multiple standing positions within the surrounding area of the vehicle is obtained. Based on a preset shooting environment evaluation criterion, according to the environmental information corresponding to each standing position, whether each standing position is suitable for shooting is evaluated to obtain the environmental evaluation results of each standing position. Herein, the surrounding area of the vehicle is used to represent an area within a preset range from the vehicle, and the standing position is used to characterize the position where the user is expected to stand when shooting the user. According to the environmental evaluation results of multiple standing positions, at least one target standing position that is most suitable for shooting is determined, and the target standing position is marked by an in-vehicle projection device to remind the user to move to the target standing position, so that the user does not need to repeatedly move positions when wanting to take pictures during an outing, saving the user's adjustment time. And when the user moves to the target standing position, the shooting instruction is executed by the in-vehicle photography device, without the user having to take pictures through a handheld device, which is simple, fast, and convenient to operate, solving the problem of inconvenient camera operation, time-consuming and laborious caused by repeatedly adjusting the standing position during the process of the user taking selfies or group photos during an outing. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the following described drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0048] Figure 1 It is a flowchart of a shooting method provided by an embodiment of the present application;

[0049] Figure 2 It is a flowchart of a method for determining the environmental evaluation result of a standing position provided by an embodiment of the present application;

[0050] Figure 3 It is a structural schematic diagram of a shooting device provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0051] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. However, those skilled in the art should clearly understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from interfering with the description of the present application.

[0052] It should be understood that, as used in the specification of this application and the appended claims, the term "comprising" indicates the presence of the described features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or their groups.

[0053] It should also be understood that the term "and / or" as used in the specification of this application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0054] As used in the specification of this application and the appended claims, the term "if" can be construed, depending on the context, as "when", "once", "in response to determining", or "in response to detecting". Similarly, the phrase "if determined" or "if [the described condition or event] is detected" can be construed, depending on the context, as meaning "once determined", "in response to determining", "once [the described condition or event] is detected", or "in response to detecting [the described condition or event]".

[0055] In addition, in the description of the specification of this application and the appended claims, the terms "first", "second", "third", etc. are only used for distinguishing descriptions and cannot be construed as indicating or implying relative importance.

[0056] Reference to "one embodiment" or "some embodiments" or the like described in the specification of this application means that a specific feature, structure, or characteristic described in connection with that embodiment is included in one or more embodiments of this application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "comprising", "including", "having", and their variants all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0057] In the prior art, when one person or the whole family travels by self-driving, there are often a large number of shooting needs. Especially in scenic spots, there are needs for selfies or group photos. However, when using a handheld imaging device for shooting, special equipment needs to be used or others need to be asked for help, and the standing position needs to be adjusted repeatedly to take photos or videos that satisfy the user in all aspects.

[0058] The embodiment of this application provides a shooting method, which is applied to an in-vehicle imaging device. Refer to Figure 1 , Figure 1 is a schematic flowchart of a shooting method provided by an embodiment of this application, including:

[0059] Step S11: When a shooting instruction is received, in response to the shooting instruction, obtain the environmental information of multiple standing positions within the vehicle's surrounding area. Herein, the vehicle's surrounding area is used to represent the area within a preset range of distance from the vehicle, and the standing position is used to characterize the position where the user is expected to stand when being photographed.

[0060] Step S12: Based on the pre-set shooting environment evaluation criteria, evaluate whether each standing position is suitable for shooting according to the environmental information corresponding to each standing position, and obtain the environmental evaluation results of each standing position.

[0061] Step S13: Determine at least one target standing position that is most suitable for shooting according to the environmental evaluation results of multiple standing positions.

[0062] Step S14: Identify the target standing position through the in-vehicle projection device to remind the user to move to the target standing position, and when the user moves to the target standing position, execute the shooting instruction through the in-vehicle photography device.

[0063] It should be noted that the vehicle is equipped with a shooting system, and the shooting system includes an in-vehicle photography device and an in-vehicle projection device. Among them, the in-vehicle photography device and the in-vehicle projection device are loaded at the position of the roof or the front of the vehicle outside the vehicle. The in-vehicle projection device can be used to display a picture, or to perform projection marking at the position required by the user. The in-vehicle photography device can take pictures, shoot videos, etc. of the position required by the user by adjusting the angle, direction, etc. For example, the photography device loaded at the roof outside the vehicle is a high-definition camera, and the in-vehicle projection device loaded outside the vehicle is a display device (such as: projector, monitor).

[0064] The shooting system is respectively communicatively connected to the vehicle's in-vehicle system and the user's mobile phone, and can jointly meet the user's shooting requirements.

[0065] The in-vehicle system is also communicatively connected to sensors, GPS systems, etc. in the environment, and can obtain information such as light, sunlight, weather, etc. in the environment at each position, and transmit this information to the shooting system.

[0066] The user's mobile phone is also installed with self-shooting system software, so that through the self-shooting system software of the mobile phone, the operation interaction between the user and the shooting system can be realized.

[0067] The camera system can also be displayed through an interaction interface, which is convenient for the user to start the camera system through the interaction interface in the vehicle.

[0068] The in-vehicle photography device in the camera system can automatically shoot according to the set shooting frequency by setting the shooting frequency.

[0069] Specifically, when a shooting instruction is received, in response to the shooting instruction, the camera system is activated, and the vehicle starts to locate the shooting point. The user can select the current position of the vehicle as the location of the vehicle, or can select any other place as the location of the vehicle.

[0070] Determine the position information of the vehicle. After that, according to the position information of the vehicle, determine the surrounding area of the vehicle. Among them, the surrounding area of the vehicle is used to represent the area within a preset range from the vehicle. For example: Taking the location of the vehicle as the center of a circle and the first threshold as the radius, a circular area is formed, and this circular area is the surrounding area of the vehicle.

[0071] Divide the surrounding area of the vehicle into multiple areas. Each area is a standing position, which is used to represent the position where the user stands when shooting for the user. Multiple coordinate points within the surrounding area of the vehicle can also be collected, and each coordinate point is a standing position.

[0072] By collecting information through sensors, GPS systems, etc. in the environment, the environmental information at each standing position can be obtained. For example, information such as the light, sunlight, and weather at the standing position can be obtained.

[0073] In the shooting system, there is a pre-set shooting environment evaluation criterion, which is used to represent the evaluation criterion for evaluating whether the environment at the standing position is suitable for shooting.

[0074] For each standing position, based on the shooting environment evaluation criterion, according to the environmental information corresponding to this standing position, evaluate whether this position is suitable for shooting, and obtain the environmental evaluation result of this standing position. Among them, the environmental evaluation result can be whether the standing position is suitable for shooting, or it can be a score for suitability for shooting.

[0075] In this way, the environmental evaluation result of each standing position is obtained.

[0076] When the environmental evaluation result is a score for suitability for shooting, according to the environmental evaluation results of all the standing positions, sort all the standing positions in descending order according to the score for suitability for shooting, and select at least one standing position with a high score for suitability for shooting as the target standing position.

[0077] When the environmental evaluation result is whether it is suitable for shooting, one or more of the standing positions suitable for shooting are used as the target standing positions.

[0078] It is also possible to automatically find a suitable photography position by establishing a deep learning model, learning and training the input initial standing environment according to the shooting environment evaluation criterion, and after multiple iterations and updates, obtaining the target standing position that is most suitable for shooting.

[0079] After obtaining the target standing position, project it onto the ground through the in-vehicle projection device to mark the target standing position and remind the user to move to the target standing position. Among them, the way for the user to move to the target standing position can be that the user walks by himself, or drives the vehicle to the target standing position, or through the intelligent driving function, automatically controls the vehicle to drive to the target standing position. When the user moves to the target standing position, the user adjusts the favorite posture and body orientation, and controls the in-vehicle photography device to execute the shooting command.

[0080] Among them, during the process of the in-vehicle projection device executing the shooting command, it can collect the user's image in real time, display the user's image on the in-vehicle projection device, or on the mobile phone associated with the shooting system, so that the user can adjust his own position and posture after seeing the image. If the user is not satisfied with the target standing position, he can also interact with the shooting system through the mobile phone to change to other positions.

[0081] It can be understood that the technical solution provided in this embodiment, when receiving the shooting command, responds to the shooting command, obtains the environmental information of multiple standing positions in the surrounding area of the vehicle, based on the pre-set shooting environment evaluation criteria, according to the environmental information corresponding to each standing position, evaluates whether each standing position is suitable for shooting, and obtains the environmental evaluation results of each standing position. Among them, the surrounding area of the vehicle is used to represent the area within a preset range from the vehicle, and the standing position is used to represent the position where the user is expected to stand when shooting the user. According to the environmental evaluation results of multiple standing positions, determine at least one target standing position that is most suitable for shooting, and mark the target standing position through the in-vehicle projection device to remind the user to move to the target standing position, so that the user does not need to repeatedly move positions when wanting to take pictures during the trip, and also saves the user's adjustment time. And when the user moves to the target standing position, the in-vehicle photography device executes the shooting command, without the user having to shoot through a handheld device, which is simple, fast, and convenient to operate, and solves the problem of inconvenient camera operation, time-consuming and laborious caused by repeatedly adjusting the standing position during the process of the user taking selfies or group photos during the trip.

[0082] In a possible implementation manner, as Figure 2 described, Figure 2 is a schematic flowchart of a method for determining the environmental evaluation result of a standing position provided by an embodiment of the present application. The embodiment of the present application provides a method for determining the environmental evaluation result of a standing position, including:

[0083] Step S121, obtain the user's clothing information.

[0084] Step S122: Based on the background color evaluation criteria, calculate the background color scores corresponding to each standing position according to the background color information of each standing position and the user's clothing information.

[0085] Step S123: Based on the ambient light evaluation criteria, calculate the ambient light scores corresponding to each standing position according to the ambient light information of each standing position.

[0086] Step S124: Obtain the environmental evaluation results corresponding to each standing position according to the background color scores and ambient light scores corresponding to each standing position.

[0087] Specifically, the environmental information includes the background color information and ambient light information of the standing position. Among them, the background color information represents any one or more of the color lightness, hue, brightness, sunshine condition, color area, and simplicity of the background color of the standing position. The shooting environment evaluation criteria include the background color evaluation criteria and the ambient light evaluation criteria. The background color evaluation criteria are used to represent the criteria for evaluating whether the background color of the standing position is suitable for shooting, and the ambient light evaluation criteria are used to represent the criteria for evaluating whether the light in the environment of the standing position is suitable for shooting.

[0088] The clothing information of the user can be obtained through a photographic device, and the clothing information includes the hue value of the color of the user's clothing.

[0089] Since the user's shooting requirements are different, the background color evaluation criteria are also different. When the difference in the hue values between the user's clothing and the background color is small, that is, the two hue values are similar, it indicates that the background color and the user's clothing are relatively harmonious in hue; if the difference in the hue values between the user's clothing and the background color is large, a strong contrast effect may be formed.

[0090] For any standing position, based on the background color evaluation criteria, calculate the background color score corresponding to this standing position according to the background color information of this standing position and the user's clothing information. The higher the background color score, the more suitable the background color of this standing position is for shooting.

[0091] In an optional example, for standing position A, based on the background color evaluation criteria, calculate the background color score corresponding to standing position A as 70 points according to the background color information of standing position A and the user's clothing information. For standing position B, calculate the background color score corresponding to standing position B as 90 points based on the same scoring method as standing position A. Then, the background color of standing position B is more suitable for shooting than that of standing position A.

[0092] Specifically, for any standing position, based on the environmental light evaluation criteria, according to the environmental light information of this standing position, the environmental light score corresponding to this standing position can be calculated. The higher the environmental light score, the more suitable the environmental light of this standing position is for shooting. For example: if both the light intensity and the light angle are within their respective threshold ranges, then the environmental light of this standing position is more suitable for shooting.

[0093] Continuing with the above example, for standing position A, based on the environmental light evaluation criteria, according to the environmental light information of standing position A, the calculated environmental light score corresponding to standing position A is 90 points. For standing position B, based on the same scoring method as standing position A, the calculated environmental light score corresponding to standing position B is 60 points. Then, the environmental light of standing position A is more suitable for shooting than that of standing position B.

[0094] Specifically, for any standing position, the background color score and the environmental light score corresponding to this standing position are weighted and calculated respectively to obtain the environmental score corresponding to this standing position. The environmental score corresponding to this standing position can be used as the environmental evaluation result of this standing position.

[0095] Continuing with the above example, assume that the weights of the background color score and the environmental light score corresponding to the standing position are 0.4 and 0.6 respectively. For standing position A, after multiplying the background color score of 70 points and the environmental light score of 90 points by their respective corresponding weights of 0.4 and 0.6 and then adding them together, the calculated environmental score corresponding to standing position A is 82 points. For standing position B, after multiplying the background color score of 90 points and the environmental light score of 60 points by their respective corresponding weights of 0.4 and 0.6 and then adding them together, the calculated environmental score corresponding to standing position B is 72 points. The score of standing position A is higher than that of standing position B, and standing position A is more suitable for shooting than standing position B.

[0096] Specifically, it is also possible to determine whether the environmental evaluation result corresponding to the standing position is suitable for shooting by judging whether the environmental score of this standing position is greater than the preset score threshold. When the environmental score corresponding to this standing position is greater than the preset score threshold, it is determined that the environmental evaluation result corresponding to this standing position is suitable for shooting; when the environmental score corresponding to this standing position is less than or equal to the preset score threshold, it is determined that the environmental evaluation result corresponding to this standing position is not suitable for shooting.

[0097] Continuing with the above example, assume that the preset score threshold is 80, the environmental score of standing position A is 82 points, which is greater than the preset score threshold. Then, it is determined that the environmental evaluation result corresponding to standing position A is suitable for shooting. The environmental score of standing position B is 72 points, which is less than the preset score threshold. Then, it is determined that the environmental evaluation result corresponding to standing position B is not suitable for shooting.

[0098] It can be understood that by comprehensively evaluating the background color and ambient light to determine the environmental evaluation result of the standing position, the accuracy of the determined environmental evaluation result can be higher, and the shooting effect of the selected target standing position can be better.

[0099] In a possible implementation manner, in step S122, based on the background color evaluation standard, according to the background color information of each standing position and the user's clothing information, the background color score corresponding to each standing position is calculated, including:

[0100] Based on the background color evaluation standard, according to the environmental color tone value and clothing color tone value of each standing position, the color tone score corresponding to each standing position is calculated;

[0101] According to the environmental brightness value of each standing position, the brightness score corresponding to each standing position is calculated;

[0102] According to the color tone score and brightness score corresponding to each standing position, the background color score corresponding to each standing position is calculated.

[0103] Specifically, the background color information includes the environmental color tone value and environmental brightness value.

[0104] The environmental color tone value refers to the average value of the color tone values of all pixels in the background picture of the standing position. Among them, the color tone is used to characterize the picture color, for example, it can be used to describe the type of color.

[0105] The environmental brightness value refers to the average value of the lightness values of all pixels in the background picture of the standing position. Among them, the lightness is used to characterize the brightness of the picture.

[0106] The environmental color tone value can be obtained through the following method:

[0107] First, calculate the color tone value of each pixel according to the following method:

[0108] Use an image processing software or programming library to process the image file, extract the RGB value of each pixel in the picture within the first preset area in the background picture or environmental background; then, use the RGB to HSV conversion formula or function to convert the RGB value of each pixel into an HSV value; finally, for each pixel, directly read the H component in its HSV value to obtain the color tone value of the pixel.

[0109] Then, calculate the environmental color tone value according to the following method:

[0110] Through the least squares method or other optimization algorithms, find an average color tone value within the first preset area in the background picture or environmental background, and this average color tone value can minimize the error with all pixel color tone values.

[0111] The ambient brightness value can be obtained by the following method:

[0112] First, calculate the brightness value of each pixel as follows: After converting the RGB value of each pixel to the HSV value, for each pixel, directly read the V component in its HSV value to obtain the brightness value of the pixel. Then, calculate the ambient brightness value as follows: By using the least squares method or other optimization algorithms, find an average brightness value within a first preset area in the background picture or the ambient background.

[0113] The clothing information includes the clothing hue value. The clothing hue value refers to the average value of the hue values of all pixels in the picture formed by the user's clothing. The method for obtaining it is the same as the method for obtaining the above ambient hue value, and will not be elaborated here.

[0114] For any standing position, calculate the difference between the ambient hue value and the clothing hue value of each standing position to obtain the hue value difference. Based on the background color evaluation criteria, obtain the hue score corresponding to each standing position according to the hue value difference.

[0115] It should be noted that the background color evaluation criteria include the hue score criteria. The hue score criteria can be set according to the user's shooting requirements. For example, the larger the hue value difference, the higher the corresponding hue score value, or when the hue difference is within a first preset range, the higher the corresponding hue score value. This embodiment does not make specific limitations on this.

[0116] Continuing the above example, the hue score corresponding to the hue value difference of standing position A is 80 points, and the hue score corresponding to the hue value difference of standing position B is 85 points. The hue score value corresponding to standing position B is greater than the hue score corresponding to standing position A. Then, the hue of standing position B is more suitable for shooting than the hue of standing position A.

[0117] Specifically, for any standing position, calculate the respective corresponding brightness score according to the ambient brightness value of the standing position.

[0118] It should be noted that the background color evaluation criteria include the brightness score criteria. The brightness score criteria can also be set according to the user's shooting requirements. For example, the larger the ambient brightness value, the higher the corresponding brightness score value, or when the ambient brightness value is within a first preset range, the higher the corresponding brightness score value. This embodiment also does not make specific limitations on this.

[0119] Continuing with the above example, the brightness score corresponding to the ambient brightness value at standing position A is 60 points, and the brightness score corresponding to the ambient brightness value at standing position B is 95 points. Since the brightness score value corresponding to standing position B is greater than that corresponding to standing position A, the brightness at standing position B is more suitable for shooting than that at standing position A.

[0120] For any standing position, based on the hue score and brightness score corresponding to the standing position, calculate the background color score corresponding to the standing position. Among them, the hue score and brightness score corresponding to the standing position can be weighted and calculated according to user needs to obtain the background color score corresponding to the standing position. The weights for weighting can be set according to user shooting requirements.

[0121] Continuing with the above example, assume that the weights of the hue score and brightness score corresponding to the standing position are both 0.5. For standing position A, multiply the hue score of 80 points and the brightness score of 60 points by the corresponding weight of 0.5 respectively, and then add them together to calculate that the background color score corresponding to standing position A is 70 points. For standing position B, multiply the hue score of 85 points and the brightness score of 95 points by the corresponding weight of 0.5 respectively, and then add them together to calculate that the background color score corresponding to standing position B is 90 points. Since the background color score of standing position B is higher than that of standing position A, the background color at standing position B is more suitable for shooting than that at standing position A.

[0122] According to the above method, the background color scores corresponding to all standing positions can be calculated.

[0123] In a possible implementation manner, in step S123, based on the ambient light evaluation standard, according to the ambient light information of each standing position, calculate the ambient light score corresponding to each standing position, including:

[0124] Based on the ambient light evaluation standard, calculate the light intensity score corresponding to each standing position according to the light intensity of each standing position;

[0125] Calculate the light angle score corresponding to each standing position according to the light angle of each standing position;

[0126] Calculate the ambient light score corresponding to each standing position according to the light intensity score and light angle score corresponding to each standing position.

[0127] Specifically, the ambient light information includes light intensity and light angle. Among them, the light intensity and light angle are affected by the position and sunlight intensity. The light intensity can be used to represent the strength of the light in the environment of the standing position, and the light angle can be used to represent the angle of the light in the environment of the standing position.

[0128] For any standing position, the environmental light evaluation criteria include light intensity scores corresponding to different light intensities. For example, when the light intensity is within a preset light intensity range, the light intensity score is relatively high. Based on the light intensity of the standing position, the light intensity scores corresponding to each standing position are calculated.

[0129] In an optional example, the light intensity score of standing position A is 90 points, and the light intensity score of standing position B is 70 points. The light intensity score corresponding to standing position A is greater than the light intensity score corresponding to standing position B. The light intensity at standing position A is more suitable for shooting than that at standing position B.

[0130] Specifically, the environmental light evaluation criteria also include light angle scores corresponding to different light angles. When the light angle is within a preset light angle range, the light angle score is relatively high. Based on the light angle of the standing position, the light angle scores corresponding to each standing position are calculated.

[0131] Continuing with the above example, the light angle score of standing position A is 90 points, and the light angle score of standing position B is 45 points. The light angle score corresponding to standing position A is greater than the light angle score corresponding to standing position B. The light angle at standing position A is more suitable for shooting than that at standing position B.

[0132] Specifically, the light intensity score and the light angle score corresponding to the standing position are weighted and calculated to obtain the environmental light score corresponding to the standing position. Among them, the light intensity score and the light angle score corresponding to the standing position can be weighted and calculated according to user needs to obtain the background color score corresponding to the standing position. The weights for weighting can be set according to user shooting requirements.

[0133] Continuing with the above example, assume that the weights of the light intensity score and the light angle score corresponding to the standing position are 0.6 and 0.4 respectively. For standing position A, after multiplying the light intensity score of 90 points and the light angle score of 90 points by the corresponding weights of 0.6 and 0.4 respectively, and then adding them together, the calculated environmental light score corresponding to standing position A is 90 points. For standing position B, after multiplying the light intensity score of 70 points and the light angle score of 45 points by the corresponding weights of 0.6 and 0.4 respectively, and then adding them together, the calculated environmental light score corresponding to standing position B is 60 points. Since the environmental light score of standing position A is higher than that of standing position B, the environmental light at standing position A is more suitable for shooting than that at standing position B.

[0134] According to the above method, the environmental light scores corresponding to all standing positions can be calculated.

[0135] In a possible implementation, in step S13, after determining at least one target standing position that is most suitable for shooting, the following steps are further included:

[0136] Determine the orientation of the user according to the target standing position and the environmental information of the target standing position.

[0137] It should be noted that after determining the target standing position, since the user's orientation and the environmental information of the target standing position will also affect the shooting quality, it is necessary to determine the user's orientation according to the environmental information of the target standing position. For example, the angle between the light and the user will also affect the quality of the captured image.

[0138] In a possible implementation, determining the orientation of the user according to the target standing position and the environmental information of the target standing position includes:

[0139] Determine the orientation of the user based on a preset included angle threshold according to the light angle of the target standing position, where the included angle threshold is used to represent the threshold of the included angle between the light and the user's orientation.

[0140] Specifically, the environmental information of the target standing position includes the light angle, and an included angle threshold is preset in the shooting system. The included angle threshold is used to represent the threshold of the included angle between the light and the user's orientation. When the included angle between the user's orientation and the light angle is within the included angle threshold, it means that the user's orientation matches the environmental information of the target standing position at this time, and the quality of the captured image will be higher. According to the light angle of the target standing position and based on the included angle threshold, the orientation of the user can be determined.

[0141] Moreover, the shooting system can display the image, display the user's shooting image in real time, and the user can adjust their orientation and posture in real time according to the shooting image.

[0142] In a possible implementation, the above method further includes:

[0143] Receive the user's voice information or body information;

[0144] When receiving the user's voice information, perform semantic recognition on the voice information to identify whether the voice information contains words for indicating shooting;

[0145] Or, when receiving the user's body information, perform body language recognition on the body information to identify whether the body information contains body movements for indicating shooting;

[0146] In the case where it is recognized that the voice information contains words for indicating shooting, or it is recognized that the body information contains body movements for indicating shooting, generate a shooting instruction for the user.

[0147] Specifically, in the shooting system, automatic shooting can be performed, or the shooting system can be controlled by the user to take pictures.

[0148] When shooting automatically, a shooting frequency is set in the shooting system. After the automatic shooting function of the system is activated, the on-vehicle camera device takes pictures at a fixed frequency and can also automatically identify environmental information and capture pictures.

[0149] When the shooting system is controlled by the user, the on-vehicle camera device can be controlled to take pictures through gestures or voice.

[0150] When the on-vehicle camera device is controlled to take pictures through gestures or voice, the shooting system receives the user's voice information or body information.

[0151] When receiving the user's voice information, the shooting system performs semantic recognition on the voice information to identify whether the voice information contains words for indicating shooting. When it is recognized that the voice information contains words for indicating shooting, a shooting instruction of the user is generated so that the shooting system performs a shooting operation according to the shooting instruction of the user.

[0152] When receiving the user's body information, body language recognition is performed on the body information to identify whether the body information contains body movements for indicating shooting. When it is recognized that the body information contains body movements for indicating shooting, a shooting instruction of the user is generated so that the shooting system performs a shooting operation according to the shooting instruction of the user.

[0153] In a possible implementation manner, the above method further includes:

[0154] The on-vehicle camera device can collect the user's image in real time and display it on an external vehicle display device or a mobile phone. After seeing it, the user can adjust his own orientation, position and posture. When the user is not satisfied with the current standing position, the user can also interact with the shooting system through the mobile phone to change the standing position.

[0155] After the shooting system finishes shooting, it can also screen out pictures with good visual effects through system functions such as AI for saving.

[0156] The shooting system can also provide a function of automatically capturing pictures within a set time or a set location range, and taking pictures that meet the shooting standards (such as everyone playing during camping).

[0157] After shooting is completed, an album can also be generated according to the taken pictures, enabling the user to view and screen the pictures through the on-vehicle camera device or the mobile phone, and improving the satisfaction of the user's personalized needs.

[0158] It can be understood that for the technical solution provided in this embodiment, when a shooting instruction is received, in response to the shooting instruction, environmental information of multiple standing positions within the vehicle surrounding area is acquired. The vehicle surrounding area is used to represent an area where the distance from the vehicle is within a preset range, and the standing position is used to characterize the position where the user is expected to stand when the user is being photographed. Based on a preset shooting environment evaluation criterion, according to the environmental information corresponding to each standing position, it is evaluated whether each standing position is suitable for shooting, and an environmental evaluation result of each standing position is obtained. Among them, at least one target standing position that is most suitable for shooting is determined according to the environmental evaluation results of multiple standing positions. The target standing position is marked by an in-vehicle projection device to remind the user to move to the target standing position, so that when the user wants to take a photo during a trip, there is no need to repeatedly move the position, saving the user's adjustment time. And when the user moves to the target standing position, the shooting instruction is executed by the in-vehicle photography device, without the user having to take the photo through a handheld device, which is simple, fast, and convenient to operate, solving the problem of inconvenient camera operation, time-consuming and laborious caused by repeatedly adjusting the standing position during the process of the user taking a self-portrait or group photo during a trip.

[0159] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The order of execution of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0160] Corresponding to the method described in the above embodiments, Figure 3 The structure diagram of a shooting device provided by an embodiment of the present application is shown. For the sake of convenience of description, only the parts related to the embodiment of the present application are shown.

[0161] Referring to Figure 3 , the shooting device 3 includes:

[0162] An information acquisition module 31, configured to, when a shooting instruction is received, in response to the shooting instruction, acquire environmental information of multiple standing positions within the vehicle surrounding area, where the vehicle surrounding area is used to represent an area where the distance from the vehicle is within a preset range, and the standing position is used to characterize the position where the user is expected to stand when the user is being photographed;

[0163] An environmental evaluation module 32, configured to, based on a preset shooting environment evaluation criterion, evaluate whether each standing position is suitable for shooting according to the environmental information corresponding to each standing position, and obtain an environmental evaluation result of each standing position;

[0164] A target standing position confirmation module 33, configured to determine at least one target standing position that is most suitable for shooting according to the environmental evaluation results of multiple standing positions;

[0165] A position identification module 34 is configured to identify a target standing position through an in-vehicle projection device to remind a user to move to the target standing position, and execute a shooting instruction through an in-vehicle photography device when the user moves to the target standing position.

[0166] In a possible implementation, the environmental information includes background color information and environmental light information of the standing position; the shooting environment evaluation criteria include background color evaluation criteria and environmental light evaluation criteria; the environment evaluation module 32 includes:

[0167] A user information acquisition unit 321 is configured to acquire the clothing information of the user;

[0168] A background color evaluation unit 322 is configured to calculate the background color scores corresponding to each standing position based on the background color evaluation criteria, according to the background color information and the clothing information of each standing position;

[0169] An environmental light evaluation unit 323 is configured to calculate the environmental light scores corresponding to each standing position based on the environmental light evaluation criteria, according to the environmental light information of each standing position;

[0170] An evaluation result calculation unit 324 is configured to obtain the environmental evaluation results corresponding to each standing position according to the background color scores and the environmental light scores corresponding to each standing position.

[0171] In a possible implementation, the background color information includes an environmental hue value and an environmental brightness value;

[0172] The clothing information includes a clothing hue value;

[0173] When calculating the background color scores corresponding to each standing position based on the background color evaluation criteria, according to the background color information and the clothing information of each standing position, the background color evaluation unit 322 is further configured to calculate the hue scores corresponding to each standing position based on the background color evaluation criteria, according to the environmental hue value and the clothing hue value of each standing position; calculate the brightness scores corresponding to each standing position according to the environmental brightness value of each standing position; calculate the background color scores corresponding to each standing position according to the hue scores and the brightness scores corresponding to each standing position.

[0174] In a possible implementation, the environmental light information includes light intensity and light angle;

[0175] When calculating the ambient light score corresponding to each standing position according to the ambient light information of each standing position based on the ambient light evaluation standard, the ambient light evaluation unit 323 is further configured to calculate the light angle score corresponding to each standing position according to the light angle of each standing position; and calculate the ambient light score corresponding to each standing position according to the light intensity score and the light angle score corresponding to each standing position.

[0176] In a possible implementation manner, after determining at least one target standing position most suitable for shooting, the photographing device 3 further includes:

[0177] A user orientation determination module 35, configured to determine the orientation of the user according to the target standing position and the environmental information of the target standing position.

[0178] In a possible implementation manner, when determining the orientation of the user according to the target standing position and the environmental information of the target standing position, the user orientation determination module 35 is further configured to determine the orientation of the user according to the light angle of the target standing position based on a preset included angle threshold, where the included angle threshold is used to represent the threshold of the included angle between the light and the orientation of the user.

[0179] In a possible implementation manner, the photographing device 3 further includes:

[0180] A photographing instruction generation module 36, configured to receive the voice information or body information of the user; when receiving the voice information of the user, perform semantic recognition on the voice information to identify whether the voice information contains words for indicating shooting; or, when receiving the body information of the user, perform body language recognition on the body information to identify whether the body information contains body movements for indicating shooting; and generate a shooting instruction of the user when it is recognized that the voice information contains words for indicating shooting, or it is recognized that the body information contains body movements for indicating shooting.

[0181] It should be noted that for the information interaction, execution process, etc. between the above-mentioned devices / units, since they are based on the same concept as the method embodiments of the present application, their specific functions and the technical effects brought about can be specifically referred to in the method embodiment part, and will not be elaborated here.

[0182] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the above division of each functional unit and module is used as an example. In actual applications, the above functions can be allocated to different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiments can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction and do not limit the protection scope of this application. The specific working processes of the units and modules in the above system can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0183] An embodiment of this application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor. When the processor executes the computer program, the steps in any of the foregoing method embodiments are implemented.

[0184] An embodiment of this application also provides a vehicle, including an in-vehicle projection device, and an in-vehicle photography device that executes any one of the foregoing methods.

[0185] An embodiment of this application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in each of the foregoing method embodiments can be implemented.

[0186] An embodiment of this application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal is enabled to execute the steps in each of the foregoing method embodiments.

[0187] When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, to implement all or part of the processes in the above-described embodiment methods of this application, a computer program can be used to instruct relevant hardware to complete. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above-described method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the photographing device / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc. In some jurisdictions, according to legislation and patent practice, the computer-readable medium cannot be an electrical carrier signal and a telecommunication signal.

[0188] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0189] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed in this article can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of this application.

[0190] In the embodiments provided in this application, it should be understood that the disclosed device / network device and method can be implemented in other ways. For example, the device / network device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.

[0191] The unit described as the separation component may or may not be physically separated. The component shown as a unit may or may not be a physical unit, that is, it may be located in one place or may be distributed over multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0192] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A shooting method, applied to a vehicle-mounted photography device, characterized in that: include: When receiving a shooting instruction, in response to the shooting instruction, obtaining environmental information of a plurality of standing positions in an area surrounding the vehicle, wherein the area surrounding the vehicle is used to represent an area within a preset range of distance from the vehicle, and the standing position is used to represent a position where the user is expected to stand when shooting the user; Based on a preset shooting environment evaluation standard, and according to the environmental information corresponding to each of the standing positions, evaluating whether each of the standing positions is suitable for shooting, and obtaining an environmental evaluation result for each of the standing positions; Determining at least one target standing position most suitable for shooting according to the environmental evaluation results of the plurality of standing positions; The target standing position is marked by a vehicle-mounted projection device to remind the user to move to the target standing position, and when the user moves to the target standing position, the shooting instruction is executed by the vehicle-mounted photography device.

2. The shooting method according to claim 1, characterized in that: The environmental information includes background color information and ambient light information of the standing position; The shooting environment evaluation standard includes a background color evaluation standard and an ambient light evaluation standard; The step of evaluating whether each standing position is suitable for shooting based on the preset shooting environment evaluation standard and the environmental information corresponding to each standing position to obtain the environmental evaluation result of each standing position includes: Acquire clothing information of the user; Based on the background color evaluation standard, according to the background color information of each standing position and the clothing information of the user, a background color score corresponding to each standing position is calculated; Based on the ambient light evaluation standard, according to the ambient light information of each standing position, the ambient light score corresponding to each standing position is calculated; According to the background color score and the ambient light score corresponding to each of the standing positions, an environmental evaluation result corresponding to each of the standing positions is obtained.

3. The shooting method according to claim 2, characterized in that: The background color information includes an ambient hue value and an ambient brightness value; The clothing information includes clothing color tone value; The step of calculating the background color score corresponding to each standing position based on the background color evaluation standard and according to the background color information of each standing position and the clothing information of the user includes: Based on the background color evaluation standard, according to the environment color value and the clothing color value of each standing position, the color tone score corresponding to each standing position is calculated; Calculate the brightness score corresponding to each standing position according to the ambient brightness value of each standing position; The background color score corresponding to each standing position is calculated based on the hue score and the brightness score corresponding to each standing position.

4. The shooting method according to claim 2, characterized in that: The ambient light information includes light intensity and light angle; The step of calculating the ambient light score corresponding to each standing position based on the ambient light evaluation standard and according to the ambient light information of each standing position includes: Based on the ambient light evaluation standard, according to the light intensity of each standing position, a light intensity score corresponding to each standing position is calculated; According to the light angle of each standing position, a light angle score corresponding to each standing position is calculated; The ambient light score corresponding to each of the standing positions is calculated based on the light intensity score and the light angle score corresponding to each of the standing positions.

5. The shooting method according to claim 4, characterized in that: After determining at least one target standing position most suitable for photographing, the method further comprises: The orientation of the user is determined according to the target standing position and environmental information of the target standing position.

6. The shooting method according to claim 5, characterized in that: The determining the orientation of the user according to the target standing position and the environmental information of the target standing position includes: According to the light angle at the target standing position, the user's orientation is determined based on a preset angle threshold, wherein the angle threshold is used to characterize a threshold of an angle between the light and the user's orientation.

7. The shooting method according to any one of claims 1 to 6, characterized in that: The method further comprises: Receiving voice information or body language information from the user; When receiving the voice information of the user, performing semantic recognition on the voice information to identify whether the voice information contains words for instructing shooting; Alternatively, when receiving the user's body language information, performing body language recognition on the body language information to identify whether the body language information contains a body language movement for instructing shooting; When it is recognized that the voice information contains words for instructing shooting, or when it is recognized that the body information contains body movements for instructing shooting, a shooting instruction of the user is generated.

8. A photographing device, characterized in that: include: an information acquisition module, configured to, when receiving a shooting instruction, acquire environmental information of a plurality of standing positions in an area surrounding the vehicle in response to the shooting instruction, wherein the area surrounding the vehicle is used to represent an area within a preset range of distance from the vehicle, and the standing position is used to represent a position where the user is expected to stand when the user is photographed; An environment evaluation module, for evaluating whether each of the standing positions is suitable for shooting based on a preset shooting environment evaluation standard and according to the environment information corresponding to each of the standing positions, and obtaining an environment evaluation result for each of the standing positions; A target standing position confirmation module, used to determine at least one target standing position most suitable for shooting according to the environmental evaluation results of the plurality of standing positions; The position identification module is used to identify the target standing position through the vehicle-mounted projection device to remind the user to move to the target standing position, and when the user moves to the target standing position, execute the shooting instruction through the vehicle-mounted photography device.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A vehicle, characterized in that: It comprises a vehicle-mounted projection device and a vehicle-mounted photography device for executing the method described in any one of claims 1-7.

Images