Vehicle control method, electronic device, and computer-readable storage medium
Patent Information
- Application Number
- CN202210652779.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-08
- Publication Date
- 2026-10-27
- Estimated Expiration
- 2042-06-08
AI Technical Summary
[0003]然而,汽车的车外摄像头等传感器通常在用户位于车内的情况下为用户提供服务,局限性较大
[0004]本申请的实施方式提供了一种可至少部分解决现有技术中存在的上述问题的车辆控制方法、电子设备及计算机可读存储介质。
Smart Images

Figure CN117246230B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of this application relate to the field of vehicle control technology, and more specifically, to a vehicle control method, electronic device, and computer-readable storage medium. Background Technology
[0002] As automobiles become safer and more intelligent, they are equipped with an increasing number of sensors to improve their safety and intelligence. For example, external cameras are installed in cars to collect image data during driving in order to analyze road conditions.
[0003] However, sensors such as exterior cameras in automobiles typically provide services to users while they are inside the vehicle, which has significant limitations. Summary of the Invention
[0004] Embodiments of this application provide a vehicle control method, electronic device, and computer-readable storage medium that can at least partially solve the aforementioned problems existing in the prior art.
[0005] One embodiment of this application provides a vehicle control method, including: detecting the area around the vehicle to obtain monitoring data; responding to the monitoring data indicating the presence of a first monitored object around the vehicle, determining characteristic information of the first monitored object based on the monitoring data, the characteristic information including at least one of the location information of the first monitored object, the motion trajectory information of the first monitored object, and the emotional information of the first monitored object; and triggering a vehicle control command based on the characteristic information of the first monitored object.
[0006] Another embodiment of this application provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the vehicle control method mentioned in the above embodiments.
[0007] Another embodiment of this application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the vehicle control method mentioned in the above embodiments.
[0008] According to the embodiments of this application, electronic devices can monitor the area around a vehicle, and after a user-designated first monitoring object is found around the vehicle, the device monitors the characteristic information of the first monitoring object (such as location information or movement trajectory information representing the activity range, emotional information, etc.) to control the vehicle based on the characteristic information of the first monitoring object, so that the vehicle can provide users with more functions such as activity range monitoring and emotion monitoring, and provide more intelligent external scenarios. Attached Figure Description
[0009] Other features, objects, and advantages of this application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings. Wherein:
[0010] Figure 1 This is a structural schematic diagram of a vehicle according to some embodiments of this application;
[0011] Figure 2 This is a schematic diagram of the structure of a piezoelectric ceramic loudspeaker according to some embodiments of this application;
[0012] Figure 3 This is a schematic flowchart of a vehicle control method according to some embodiments of this application;
[0013] Figure 4 This is a schematic diagram showing the relative positions of the effective monitoring area and the safety area of a vehicle according to some embodiments of this application;
[0014] Figure 5 This is a schematic diagram showing the relative relationship between the desired safety area, the parking area of each vehicle, and the actual safety area according to some embodiments of this application.
[0015] Figure 6 This is a schematic diagram showing the relative relationship between the desired safety area, the parking area of each vehicle, and the actual safety area according to some other embodiments of this application.
[0016] Figure 7 This is a schematic diagram showing the relative positions of a first monitored object and a vehicle according to some embodiments of this application;
[0017] Figure 8 This is a schematic diagram of the trajectory of a first monitored object according to some embodiments of this application;
[0018] Figure 9 These are schematic block diagrams of electronic devices according to some embodiments of this application. Detailed Implementation
[0019] To better understand this application, various aspects of this application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed descriptions are merely illustrative of exemplary embodiments of this application and are not intended to limit the scope of this application in any way. Throughout the specification, the same reference numerals refer to the same elements. The expression "and / or" includes any and all combinations of one or more of the associated listed items.
[0020] It should be noted that in this specification, the terms "first," "second," "third," etc., are used only to distinguish one feature from another and do not imply any limitation on the features, especially not any order of precedence. For example, without departing from the teachings of this application, the first monitoring object discussed herein may also be referred to as the second monitoring object, and vice versa.
[0021] In the accompanying drawings, the thickness, dimensions, and shapes of the parts have been slightly adjusted for ease of illustration. The drawings are for illustrative purposes only and are not drawn to scale. As used herein, the terms “approximately,” “about,” and similar terms are used as expressions of approximation, not as expressions of degree, and are intended to illustrate inherent deviations in measured or calculated values that will be recognized by one of ordinary skill in the art.
[0022] It should also be understood that expressions such as "comprising," "including," "having," "containing," and / or "comprising" are open-ended rather than closed-ended expressions in this specification, indicating the presence of the stated features, elements, and / or components, but not excluding the presence of one or more other features, elements, components, and / or combinations thereof. Furthermore, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features, not just individual elements in the list. Additionally, when describing embodiments of this application, the word "may" is used to mean "one or more embodiments of this application." And the term "exemplary" is intended to refer to examples or illustrations.
[0023] Unless otherwise specified, all terms used herein (including engineering and technical terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that, unless expressly stated herein, terms defined in common dictionaries shall be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or overly formalized meaning.
[0024] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. Furthermore, unless explicitly limited or contradicted by the context, the specific steps included in the methods described in this application are not limited to the order in which they are described, but can be performed in any order or in parallel. This application will now be described in detail with reference to the accompanying drawings and embodiments.
[0025] Furthermore, when the term "connection" or "linkage" is used in this application, it may indicate direct or indirect contact between the corresponding components, unless otherwise expressly defined or deduced from the context.
[0026] Figure 1This is a structural schematic diagram of a vehicle according to some embodiments of this application. For example... Figure 1 As shown, vehicle 100 may include a detection device. The detection device is used to detect the environment surrounding the vehicle to obtain monitoring data. See also... Figure 1 The detection device may include a voice detection module 111, a vibration detection module 112, a distance detection module 113, and an image acquisition module 114. The voice detection module 111 is configured to detect voice and generate voice data. The vibration detection module 112 is configured to detect vibration and generate vibration data. The distance detection module 113 is configured to detect distance and generate distance data. The image acquisition module 114 is configured to detect the vehicle's surrounding environment and generate image data. In embodiments of this application, the image acquisition module may be an external vehicle camera. The installation positions of the voice detection module 111, vibration detection module 112, distance detection module 113, and image acquisition module 114 can be set as needed. For example, the voice detection module 111 may be installed in at least one of the vehicle's B-pillar (not shown), the window glass frame 141 covering the B-pillar, and the rearview mirror 142. Vibration detection module 112 is disposed in at least one of the vehicle's door panel 143, hood 144, trunk lid 145, front bumper 146, and rear bumper 147, allowing an outsider to interact with the vehicle 10 by tapping the aforementioned devices. Distance detection module 113 is disposed in at least one of the B-pillar (not shown) between the front and rear seats of the vehicle 10's cabin, the window glass frame 141 covering the B-pillar, and the rearview mirror 142. Image detection module 114 is disposed in at least one of the B-pillar (not shown) between the front and rear seats of the vehicle 10's cabin, the window glass frame 141 covering the B-pillar, the front bumper 146, and the rear bumper 147. Monitoring data may be one or more of the aforementioned voice data, vibration data, distance data, and image data.
[0027] The vehicle 10 may also include an external sound-emitting device 130, which may be disposed in at least one of the vehicle's door panel 143, hood 144, trunk lid 145, front bumper 146, rear bumper 147, roof, and undercarriage. The external sound-emitting device 130 may be an electromagnetic coil speaker or a panel sound-emitting module, and there is no limitation herein.
[0028] In some embodiments of this application, the panel sound-emitting module may be a piezoelectric panel sound-emitting module. For example, the piezoelectric panel sound-emitting module may include a piezoelectric ceramic speaker. Figure 2This is a schematic diagram of the structure of a piezoelectric ceramic loudspeaker according to some embodiments of this application. The piezoelectric ceramic loudspeaker may include electrode plates 211 configured to receive excitation voltage from a driving circuit. Electrode plates 211 may be a pair of positive and negative electrodes. The piezoelectric ceramic loudspeaker may also include a piezoelectric ceramic 212 configured to elongate or contract laterally or longitudinally under the action of the excitation voltage received through the electrode plates 211. The excitation voltage may be a high-frequency square wave with alternating polarity, thus causing the piezoelectric ceramic 212 to undergo mechanical deformation, i.e., elongation or contraction, under the action of this alternating polarity square wave. Furthermore, the piezoelectric ceramic 212 may be a laterally or longitudinally polarized piezoelectric ceramic 212, thereby generating lateral or longitudinal mechanical deformation under the action of the excitation voltage. The piezoelectric ceramic loudspeaker may also include a diaphragm 213 attached to the piezoelectric ceramic 212 and vibrating as the piezoelectric ceramic 212 elongates or contracts. In this way, the piezoelectric ceramic loudspeaker converts the input excitation voltage into vibration, thereby emitting speech. The diaphragm 213 can be attached to components such as the door panel 143 to cause the door panel 143 to vibrate. The piezoelectric ceramic loudspeaker may also include a vibration pad 214 located between the diaphragm 213 and the door panel 143. For example, the vibration pad 214 may be an adhesive used to bond the diaphragm 213 and the door panel 143. Furthermore, in some embodiments, the piezoelectric ceramic loudspeaker may include multiple piezoelectric ceramics 212 and corresponding pairs of electrode plates 211. For example, a piezoelectric ceramic 212 may be disposed on each of the upper and lower sides of the diaphragm 213, and both may extend or contract in opposite directions under the action of their respective electrode plates 211, thereby further enhancing the vibration effect. Sound is emitted outward through the panel sound-emitting module, resulting in a wider sound field for the vehicle.
[0029] Vehicle 10 may also include an in-vehicle infotainment system. The electronic device may be the in-vehicle infotainment system of vehicle 10, which can receive monitoring data obtained by the detection device from detecting the surrounding environment of the vehicle through in-vehicle communication technology, and perform data processing accordingly.
[0030] It should be understood that, Figure 1 The positions of the components are shown in the illustration only, and adjustments can be made in other implementations.
[0031] It should be understood that, in the embodiments of this application, the information about the user's personal information obtained by the electronic device (e.g., the user's contact information, the identification information of the first monitored object stored by the user, etc.) is obtained with the user's authorization, and this application will not emphasize this point again.
[0032] To make better use of monitoring data and provide users with more intelligent services, embodiments of this application provide a vehicle control method through which electronic devices can control vehicles. For example, the electronic device can be a vehicle infotainment system, or a server, mobile terminal, etc., that is communicatively connected to the vehicle infotainment system. Figure 3 This is a schematic flowchart of a vehicle control method according to some embodiments of this application. For example... Figure 3 As shown, the vehicle control method 200 may include the following steps.
[0033] S21, to detect the area around the vehicle to obtain monitoring data.
[0034] S22, in response to monitoring data indicating the presence of a first monitored object around the vehicle, determining characteristic information of the first monitored object based on the monitoring data. The characteristic information includes at least one of the following: location information of the first monitored object, movement trajectory information of the first monitored object, and emotional information of the first monitored object.
[0035] S23, trigger vehicle control commands based on the characteristic information of the first monitored object.
[0036] According to the embodiments of this application, electronic devices can monitor the area around a vehicle, and after a user-designated first monitoring object is found around the vehicle, the device monitors the characteristic information of the first monitoring object (such as location information or movement trajectory information representing the activity range, emotional information, etc.) to control the vehicle based on the characteristic information of the first monitoring object, so that the vehicle can provide users with more functions such as activity range monitoring and emotion monitoring, and provide more intelligent external scenarios.
[0037] For ease of understanding, the following is... Figure 3 The steps shown are illustrated by example.
[0038] Step S21
[0039] In some embodiments of this application, after the electronic device switches the vehicle mode to a preset operating mode other than the vehicle driving mode, it executes steps S21 to S23. For example, in a user camping scenario, the preset operating mode is camping mode. For ease of understanding, the following description uses camping mode as an example. Optionally, the electronic device can acquire the vehicle's location information and an electronic map within a preset range around the vehicle in real time. Some suitable camping areas are marked on the electronic map as camping areas. After determining that the vehicle is parked, the electronic device determines whether the parking area is a camping area based on the vehicle's location information. If the parking area is determined to be a camping area, the electronic device can switch the vehicle's operating mode to camping mode.
[0040] It should be understood that, without departing from the teachings of this application, the electronic device may, after determining that the vehicle's parking area is a camping area, first determine the parking time, and only after determining that the parking time has reached a preset duration, switch the vehicle's operating mode. Alternatively, the electronic device may, after determining that the vehicle's parking area is a camping area, first provide initial consultation information to the user to inquire whether to switch the vehicle's operating mode to camping mode, and only switch the vehicle's operating mode after receiving initial feedback from the user indicating agreement to switch. This application does not impose any limitations on this.
[0041] It should be understood that, without departing from the teachings of this application, after determining that the vehicle's parking area is not a camping area, the electronic device may not adjust the vehicle's operating mode, or it may provide initial consultation information to consult the user whether to switch the vehicle's operating mode to camping mode, and determine whether to switch the vehicle's operating mode based on the user's feedback. This application does not impose any restrictions on this.
[0042] Optionally, the electronic device can provide feedback on the first inquiry via the vehicle's touchscreen or a sound-emitting device (e.g., an in-vehicle sound-emitting device or an external sound-emitting device). Taking a sound-emitting device as an example, the sound-emitting device can be either an in-vehicle sound-emitting device or an external sound-emitting device. When feedback on the first inquiry is needed, the electronic device can detect the user's location using a detection device. If the detection result indicates that the user is inside the vehicle, the feedback on the first inquiry is provided through the in-vehicle sound-emitting device; if the detection result indicates that the user is outside the vehicle, the feedback on the first inquiry is provided through the external sound-emitting device.
[0043] It should be understood that, without departing from the teachings of this application, the user can be the vehicle owner or any person whose personal information, including passengers, is entered into the electronic device as a user of the vehicle, and this application does not restrict this.
[0044] It should be understood that, without departing from the teachings of this application, the operating modes that can trigger steps S21 to S23 may be other than the camping mode, and this application does not limit the operating modes that trigger steps S21 to S23.
[0045] In some embodiments of this application, after the vehicle is put into camping mode, the electronic device can detect the area around the vehicle using a detection device located outside the vehicle to obtain monitoring data. The detection device may include an image acquisition module, and the monitoring data includes first image data. In this document, the image acquisition module is exemplified by an external vehicle camera. The external vehicle camera may include a camera mounted on the outside of the vehicle body, or other cameras located outside the vehicle, whose shooting area includes the area around the vehicle, independent of the vehicle, and communicatively connected to the electronic device; no limitation is made here.
[0046] It should be understood that, without departing from the teachings of this application, the detection device may also be a biosensor, vehicle radar, or other devices that can be used to determine the characteristic information of the first monitored object. This application does not limit this. The monitoring data may also include distance data, as mentioned above. This application does not limit this.
[0047] Step S22
[0048] In some embodiments of this application, the electronic device stores identification information of a first monitored object for monitoring the first monitored object. The identification information of the first monitored object may be facial image information of the first monitored object, or other information, such as voiceprint information, etc., and this application does not limit it.
[0049] Optionally, the electronic device begins monitoring after the first monitored object appears in the vehicle's monitoring area. For example, the electronic device can use a facial recognition algorithm to identify the monitoring data collected by the detection device and determine whether the first monitored object exists. If the electronic device detects the first monitored object, it determines that the monitoring data indicates the presence of the first monitored object around the vehicle. In response to the monitoring data indicating the presence of the first monitored object around the vehicle, the electronic device determines the characteristic information of the first monitored object based on the monitoring data.
[0050] For ease of understanding, the following example illustrates how an electronic device determines the characteristic information of a first monitored object, using monitoring data including first image data captured by an external camera.
[0051] As an example, the external camera can be a depth camera. The first image data includes depth information. The electronic device can determine the relative distance and / or relative direction between the first monitored object and the vehicle based on the depth information of the first monitored object in the first image data, as the location information of the first monitored object.
[0052] As another example, the monitoring data also includes distance information captured by the distance detection module. The electronic device can determine the relative direction between the first monitored object and the vehicle based on the first image data, and combine this relative direction distance information to determine the relative distance between the first monitored object and the vehicle, which can then be used as the location information of the first monitored object.
[0053] As another example, the electronic device identifies a first monitored object in the first image data and determines the motion trajectory information of the first monitored object based on multiple images captured in succession.
[0054] As yet another example, the electronic device identifies a first monitored object in the first image data and identifies the emotional information of the first monitored object through an emotion recognition algorithm or other algorithms.
[0055] It should be understood that, without departing from the teachings of this application, the characteristic information of the first monitored object may also be other information of the first monitored object, and this application does not limit this.
[0056] It should be understood that, without departing from the teachings of this application, electronic devices may also determine the characteristic information of the first monitored object in other ways, and this application does not impose any restrictions on this.
[0057] It should be understood that, without departing from the teachings of this application, the electronic device may also determine other information based on the first image data, such as environmental information around the vehicle (e.g., the weather around the vehicle, the scenery around the vehicle, objects around the vehicle, etc.), and this application does not limit this.
[0058] Step S23
[0059] In some embodiments of this application, the characteristic information of the first monitored object may include at least one of the location information of the first monitored object, the movement trajectory information of the first monitored object, and the emotional information of the first monitored object. The electronic device monitors the first monitored object based on the aforementioned characteristic information, for example, monitoring the emotions and / or activity range of the first monitored object.
[0060] To facilitate understanding, the activity range of the first monitored object in electronic equipment monitoring will be illustrated below.
[0061] In some embodiments of this application, the characteristic information of the first monitored object includes the location information or movement trajectory information of the first monitored object, and the control command includes an alarm command. The electronic device triggering the vehicle's control command based on the characteristic information of the first monitored object includes: triggering an alarm command in response to the location information or movement trajectory information indicating that the first monitored object has exceeded a predefined safe area. The electronic device can monitor the activity of the first monitored object through its location information or movement trajectory information, allowing the vehicle to help the user monitor the first monitored object in camping mode, reducing user stress and allowing the user to enjoy camping more. Furthermore, monitoring the first monitored object by the electronic device can also make the first monitored object safer. Especially in cases where the first monitored object is a child, an elderly person with dementia, etc., if the first monitored object leaves the safe area, the electronic device can promptly alert the user so that the user can take timely measures.
[0062] To facilitate understanding, we will first provide an exemplary description of how to define a secure area. For example, the methods for defining secure areas on electronic devices include, but are not limited to, method 1 and method 2.
[0063] Method 1: The electronic device acquires the monitoring distance and delineates a safe zone based on the monitoring distance. The monitoring distance can be determined based on the age of the first monitored object, the object's physical characteristics, or acquired distance parameters.
[0064] In some exemplary embodiments, the electronic device may define a safe area as a circular region or a sector-shaped region centered on the vehicle and with the monitoring distance as its radius, or it may define a rectangular region centered on the vehicle and with the monitoring distance as its side length.
[0065] It should be understood that the way electronic devices delineate safe zones based on monitoring distance and vehicle location, as well as the shape of the safe zones, can be set as needed, and this application does not impose any restrictions on this.
[0066] As an example, the electronic device obtains the age of the first monitored object and determines the monitoring distance based on the correlation between age and monitoring distance. This correlation can be a positive correlation: the older the monitored object, the greater the monitoring distance, and vice versa. The electronic device uses the monitored object's age to define a safe zone, fully considering the individual characteristics of the monitored object, making the defined safe zone more closely match the monitored object's activity needs.
[0067] It should be understood that, without departing from the teachings of this application, the correspondence between age and monitoring distance can be set as needed, and this application does not impose any restrictions on this.
[0068] As another example, the electronic device acquires the physical characteristic information of the first monitored object and determines the monitoring distance by combining the physical characteristic information with the monitoring distance correspondence. The physical characteristic information may include height, weight, gender, etc., and this application does not limit this. If the physical characteristic information includes one of height, weight, or gender, taking height as an example, the correspondence between height and monitoring distance can be a positive correlation. That is, the taller the first monitored object, the greater the monitoring distance; the shorter the first monitored object, the smaller the monitoring distance. If the physical characteristic information includes multiple of height, weight, gender, etc., the monitoring distance can be determined by combining the impact of each piece of information on the first monitored object's mobility through weighted methods. The electronic device delineates a safe zone for the first monitored object based on its physical characteristic information, fully considering the individual characteristics of the monitored object, so that the delineated safe zone better matches the activity needs of the first monitored object.
[0069] It should be understood that, without departing from the teachings of this application, the correspondence between physical characteristic information and monitoring distance can be set as needed, and this application does not impose any restrictions on this.
[0070] As another example, the electronic device acquires distance parameters and determines the monitoring distance accordingly. For instance, the distance parameters can be set by the user guided by the electronic device, or they can be set directly by the manufacturer; this application does not impose any restrictions on this.
[0071] It should be understood that, without departing from the teachings of this application, the monitoring distance can also be set according to other parameters, and this application does not impose any restrictions on this.
[0072] Method 2: Upon receiving a monitoring command, the electronic device displays a vehicle-centric electronic map on its touchscreen. The user can then circle their desired safe area on the touchscreen map. The electronic device acquires the swipe trajectory detected by the touchscreen and determines the safe area based on this trajectory. In this example, the user can independently define various types of safe areas based on factors such as the size of the camping area and the desired activity range of the primary monitoring target, making the defined safe area more tailored to the user's needs.
[0073] Method 3: The vehicle is equipped with a multi-vehicle cooperative mode. The electronic equipment responds to the vehicle being in multi-vehicle cooperative mode by acquiring the effective monitoring area of the vehicle and the cooperative vehicles, and determines the safety zone jointly enclosed by the vehicle and the cooperative vehicles based on their effective monitoring areas. The effective monitoring distance of the vehicle can be determined based on the parameter information of the vehicle's external cameras. The parameter information of the external cameras may include the focal length and installation position of the external cameras.
[0074] In some embodiments of this application, the electronic device can determine a safe zone based on the monitoring level of the first monitored object and the effective monitoring area of each vehicle. For example, the electronic device may have pre-stored safe zone delineation rules for different monitoring levels. The electronic device determines the safe zone delineation rules based on the monitoring level of the first monitored object, and determines the safe zone based on the determined safe zone delineation rules and the effective monitoring area of each vehicle. The monitoring level of the first monitored object can be given by the user or determined by the electronic device based on information such as the age and height of the first monitored object; no limitation is imposed here.
[0075] As an example, the higher the monitoring level, the smaller the safe zone defined by the safe zone delineation rules. For instance, the electronic device has three monitoring levels, with the first level lower than the second, which is lower than the third. The safe zone delineation rules for the first monitoring level are as follows: For each vehicle, determine the monitoring point farthest from the center position within the vehicle's effective monitoring area based on the center positions of multiple vehicles; select the monitoring point farthest from the center position from among the farthest monitoring points of each vehicle; and determine the size of the safe zone based on the distance between the selected monitoring point and the center position. The safe zone delineation rules for the second monitoring level are as follows: For each vehicle, determine the monitoring point farthest from the center position within the vehicle's effective monitoring area based on the center positions of multiple vehicles; select the monitoring point closest to the center position from among the farthest monitoring points of each vehicle; and determine the size of the safe zone based on the distance between the selected monitoring point and the center position. The safe zone delineation rules for the third monitoring level are as follows: Determine the size of the safe zone based on the distance between the center positions of multiple vehicles and the position of the vehicle farthest from the center position.
[0076] For example, Figure 4 This is a schematic diagram showing the relative positions of the effective monitoring area and the safe area of a vehicle according to some embodiments of this application. The effective monitoring area for each vehicle can be area A1 to area A4. Therefore, if the monitoring level is level three, the electronic device defines safe area B1 with the center position of multiple vehicles as the center and the distance between the farthest vehicle and the center position as the radius. If the monitoring level is level two, since the farthest monitoring point of vehicle 10-2 is closest to the center point relative to the farthest monitoring points of other vehicles, the electronic device defines area B2 with the center position of multiple vehicles as the center and the distance between the farthest monitoring distance of vehicle 10-2 and the center position as the radius. If the monitoring level is level one, since the farthest monitoring point of vehicle 10-1 is farthest from the center point relative to the farthest monitoring points of other vehicles, the electronic device defines area B3 with the center position of multiple vehicles as the center and the distance between the farthest monitoring distance of vehicle 10-1 and the center position as the radius.
[0077] It should be understood that other rules for defining security zones may be used without departing from the teachings of this application, and this application does not impose any restrictions on this.
[0078] It is worth mentioning that multiple vehicles can work together, allowing each vehicle to leverage the monitoring capabilities of other cooperating vehicles to increase the monitoring range.
[0079] It should be understood that, Figure 4The effective monitoring area of each vehicle is used as an example for illustration. In other embodiments, the effective monitoring area of each vehicle may be different, and this application does not limit this.
[0080] Alternatively, in response to the vehicle being in a multi-vehicle cooperative mode, the electronic device plans parking areas for the vehicle and the cooperative vehicles based on the parameter information of the vehicle's external camera, the parameter information of the cooperative vehicles' external cameras, and the outline information of the desired safe area, so that the vehicle and the cooperative vehicles together form a closed safe area.
[0081] As an example, when two vehicles are being monitored simultaneously, the electronic equipment calculates the total monitoring area by tangenting or partially overlapping the effective monitoring areas of the two vehicles. Based on the size and outline of the total monitoring area, as well as the outline of the desired safety area, the electronic equipment determines the vehicle's parking position to maximize the overlap between the total monitoring area and the desired safety area.
[0082] As another example, when the number of vehicles being monitored is three or more, the electronic device can extract the outline information of the camping area from the electronic map. Based on factors such as the density of people in the camping area, it can designate unoccupied areas within the camping area as the desired safe zone. Alternatively, the electronic device can determine the desired safe zone based on the trajectory drawn by the user on the electronic map. After determining the desired safe zone, the electronic device acquires its outline information and, based on this outline information, determines a regular shape inscribed within the desired safe zone to simplify the parking area planning process. This regular shape can be a circle or a regular polygon, and the number of sides of the regular polygon can be determined based on the number of cooperating vehicles. For example, if the number of vehicles is N, the regular shape is a regular N-gon. The following examples illustrate how to determine parking areas in conjunction with the types of regular shapes.
[0083] In some implementations, the regular shape is circular. Figure 5 This is a schematic diagram illustrating the relative relationship between the desired safety area, the parking areas for each vehicle, and the actual safety area according to some embodiments of this application. The desired safety area is an irregular area C1, and the regular shape is a circle C2. The parking areas for each vehicle are areas D1 to D3, and the effective monitoring areas for each vehicle are areas A1 to A3. The actual safety area can be located in any area within area F. The process for determining the safety area can be found in [reference needed]. Figure 4Regarding the related explanations, the electronic device can later determine whether the first monitored object has left the safe area based on the actual safe area. For example, the electronic device can define a parking area for a vehicle centered on any point on the circular boundary, and then define parking areas for other vehicles based on the number of vehicles and their effective monitoring areas, so that the centers of all vehicle parking areas are located on the circular boundary, and the distances 'd' between the boundaries of each vehicle's effective monitoring area along the line connecting the centers of the effective monitoring areas are similar or the same. Optionally, if the distance 'd' is greater than a preset distance value, the user can be advised to shrink the desired safe area. Optionally, while advising the user to shrink the desired safe area, the range of the desired safe area can be provided to the user based on the number of vehicles and the parameter information of the external cameras of each vehicle. It should be understood that, without departing from the teachings of this application, when the regular shape is circular, the electronic device can also determine the parking areas of each vehicle in other ways, which are not listed here.
[0084] In other implementations, the regular shape is a regular polygon. The electronic device obtains the side length of the regular N-gon. If the effective monitoring area of each vehicle's exterior camera is circular, and the radius of the smallest effective monitoring area is greater than or equal to half the side length, then the electronic device can use the area centered on the center of each side of the regular N-gon, with the long side length greater than or equal to the long side length of the vehicle, and the short side length greater than or equal to the short side length of the vehicle, as the parking area for each vehicle. If the radius of the smallest effective monitoring area is less than half the side length, the user can be prompted to reduce the monitored safety area, and then a safety area shaped like a regular N-gon with the diameter of the smallest effective monitoring area as its side length is defined. The area centered on the center of each side of the newly defined regular N-gon, with the long side length greater than or equal to the long side length of the vehicle, and the short side length greater than or equal to the short side length of the vehicle, is then used as the parking area for each vehicle.
[0085] For example, Figure 6 This is a schematic diagram showing the relative relationship between the desired safety area, the parking area for each vehicle, and the actual safety area according to some embodiments of this application. Figure 6 Taking three vehicles under joint monitoring as an example, the desired safe area is an irregular area C1, a regular triangle C2, and the parking areas for each vehicle are areas D1 to D3. The effective monitoring areas for each vehicle are areas A1 to A3. The actual safe area can be located in any area within F. The process for determining the safe area can be found in [reference needed]. Figure 4 According to the relevant instructions, electronic devices can later determine whether the first monitored object has left the safe area by combining the actual safe area.
[0086] It's worth noting that by combining the monitoring capabilities of multiple vehicles with the desired size of the safe area, electronic devices can plan parking areas for vehicles. This allows the safe area formed by multiple vehicles to be larger or more closely resemble the shape of a camping area, improving vehicle monitoring efficiency. Furthermore, because the safe area formed by multiple vehicles is closed, blind spots are reduced, resulting in higher security.
[0087] It should be understood that if the desired safety area is a regular shape, such as a circle, the electronic equipment can determine the parking area for each vehicle by combining its shape, the number of vehicles, and the effective monitoring area of each vehicle. For example, if the desired safety area is circular, the parking area can be determined using the same method as in the example above where a regular shape is a circle. Similarly, if the desired safety area is rectangular or other shapes, the inscribed or circumscribed circle of that shape can be determined first, and then the parking area for each vehicle can be determined using the method described in the example above.
[0088] It should be understood that, without departing from the teachings of this application, electronic devices may also define parking areas for each vehicle by combining other information, such as information on whether there are obstructions such as walls in the desired safe area, and this application does not limit this.
[0089] It should be understood that, without departing from the teachings of this application, electronic devices may also plan parking areas for each vehicle through other planning algorithms, and this application does not impose any restrictions on this.
[0090] It should be understood that electronic devices may define secure areas in other ways without departing from the teachings of this application, and this application does not impose any restrictions on this.
[0091] The above provides an exemplary description of how to define a safe zone. The following provides an exemplary description of how an electronic device determines whether the first monitored object has exceeded the safe zone.
[0092] As an example, the characteristic information of the first monitored object includes the location information of the first monitored object. The electronic device determines whether the first monitored object has exceeded the safe zone based on the relative relationship between the location information of the first monitored object and the location information of the safe zone. The location information can be absolute location information relative to the ground, or relative location information relative to vehicles or other reference objects; this application does not limit this. The relative location information can be one-dimensional relative distance information, or two-dimensional relative distance information and relative direction information; this application does not limit this. Taking relative distance information relative to vehicles as an example... Figure 7 This is a schematic diagram showing the relative positions of the first monitored object 20 and the vehicle 10-1 according to some embodiments of this application. For example... Figure 7As shown, the electronic device can determine that the first monitored object 20 has exceeded the safe zone A1 after detecting that the relative distance between the first monitored object 20 and the vehicle 10-1 exceeds the distance defined by the safe zone A1, and trigger an alarm command.
[0093] As another example, the electronic device is equipped with a multi-vehicle cooperative mode for the vehicle. The characteristic information of the first monitored object includes the movement trajectory of the first monitored object. The multi-vehicle cooperative mode refers to the establishment of direct or indirect data connections between multiple vehicles to jointly monitor at least one monitored object. When the vehicle activates the multi-vehicle cooperative mode, the electronic device, in response to the characteristic information of the first monitored object indicating that the first monitored object has exceeded a predefined safe area, triggers an alarm command in ways including, but not limited to, mode one and mode two.
[0094] Method 1: The electronic device, responding to the vehicle being in multi-vehicle cooperative mode and the movement trajectory information of the first monitored object indicating its movement direction as a first direction, determines that the first monitored object has exceeded the safe area and triggers an alarm command. The first direction can be determined based on the relative positional relationship of the safe area. For example, the first direction is the direction away from the center position of the vehicle and the cooperative vehicles. For instance, the electronic device, responding to the vehicle being in multi-vehicle cooperative mode, determines the safe area jointly enclosed by the vehicle and the cooperative vehicles, and determines the first direction based on the positional relationship between the vehicle and the safe area. For example, if the vehicle is located due north of the safe area, the first direction can include due north and directions with an angle less than 90 degrees to due north. It should be understood that the first direction can also be determined based on other information; this is not limited here.
[0095] Figure 8 This is a schematic diagram of the trajectory of the first monitored object 20 according to some embodiments of this application. The effective monitoring area for each vehicle can be area A1 to area A4, the safe area can be area B2, W represents due west, N represents due north, E represents due east, and S represents due south. Figure 8 In the example shown, four vehicles (10-1 to 10-4) are monitored together, and the electronic device is the vehicle-mounted system of vehicle 10-1. Since vehicle 10-1 is located due west of the vehicle, if the movement trajectory T of the first monitored object 20 indicates that the first monitored object moves westward from the effective monitoring area of vehicle 10-1, and the first monitored object disappears from the effective monitoring area of vehicle 10-1, vehicle 10-1 determines that the first monitored object has exceeded the safe area and triggers an alarm command.
[0096] It should be understood that, without departing from the teachings of this application, in order to improve the accuracy of alarms, electronic devices may also set other conditions for triggering alarm commands. For example, when the movement trajectory information of the first monitored object indicates that the movement direction of the first monitored object is a first direction and the first monitored object is about to leave the effective monitoring area of the vehicle, the electronic device may then trigger an alarm command. This application does not limit this.
[0097] Alternatively, the electronic device can combine motion trajectory information and the extent of the safe zone to determine whether to trigger an alarm command. For example, after determining that the motion trajectory information of the first monitored object indicates that the first monitored object is moving away from the vehicle in a second direction from the vehicle towards the cooperating vehicle, the electronic device determines whether to trigger an alarm command based on the relationship between the position of the first monitored object leaving the vehicle's effective monitoring area and the safe zone. For instance, if the position of the first monitored object leaving the vehicle's effective monitoring area is outside the safe zone, an alarm command is triggered; if the position of the first monitored object leaving the vehicle's effective monitoring area is within the safe zone, no alarm command is triggered. The process of defining the safe zone can refer to... Figure 4 The relevant description. Combined with... Figure 4 As can be seen, the scope of the safe zone differs under different monitoring levels, the size of the activity range of the first monitored object varies, and the size of the blind spot within the safe zone also differs. The classification of monitoring levels allows electronic devices to be configured with alarm schemes more suitable for the activity capabilities of different monitored objects or the monitoring needs of users.
[0098] Alternatively, if the electronic device determines that the first monitored object has left the vehicle's effective monitoring area within a safe zone, it can enter a pre-alarm mode. Then, based on whether the first monitored object enters the effective monitoring area of the cooperating vehicle within a preset time, it can determine whether to trigger an alarm command. For example, in pre-alarm mode, if the electronic device determines that the first monitored object has entered the effective monitoring area of the cooperating vehicle, it deactivates the pre-alarm mode; if the electronic device determines that the first monitored object has not entered the effective monitoring area of the cooperating vehicle, it triggers an alarm command.
[0099] It should be understood that, without departing from the teachings of this application, electronic devices may also adopt other processing strategies when it is determined that the first monitored object leaves the effective monitoring area of the vehicle within a safe area, and this application does not limit such actions.
[0100] Method 2: The electronic device responds to the vehicle being in multi-vehicle cooperative mode, and the movement trajectory information of the first monitored object indicating that the first monitored object is moving away from the vehicle in a second direction from the vehicle towards the cooperative vehicle, by sending a first search command to the cooperative vehicle; and responds to the first prompt information fed back by the cooperative vehicle indicating that the first monitored object has not been detected and has exceeded the predefined safety area, triggering an alarm command. When the first monitored object moves towards the cooperative vehicle, the electronic device can call upon the cooperative vehicle to monitor the first monitored object, thus improving monitoring capabilities.
[0101] Alternatively, electronic devices can detect the area around the vehicle using external detection devices (such as external cameras) to obtain monitoring data, including first image data. In response to receiving a second person-finding command from a collaborating vehicle, which includes facial image data of a second monitored object, the electronic device analyzes whether the second monitored object exists in the first image data; and in response to the presence of the second monitored object in the first image data, it sends a second notification message indicating that the second monitored object has been detected to the collaborating vehicle. The electronic device can respond to the person-finding command from the collaborating vehicle, assisting the collaborating vehicle in monitoring the second monitored object, thereby improving the collaborating vehicle's monitoring capabilities.
[0102] by Figure 8 For example, when vehicle 10-1 detects that the first monitored object has left its effective monitoring area A1 in the northeast direction, it sends a first search command to vehicle 10-2. If the first prompt message from vehicle 10-2 indicates that the first monitored object has been detected, no alarm command is triggered. If the first prompt message from vehicle 10-2 indicates that the first monitored object has not been detected, an alarm command is triggered. Vehicle 10-2 can also start monitoring the first monitored object upon receiving the first search command.
[0103] It should be understood that, without departing from the teachings of this application, electronic devices may also determine whether the first monitored object has exceeded the safe area in other ways. This is only an illustrative example and is not intended to limit the scope of this application.
[0104] The above provides an example of how an electronic device determines whether the first monitored object has exceeded the safe zone. The following provides an example of how to execute an alarm command.
[0105] In some implementations, the methods for executing alarm commands include, but are not limited to, method a, method b, and method c.
[0106] Method a: The electronic device obtains the user's saved contact information and notifies the user that the first monitored object has left the safe area. For example, it can call the user via a regular phone or voice call, or notify the user via SMS that the first monitored object has left the safe area.
[0107] Method b: The electronic device controls the external sound device to play a voice message such as "Please note: XXX has left the safe area" to notify the first monitored object to leave the safe area.
[0108] Method c: The electronic device controls an external sound device to play a voice message such as "Please note: XXX has left the safe area," notifying the first monitored object to leave the safe area. If the electronic device does not receive an end-of-alarm command from the user within a first preset time, it retrieves the user's saved contact information and notifies the user that the first monitored object has left the safe area using that information.
[0109] It should be understood that electronic devices can also trigger alarm commands through other means.
[0110] After providing an exemplary description of the process by which an electronic device monitors the activity range of the first monitored object, the following is an exemplary description of the process by which an electronic device monitors the emotions of the first monitored object.
[0111] In some embodiments of this application, the characteristic information of the first monitored object includes the emotional information of the first monitored object, and the control command includes a sound control command. The electronic device triggering the vehicle's control command based on the characteristic information of the first monitored object includes: determining a sound control command based on the emotional information of the first monitored object, the sound control command including an audio signal; and stimulating an external sound-emitting device to emit sound through the audio signal. For example, the monitoring data includes first image data captured by an external camera. The electronic device identifies the first image data, determines the emotional information of the first monitored object, plays corresponding audio based on the emotional information of the first monitored object, and sends the audio signal of the audio to the external sound-emitting device to stimulate the external sound-emitting device to emit sound. For example, if the emotional information of the first monitored object indicates a positive emotion, a cheerful song can be played through the external sound-emitting device.
[0112] Optionally, while playing a song, the electronic device can recognize information such as the song's beat and control the headlights to flash accordingly, in order to match the song's rhythm and emotional changes.
[0113] As an alternative, electronic devices can identify the emotions of the first monitored object in real time, so as to dynamically adjust the type of song played according to the changes in the first monitored object's emotions, so as to make it more in line with the emotions of the first monitored object.
[0114] It should be understood that the methods by which electronic devices identify the emotions of the first monitored object can refer to some other implementation methods, which will not be elaborated here.
[0115] It should be understood that, without departing from the teachings of this application, electronic devices may also monitor other behaviors of the first monitored object, and this application does not impose any restrictions on this.
[0116] It should be understood that, without departing from the teachings of this application, electronic devices may monitor other content in addition to monitoring the behavior of the primary monitored object. Examples of other monitored content are provided below.
[0117] In some embodiments of this application, the electronic device may respond to monitoring data indicating that the vehicle is damaged and provide a second alert so that the user can check the vehicle's status in a timely manner, perform vehicle maintenance, locate the person who damaged the vehicle, etc.
[0118] In other embodiments of this application, the electronic device can respond to monitoring data indicating that the vehicle's surrounding environment meets preset environmental requirements by providing a third prompt message, or control a detection device located outside the vehicle to automatically capture second image data. For example, the electronic device acquires information about the vehicle's surrounding environment based on monitoring data, such as scenery information. The preset environmental requirement could be, for example, the presence of a specific scene, such as a sunset. If the scenery information indicates that a specific scene, such as a sunset, exists within the field of view of the vehicle's external camera, the electronic device can provide a third prompt message to the user, allowing the user to promptly notice the sunset and choose whether to take a photo. The electronic device can also automatically capture second image data including the sunset scene using an external detection device (such as an external camera). By monitoring the scenery around the vehicle through the vehicle's detection device, the electronic device can reduce the chances of users missing scenic views they wish to capture, making vehicle services more intelligent and user-friendly.
[0119] In some embodiments of this application, the monitoring data includes first image data captured by a detection device (e.g., an exterior camera) located outside the vehicle. The electronic device can respond to the first image data indicating the start of camping by controlling the detection device located outside the vehicle to record third image data according to preset shooting rules. For example, the electronic device can determine whether camping has started based on the presence of a specified item in the first image data. For example, the specified item could be a tent, carpet, food, etc. After determining that the specified item exists in the first image data, the electronic device can automatically take a commemorative photo of the user's camping trip, making the vehicle service more intelligent and user-friendly.
[0120] It should be understood that, without departing from the teachings of this application, electronic devices may provide users with more functions in camping mode, which are not listed here, and this application does not limit them.
[0121] For ease of understanding, the following example, using a camping scenario, illustrates some interaction processes between the user and the vehicle during the implementation of the vehicle control method mentioned in the embodiments of this application.
[0122] For example, multiple external cameras can be installed on the exterior of the vehicle to collect 360-degree image information around the vehicle, thereby performing target tracking, measuring target distance, etc. The vehicle first determines whether the user has purchased some functions of the vehicle control method mentioned in the embodiments of this application. If it is determined that the user has purchased the selected functions, the subsequent steps can be executed. If it is determined that the user has not purchased the selected functions, the user can be prompted to purchase them. After determining that the user has purchased the relevant functions, the vehicle can determine whether the user has entered the identification information of the first monitored object. If it is determined that the user has not yet entered the identification information of the first monitored object, the user can be prompted to enter it. If it is determined that the user has entered the identification information of the first monitored object, the identification information of the first monitored object can be displayed so that the user can confirm whether the current monitoring target is the first monitored object. If it is determined that it is not, the user is prompted to enter it. When the vehicle is parked in a camping area, the vehicle can switch the vehicle's operating mode to camping mode through a touch screen or voice. In camping mode, the external cameras continue to collect images to obtain the first image data, and the vehicle switches the image data analysis to the image analysis logic of camping mode, and can select to adjust the volume of the external sound device to a specified volume. Under the image analysis logic of camping mode, the image analysis module system mainly includes emotion and behavior recognition of the primary monitored object, vehicle safety monitoring, and surrounding environment monitoring. Optionally, users can select the functions needed in camping mode according to the actual scenario, such as the activity range monitoring function, emotion monitoring function, and vehicle safety monitoring function mentioned above, and set the required parameters for each function, such as distance parameters. For example, if the primary monitored object is a child and the distance parameter is 10 meters, the vehicle will use 10 meters as the monitoring distance. Optionally, through in-vehicle communication technology, the vehicle's infotainment system can synchronize the above data to the image analysis system and activate the activity range monitoring function (i.e., target tracking and safe distance measurement). After the external camera collects image data, it transmits the image data to the image analysis system. The image analysis system intelligently analyzes the objects and their characteristics in the image data, such as people's actions (e.g., walking), scenery, and scenery type (e.g., sunset). The image analysis system synchronizes the analysis results to the vehicle's infotainment system through in-vehicle communication technology, and the vehicle system processes different logic based on the analysis results. For example, if a user activates the emotion monitoring function, the image analysis system, after identifying the emotion information of the first monitored object, will send this information to the vehicle's infotainment system via in-vehicle communication technology. The infotainment system can then play corresponding songs based on the emotion information; for example, if the emotion is positive, upbeat songs can be played through the external sound system. Similarly, if a user activates the activity range monitoring function, the image analysis system, after identifying that the first monitored object has exceeded the safe area, will send an alarm notification to the vehicle's infotainment system via in-vehicle communication technology, triggering an alarm command.
[0123] As can be seen from the above, in the embodiments of this application, by using camera recognition technology (or image recognition technology) and linking with the vehicle system, it is possible to realize functions such as security monitoring of the monitored object, emotional comfort, vehicle security monitoring, and taking photos for the user in situations such as camping, providing users with more intelligent external scenarios.
[0124] The steps of the various methods described above are only for clarity. In practice, they can be combined into one step or some steps can be split into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but without changing the core design of the algorithm and process, are also within the scope of protection of this patent.
[0125] One embodiment of this application also provides an electronic device, which includes at least one processor and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the above-described vehicle control method.
[0126] One embodiment of this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements a vehicle control method.
[0127] Figure 9 A schematic block diagram of an example electronic device 300 that can be used to implement embodiments of this application is shown. The electronic device is intended to represent various forms of digital computers, such as in-vehicle systems, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the application described and / or claimed herein.
[0128] like Figure 9As shown, the electronic device 300 includes a computing unit 301, which can perform various appropriate actions and processes based on a computer program stored in a read-only memory (ROM) 302 or a computer program loaded from a storage unit 308 into a random access memory (RAM) 303. The RAM 303 may also store various programs and data required for the operation of the electronic device 300. The computing unit 301, ROM 302, and RAM 303 are interconnected via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.
[0129] Multiple components in electronic device 300 are connected to I / O interface 305, including: input unit 306, such as keyboard, mouse, etc.; output unit 307, such as various types of displays, speakers, etc.; storage unit 308, such as disk, optical disk, etc.; and communication unit 309, such as network card, modem, wireless transceiver, etc. Communication unit 309 allows electronic device 300 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.
[0130] The computing unit 301 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 301 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 301 performs the various methods and processes described above, such as vehicle control methods. For example, in some embodiments, the vehicle control method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 308. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 300 via ROM 302 and / or communication unit 309. When the computer program is loaded into RAM 303 and executed by the computing unit 301, one or more steps of the vehicle control method described above may be performed. Alternatively, in other embodiments, the computing unit 301 may be configured to perform the vehicle control method by any other suitable means (e.g., by means of firmware).
[0131] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transferring data and instructions to the storage system, the at least one input device, and the at least one output device.
[0132] The program code used to implement the methods of this application may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that when executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0133] In the context of this application, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0134] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user, such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0135] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.
[0136] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other.
[0137] The above description is merely an illustration of the embodiments of this application and the technical principles employed. Those skilled in the art should understand that the scope of protection involved in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the technical concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this application.
Claims
1. A vehicle control method, characterized in that, include: In response to the vehicle activating camping mode, the area around the vehicle is detected to obtain monitoring data. In response to the monitoring data indicating the presence of a first monitored object around the vehicle, the characteristic information of the first monitored object is determined based on the monitoring data. as well as The vehicle control command is triggered based on the characteristic information of the first monitored object; The feature information includes the location information of the first monitored object or the movement trajectory information of the first monitored object, and the control command includes an alarm command; The step of triggering the vehicle control command based on the feature information of the first monitored object includes: In response to the location information or the motion trajectory information indicating that the first monitored object has exceeded the predefined safe area, the alarm command is triggered. The alarm command triggered in response to the feature information of the first monitored object indicating that the first monitored object has exceeded the predefined safe area includes: In response to the vehicle being in multi-vehicle cooperative mode, and the movement trajectory information of the first monitored object indicating that the first monitored object is moving away from the vehicle along a second direction from the vehicle to the cooperative vehicle, a first person-finding command is sent to the cooperative vehicle; and In response to the first prompt message from the cooperative vehicle indicating that the first monitored object was not detected, it is determined that the first monitored object is outside the predefined safe area, and the alarm command is triggered.
2. The method according to claim 1, wherein, The method further includes: Obtain the monitoring distance; and The security zone is defined based on the monitoring distance.
3. The method according to claim 2, wherein, The monitoring distance is determined based on the age of the first monitored object, the physical characteristics of the first monitored object, or the distance parameters obtained.
4. The method according to claim 1, wherein, The method further includes: In response to receiving a monitoring command, an electronic map centered on the vehicle is displayed on the touchscreen; and The sliding trajectory detected by the touch screen is obtained, and the safe area is determined based on the sliding trajectory.
5. The method according to claim 1, wherein, The alarm command triggered in response to the feature information of the first monitored object indicating that the first monitored object has exceeded the predefined safe area includes: In response to the vehicle being in multi-vehicle cooperative mode, and the movement trajectory information of the first monitored object indicating that the first monitored object is moving away from the vehicle along a first direction, it is determined that the first monitored object has exceeded the safe area, and the alarm command is triggered; wherein, the first direction is the direction away from the center position of the vehicle and the cooperative vehicle.
6. The method according to claim 5, wherein, The method further includes: In response to the motion trajectory information of the first monitored object instructing the first monitored object to move away from the vehicle along a second direction from the vehicle to the cooperating vehicle, the system determines whether to trigger the alarm command based on the relationship between the position of the first monitored object leaving the effective monitoring area of the vehicle and the safe area.
7. The method according to claim 5, wherein, The method further includes: In response to the vehicle being in the multi-vehicle cooperative mode, the safe area jointly enclosed by the vehicle and the cooperative vehicles is determined; and The first direction is determined based on the positional relationship between the vehicle and the safe area.
8. The method according to claim 7, wherein, The determination of the safe area jointly enclosed by the vehicle and the cooperating vehicle includes: The safe zone is determined based on the effective monitoring area of the vehicle, the effective monitoring area of the cooperating vehicle, and the monitoring level of the first monitored object.
9. The method according to claim 5, wherein, The method further includes: In response to the vehicle being in the multi-vehicle cooperative mode, parking areas are planned for the vehicle and the cooperative vehicles based on the parameter information of the vehicle's exterior camera, the parameter information of the cooperative vehicles' exterior cameras, and the outline information of the desired safe area, so that the vehicle and the cooperative vehicles together form a closed safe area.
10. The method according to claim 1, wherein, The process of detecting the area around the vehicle to obtain monitoring data includes: Monitoring data is obtained by detecting the area around the vehicle using a detection device installed outside the vehicle. The monitoring data includes first image data. The method further includes: In response to receiving a second person-finding instruction from a cooperating vehicle, which includes facial image data of a second monitored object, analyze whether the second monitored object exists in the first image data; and In response to the presence of the second monitored object in the first image data, a second prompt message indicating that the second monitored object has been detected is sent to the cooperative vehicle.
11. The method according to claim 1, wherein, The feature information includes the emotional information of the first monitored object, and the control command includes a vocal control command. The step of triggering the vehicle control command based on the feature information of the first monitored object includes: Based on the emotional information of the first monitored object, the voice control command is determined, the voice control command including an audio signal; and The audio signal excites the external sound-emitting device to produce sound.
12. The method according to claim 1, wherein, The method further includes: In response to the monitoring data indicating that the vehicle is damaged, a second alert message is sent.
13. The method according to claim 1, wherein, The method further includes: In response to the monitoring data indicating that the environment around the vehicle meets preset environmental requirements, a third prompt message is provided, or the detection device set outside the vehicle is controlled to automatically capture second image data.
14. The method according to claim 1, wherein, The monitoring data includes first image data captured by a detection device located outside the vehicle, and the method further includes: In response to the first image data indicating the start of camping, the detection device located outside the vehicle is controlled to record third image data according to a preset shooting rule.
15. An electronic device, characterized in that, include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the vehicle control method as described in any one of claims 1 to 14.
16. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the vehicle control method as described in any one of claims 1 to 14.
Citation Information
Patent Citations
In-vehicle child safety warning method and device, electronic equipment and storage medium
CN114475507A