Control method, system and equipment for external interaction and mutual screen, medium and vehicle

Abstract

The invention provides a control method, system and device for external interaction, a medium and a vehicle. The control method comprises the steps that one or more of in-vehicle gestures, in-vehicle voice, central control screen data and terminal data are acquired; according to the in-vehicle gesture, the in-vehicle voice, the central control screen data and the terminal data, the control type is judged, wherein the control type comprises active control and automatic control; if the control is active control, generating display content according to the input content, and displaying the display content on an external interaction screen; and if the control is automatic control, comparing with a preset database, generating corresponding display content according to the corresponding scene data, and displaying the corresponding display content on the external interaction screen. And if the driver wants to control in the vehicle driving process, the driver can control through gestures or voice, so that the driver is not distracted. Other passengers in the vehicle can control the central control screen through one of gestures, voices, the central control screen and the terminal, so that the control modes of the external interaction screen are diversified.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a control method, system, device, medium and vehicle for an external interactive screen. Background Art

[0002] With the continuous development of automobile technology, the field of automobile interactive control technology is also gradually improving. In order to increase the functionality of the car, an external interactive device is installed on the vehicle, and the external interactive device is controlled through a hollow screen. The existing control is manually controlled through the central control screen, which is inconvenient to control during driving and has safety hazards in movement. Summary of the invention

[0003] In view of the shortcomings of the prior art described above, an object of the present invention is to provide a control method, system, device, medium and vehicle for an external interactive screen, so as to solve the problem in the prior art that the control of the external interactive screen needs to be manually operated through the central control screen, resulting in inconvenient control in the driving map.

[0004] To achieve the above objectives and other related objectives, on the one hand, the present invention provides a control method for an external interactive screen, comprising:

[0005] Obtain one or more of in-vehicle gestures, in-vehicle voice, central control screen data, and terminal data;

[0006] Determine the control type based on in-vehicle gestures, in-vehicle voice, central control screen data and terminal data, the control type includes active control and automatic control;

[0007] If it is active control, the display content is generated based on the in-car gestures, in-car voice, central control screen data and terminal data input, and displayed on the external interactive screen;

[0008] If it is automatic control, the scene data is determined based on the in-car gestures, in-car voice, central control screen data and terminal data, and the corresponding display content is generated and displayed on the external interactive screen.

[0009] Furthermore, before the step determines the control type based on the in-vehicle gestures, in-vehicle voice, central control screen data and terminal data, it is necessary to determine whether the vehicle has no faults. If there is a fault, the external interactive screen will not display any content.

[0010] Furthermore, if the step is active control, after the display content is generated according to the in-vehicle gestures, in-vehicle voice, central control screen data and terminal data input, the actively input text is judged whether it complies with the regulations.

[0011] Furthermore, before determining the control type, the process also includes acquiring temperature data and date data, comparing the date data with information stored in a database, and determining the date information of the day.

[0012] Furthermore, the vehicle computer data and the external vehicle image data are obtained. When the vehicle is driving, the external vehicle scene obtained by the vehicle computer data and the external vehicle image data is compared with the preset scene. If it meets the preset scene, a message pops up to select whether to output the corresponding preset scene content.

[0013] Furthermore, it also includes sending the actively controlled or automatically controlled display content to the gateway for parsing, and then the gateway displays the parsed data on the external interactive screen.

[0014] On the other hand, the present application also provides a control system for an external interactive screen, comprising:

[0015] The acquisition module is used to acquire vehicle computer data, external vehicle images, internal vehicle gestures, external vehicle voice data, central control screen data, and terminal data;

[0016] A scene determination module, used to compare the in-vehicle gesture, in-vehicle voice, central control screen data and terminal data with a database to determine whether the vehicle is in a scene in the database, wherein the database includes multiple scene data;

[0017] A judgment module is used to judge the control type based on in-car gestures, in-car voice, central control screen data and terminal data;

[0018] The storage module is used to store the database.

[0019] On the other hand, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the above-mentioned control method for the external interactive screen when executed by the processor.

[0020] On the other hand, the present application also provides a computer-readable storage medium, which has a computer program. When the computer program is executed by a processor, the steps of the control method for the external interactive screen described above are implemented.

[0021] On the other hand, the present application also provides a vehicle, comprising an external vehicle interaction module, and the external vehicle interaction module is used to implement the above-mentioned control method for the external interaction screen.

[0022] As described above, the control method provided by the present invention has the following beneficial effects: by obtaining one or more of the in-car gestures, in-car voices, central control screen data and terminal data, the control type is first determined. If the driver wants to control the vehicle during driving, he can control it through gestures or voice, thereby avoiding distraction of the driver. Other passengers in the car can also control the central control screen through gestures, voices, central control screens and terminals, thus diversifying the control methods of the external interactive screen. By controlling the external interactive screen, information interaction between the inside and outside of the car is realized, giving the vehicle active expression attributes, making the vehicle more intelligent, and further enhancing the interactive experience between the driver and the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 Shown is a flow chart of a control method for an external interactive screen provided by the present invention;

[0024] Figure 2 It is a schematic diagram of the process of active control;

[0025] Figure 3 Schematic diagram of the automatic control process. DETAILED DESCRIPTION

[0026] The following describes the embodiments of the present invention through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention.

[0027] See also Figures 1 to 3 The present invention provides a control method for an external interactive screen, comprising:

[0028] Obtain one or more of in-vehicle gestures, in-vehicle voice, central control screen data, and terminal data.

[0029] The status of the driver or passengers in the car can be obtained through gestures and voice in the car. The terminal is connected to the central control screen. The connection method can be wired or wireless. The wireless can be through Bluetooth, WIFI, etc. The terminal can be a mobile phone, tablet or other. When the vehicle is at zero speed, the driver can control the external interactive screen through gestures, voice, central control screen and terminal, or a combination. If the vehicle is in motion, in order to avoid distraction, the driver can control input through gestures and / or voice.

[0030] The control type is determined based on in-vehicle gestures, in-vehicle voice, central control screen data and terminal data, and the control type includes active control and automatic control.

[0031] If it is active control, the display content is generated based on the in-car gestures, in-car voice, central control screen data and terminal data input, and displayed on the external interactive screen.

[0032] When it is detected that the user has clearly expressed a certain intention or demand through gestures, voice, direct touch on the central control screen or other terminals, it is considered to have entered the active control state. In this mode, the system allows users to freely input text information, select pictures or other multimedia elements from the preset database, and customize the content finally presented on the external interactive screen according to personal preferences. This method provides users with a highly flexible personalized expression platform.

[0033] If it is automatic control, the in-car gestures, in-car voice, central control screen data and terminal data are compared with the preset database to determine the scene data, and the corresponding display content is generated according to the corresponding scene data and displayed on the external interactive screen. After receiving the automatic control command, the in-car gestures, in-car voice, central control screen data and terminal data are matched with the preset database. Once the scene setting that best fits the current situation is found, the corresponding content will be generated and automatically displayed on the external interactive screen. This not only simplifies the user's operation process, but also ensures a good user experience even without special intervention.

[0034] In the design of the interactive system of smart cars, ensuring the safety and reliability of the vehicle is the top priority. Therefore, before judging the control type based on in-car gestures, in-car voice, central control screen operation and data from the on-board terminal, an important inspection step must be performed first - confirming whether the vehicle currently has any faults.

[0035] Whenever the interactive system is started or a periodic health check is performed, the system automatically runs a series of diagnostic procedures to detect the status of key vehicle components, such as engine performance, braking system, etc. If any abnormality is found, the system will immediately record it and mark it as a potential fault.

[0036] Among them, the battery power is before the detection of system failure. For electric vehicles, especially the power level, although the driver can see the battery status of the vehicle after the vehicle is started, it is inevitable to be careless. In this embodiment, before the driver gets on the vehicle, as long as the vehicle is unlocked, the battery status of the vehicle can be intuitively seen through the external interactive screen. During the charging process, unlocking and activation can display the charging percentage. For example, when unlocked in a non-charging state, the corresponding graphic animation plus text reminder is displayed according to the power level. Different colors have different power levels: low power is displayed in red, medium power is displayed in yellow, and sufficient power is displayed in green. The external interactive screen is not displayed when the vehicle is locked. When the vehicle is unlocked, the power information can be directly displayed on the external interactive screen.

[0037] Whether it is active control or automatic control, before judging the control type based on in-car gestures, in-car voice, central control screen data and terminal data, it is necessary to determine whether the vehicle has no faults. If there is a fault, the external interactive screen will not display the content. The battery power should be checked before detecting the fault.

[0038] Active control includes inputting text, selecting pictures in the database, and selecting display information, including weather, date, etc. After the text is input manually or by voice, it is judged to see if it contains any content that does not comply with regulations, such as whether it contains sensitive words or sentences that violate public order and good morals. If the input content is not standardized, it will be highlighted and needs to be re-entered and adjusted.

[0039] When acquiring data, it also includes connecting to the Internet through a temperature sensor or a hollow screen to obtain weather information and date information, etc. Date information, such as birthdays or other special dates, can also be stored in the database and displayed on the external interactive screen.

[0040] For example, if birthday information or holiday information is stored in the database, then on that day, "Happy Birthday" or "Happy Holidays" may be displayed on the external interactive screen.

[0041] Automatic control can be selected before use, and the database stores a variety of scene data. For example, when the temperature detected by the temperature sensor is lower than the set value, the external interactive screen can display "It's cold, please dress warmly." For example, when the temperature detected by the temperature sensor is higher than the set value, the external interactive screen can display "It's hot, please prevent heatstroke."

[0042] Obtain vehicle computer data and external image data. When the vehicle is driving, the external scene obtained by the vehicle computer data and external image data is compared with the preset scene. If it meets the preset scene, a message pops up to choose whether to output the corresponding preset scene content.

[0043] For example, light sensors are also installed on the outside of the vehicle. Whether it is active control or automatic control, during driving, the light sensors on the outside of the vehicle can judge the situation of turning off the high beam, especially the high beam emitted by vehicles in the opposite lane. If high beam information is detected, the external interactive screen can display "Please turn off the high beam" or output animation to remind other vehicles to turn off the high beam.

[0044] Laser radar can also be installed outside the car. When it runs to an intersection or zebra crossing, the laser radar can obtain the situation outside the car and determine whether there are pedestrians crossing the street. When a pedestrian is detected, a message pops up, and the people in the car can interact with the pedestrian crossing scene through voice or manual input. At this time, the external interactive screen can display the information of pedestrians crossing the road. The information of pedestrians crossing the road can be text, or it can be a picture of a zebra crossing plus moving pedestrians and text. By controlling the external interactive screen, information interaction between the inside and outside of the car is realized, giving the vehicle active expression attributes, the vehicle is further intelligent, and the interactive experience between the driver and the vehicle is further improved.

[0045] After the display content of active control or automatic control is generated, it needs to be sent to the gateway for parsing, and then the gateway displays the parsed data on the external interactive screen.

[0046] The VCU controller sends the vehicle information to the gateway, laser radar, and image module. The voice module is connected to the gateway through the CAN center line. The external interactive screen is also connected to the light pipe through the CAN bus. The battery pack, central control screen, terminal, pipeline sensor, and temperature sensor are also connected to the gateway. All data is analyzed at the gateway and then displayed on the external interactive screen. The VCU controller collects information such as the speed and acceleration of the vehicle.

[0047] This application uses manual operation, voice control, and gesture control of the central control screen, and is also equipped with mobile phone remote control. It allows customers to use the interactive screen function safely and efficiently in various scenarios; for example: DIY expression of mood or language by operating the central control screen in the parking state; change the content of the interactive screen outside the car through voice control and gesture control during the operation of the car; you can also give family or friends some different romance and surprises through mobile phone remote control when you are at home or away from the car. The operation is safer and more diverse. This application provides you with a better car experience through the cooperation of various controllers, lidars, light sensors, temperature sensors, etc.; for example: when driving at night, if the opposite lane keeps turning on the high beam and affects safe driving, the light sensor captures it and automatically reminds the other party through the interactive screen and the overtaking lights. It can read weather forecast information and, based on the current outside temperature, remind you through the interactive screen to put on more clothes, keep warm, or prepare an umbrella if it is about to rain, and not to park in low-lying areas. When pedestrians pass by, the interactive screen will automatically display text and scrolling images of pedestrians passing first by judging the brake signal, making communication between the two smoother and driving safer. By reading calendar information, the interactive screen will display text animations such as Happy Holidays and Happy Birthday when you use the car, giving you a good mood all day. It can judge the battery power information, remind customers whether they need to charge when the key is unlocked, plan the itinerary reasonably, and display the charging status when charging, which is more practical and gives customers a better car experience.

[0048] On the other hand, the present application also provides a control system for an external interactive screen, comprising:

[0049] The acquisition module is used to acquire vehicle data, external images, gestures inside the vehicle, voice data outside the vehicle, central control screen data, and terminal data. It also acquires vehicle data, temperature data, date data, and collects pedestrian data externally through the image module.

[0050] The scene determination module is used to compare the in-car gestures, in-car voice, central control screen data and terminal data with the database to determine whether the vehicle is in a scene in the database, and the database includes multiple scene data. First, determine whether it is active control or automatic control. If it is automatic control, then continue to determine the output scene mode.

[0051] The judgment module is used to judge the control type based on the in-car gestures, in-car voice, central control screen data and terminal data. It also needs to judge whether the date stored in the database is a special date, as well as weather, pedestrian and high beam information.

[0052] The storage module is used to store a database, in which a plurality of scene data are stored.

[0053] On the other hand, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the above-mentioned control method for the external interactive screen when executed by the processor.

[0054] On the other hand, the present application also provides a computer-readable storage medium, which has a computer program. When the computer program is executed by a processor, the steps of the control method for the external interactive screen described above are implemented.

[0055] On the other hand, the present application also provides a vehicle, comprising an external vehicle interaction module, and the external vehicle interaction module is used to implement the above-mentioned control method for the external interaction screen.

[0056] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0057] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0058] The units involved in the embodiments of the present invention may be implemented by software or hardware, and the units described may also be arranged in a processor. The names of these units do not, in some cases, limit the units themselves. The units or modules described may also be arranged in a processor, for example, may be described as: a processor includes a data acquisition module, a first processing module, a second processing module, and a result generation module. The names of these units or modules do not, in some cases, limit the units or modules themselves.

[0059] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the present application.

Claims

1. A control method for an external interactive screen, characterized in that: include: Obtain one or more of in-vehicle gestures, in-vehicle voice, central control screen data, and terminal data; Determine the control type based on in-vehicle gestures, in-vehicle voice, central control screen data and terminal data, the control type includes active control and automatic control; If it is active control, the display content is generated based on the in-car gestures, in-car voice, central control screen data and terminal data input, and displayed on the external interactive screen; If it is automatic control, the scene data is determined based on the in-car gestures, in-car voice, central control screen data and terminal data, and the corresponding display content is generated and displayed on the external interactive screen.

2. The control method for an external interactive screen according to claim 1, characterized in that: Before the step determines the control type based on the in-vehicle gestures, in-vehicle voice, central control screen data and terminal data, it is necessary to determine whether the vehicle has no faults. If there is a fault, the external interactive screen will not display any content.

3. The control method for an external interactive screen according to claim 1, characterized in that: If the step is active control, after generating the display content according to the in-vehicle gestures, in-vehicle voice, central control screen data and terminal data input, the actively input text is judged whether it complies with the regulations.

4. The control method for an external interactive screen according to claim 1, characterized in that: The step also includes obtaining temperature data and date data before determining the control type based on in-vehicle gestures, in-vehicle voices, central control screen data and terminal data, comparing the date data with the information stored in the database, and determining the date information of the day.

5. The control method for an external interactive screen according to any one of claims 1 to 4, characterized in that: It also includes obtaining vehicle computer data and external vehicle image data. When the vehicle is driving, the external vehicle scene obtained by the vehicle computer data and external vehicle image data is compared with the preset scene. If it meets the preset scene, a message pops up to select whether to output the corresponding preset scene content.

6. The control method for an external interactive screen according to claim 1, characterized in that: It also includes sending the display content of active control or automatic control to the gateway for parsing, and then the gateway displays the parsed data on the external interactive screen.

7. A control system for an external interactive screen, characterized in that: include: The acquisition module is used to acquire vehicle computer data, external vehicle images, internal vehicle gestures, external vehicle voice data, central control screen data, and terminal data; A scene determination module, used to compare the in-vehicle gesture, in-vehicle voice, central control screen data and terminal data with a database to determine whether the vehicle is in a scene in the database, wherein the database includes multiple scene data; A judgment module is used to judge the control type based on in-car gestures, in-car voice, central control screen data and terminal data; The storage module is used to store the database.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the computer program is executed by the processor, the control method for the external interactive screen as described in any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium, the computer-readable storage medium having a computer program, characterized in that: When the computer program is executed by a processor, the steps of the control method for an external interactive screen as described in any one of claims 1 to 6 are implemented.

10. A vehicle, characterized in that: The vehicle includes an external vehicle interaction module, and the external vehicle interaction module is used to implement the control method for the external interaction screen as described in any one of claims 1 to 6.

Images