State prompting method and device, vehicle auxiliary equipment and storage medium

Abstract

The invention discloses a state prompting method, device and equipment and a storage medium, and relates to the technical field of vehicles, the state prompting method is applied to vehicle auxiliary equipment, and the equipment comprises a loudspeaker and a head-mounted display screen. The method comprises the following steps: when a current equipment state is that normal communication connection is established with a vehicle and a motion state signal of the vehicle is a preset state signal, generating a voice prompt signal according to the motion state signal, and broadcasting the voice prompt signal through a loudspeaker; and when the mode selection information is received, generating a state prompt picture, and pushing the state prompt picture through the head-mounted display screen. By means of the mode, the motion state of the vehicle is prompted through the vehicle auxiliary equipment, so that a passenger can adjust the body state in time according to the motion state of the vehicle, the situation that the passenger feels uncomfortable due to the fact that the body state of the passenger is not adjusted in time due to sharp changes of the acceleration of the vehicle is avoided, and the riding experience feeling of a user is improved.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to status indication methods, devices, vehicle auxiliary equipment, and storage media. Background Technology

[0002] With the rapid development of new energy vehicles, more and more vehicles are entering households. When driving in congested traffic, vehicles frequently encounter sudden braking or acceleration. This can lead to a poor riding experience for passengers, especially those in the rear seats, causing discomfort and even motion sickness. The main reason for this is that in congested traffic, rear passengers cannot see the road conditions through the windshield during sudden braking or acceleration, and their bodies cannot adjust accordingly. This mismatch between their physical state and the system activity caused by the sudden braking or acceleration results in fatigue and a poor riding experience.

[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The main purpose of this application is to provide a status prompting method, device, vehicle auxiliary equipment, and storage medium, aiming to solve the technical problem in the prior art where the user's physical state is inconsistent with the vehicle's movement state, resulting in physical discomfort and a poor user riding experience.

[0005] To achieve the above objectives, this application proposes a status indication method, which is applied to a vehicle auxiliary device, the vehicle auxiliary device including: a speaker and a head-mounted display screen, the status indication method including:

[0006] When the current device status is that a normal communication connection has been established with the vehicle and the vehicle's motion status signal is a preset status signal, a voice prompt signal is generated based on the motion status signal and the voice prompt signal is broadcast through the speaker.

[0007] Upon receiving mode selection information from the user, a status prompt screen is generated based on the mode selection information, and the status prompt screen is pushed through the head-mounted display screen.

[0008] In one embodiment, the vehicle assistance device further includes a pressure sensor;

[0009] Before the step of generating a voice prompt signal based on the motion state signal when the current device state is a normal communication connection established with the vehicle and the vehicle's motion state signal is a preset state signal, the method further includes:

[0010] When a short circuit is detected in the device connection, the current clamping force is determined based on the pressure data collected by the pressure sensor.

[0011] The current wearing status is determined based on the current clamping force;

[0012] When the current wearing state is normal wearing state, the current device state is determined to be a normal communication connection established with the vehicle, and the vehicle's motion status signal is acquired.

[0013] In one embodiment, the step of generating a voice prompt signal based on the motion state signal includes:

[0014] When the motion state signal is a first state signal, the state voice information corresponding to the first state signal is searched in the voice state mapping relationship;

[0015] Based on the state voice information, voice is generated to obtain the voice prompt signal corresponding to the first state signal.

[0016] In one embodiment, the step of generating a status prompt screen based on the mode selection information and pushing the status prompt screen through the head-mounted display screen includes:

[0017] The screen prompt mode is determined based on the mode selection information;

[0018] When the screen prompt mode is the first screen mode, the real-time screen information of the vehicle's screen acquisition device is acquired;

[0019] A status prompt screen is generated based on the real-time video information, and the status prompt screen is pushed through the head-mounted display screen.

[0020] In one embodiment, after the step of determining the screen prompt mode based on the mode selection information, the method further includes:

[0021] When the screen prompt mode is the second screen mode, the vehicle's current speed and surrounding obstacle information are obtained;

[0022] The congestion level around the vehicle is determined based on the surrounding obstacle information;

[0023] Find the state simulation screen corresponding to the surrounding congestion level and the current driving speed in the state screen mapping relationship;

[0024] A status prompt screen is generated based on the simulated status screen, and the status prompt screen is pushed through the head-mounted display screen.

[0025] In one embodiment, the vehicle assistance device further includes an audio acquisition component;

[0026] After the step of broadcasting the voice prompt signal through the speaker, the method further includes:

[0027] When audio information collected by the audio acquisition component is received within a preset duration, the audio information is analyzed to determine the current audio semantics;

[0028] When the current audio semantics is mode selection semantics, it is determined that the mode selection information fed back by the user has been received.

[0029] In one embodiment, the vehicle assistance device further includes a vision sensor and a massage component;

[0030] After the step of generating a status prompt screen based on the mode selection information and pushing the status prompt screen through the head-mounted display screen, the method further includes:

[0031] The user's eye condition is determined based on the user's eye data collected by the visual sensor;

[0032] When the eyes are in a closed state, the control status prompt function is turned off, and massage is performed through the massage component.

[0033] In addition, to achieve the above objectives, this application also proposes a status prompting device, which includes: a generation module, used to generate a voice prompting signal based on the motion state signal when the current device status is a normal communication connection established with the vehicle and the motion state signal of the vehicle is a preset status signal, and to broadcast the voice prompting signal through the speaker;

[0034] The generation module is also used to generate a status prompt screen based on the mode selection information received from the user, and push the status prompt screen through the head-mounted display screen.

[0035] In addition, to achieve the above objectives, this application also proposes a vehicle assistance device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the status indication method as described above.

[0036] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and which, when executed by a processor, implements the steps of the status indication method described above.

[0037] This application provides a status prompting method, which is applied to a vehicle auxiliary device. The method includes: when the current device status is a normal communication connection established with the vehicle and the vehicle's motion status signal is a preset status signal, generating a voice prompt signal based on the motion status signal and broadcasting the voice prompt signal through a speaker; and when receiving mode selection information from the user, generating a status prompt screen based on the mode selection information and pushing the status prompt screen through a head-mounted display screen. By using the above method to provide vehicle motion status prompts through the vehicle auxiliary device, passengers can promptly adjust their physical state according to the vehicle's motion status, avoiding discomfort caused by failure to adjust their physical state in time due to rapid changes in vehicle acceleration, thus improving the user's riding experience. Attached Figure Description

[0038] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0039] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 This is a flowchart illustrating the status indication method of this application in Embodiment 1;

[0041] Figure 2 This is a schematic diagram of the structure of the vehicle auxiliary equipment provided in Embodiment 1 of this application;

[0042] Figure 3 This is a flowchart illustrating the second embodiment of the status indication method for this application.

[0043] Figure 4 This is a flowchart illustrating the status indication method of this application in Embodiment 3;

[0044] Figure 5 This is a schematic diagram of the module structure of the status indication device according to an embodiment of this application;

[0045] Figure 6 This is a schematic diagram of the device structure of the hardware operating environment involved in the status prompting method in the embodiments of this application.

[0046] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0047] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0048] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0049] The main solution of this application embodiment is: when the current device is in a normal communication connection with the vehicle and the vehicle's motion status signal is a preset status signal, a voice prompt signal is generated based on the motion status signal, and the voice prompt signal is broadcast through the speaker; when the user feedback mode selection information is received, a status prompt screen is generated based on the mode selection information, and the status prompt screen is pushed through the head-mounted display screen.

[0050] With the rapid development of new energy vehicles, more and more vehicles are entering households. When driving in congested traffic, vehicles frequently encounter sudden braking or acceleration. This sudden braking or acceleration can lead to a poor riding experience for passengers, especially those in the rear seats, causing discomfort and even motion sickness. The main reason for this is that during sudden braking or acceleration in congested traffic, rear passengers cannot see the road conditions through the windshield, and their bodies cannot adjust accordingly. This mismatch between their body's state and the system's activity caused by the sudden braking or acceleration results in fatigue—a physiological phenomenon. For example, when a vehicle brakes suddenly, the vehicle system stops instantly, and its motion state changes to a standstill. However, due to inertia, the passenger's body retains the motion state or tendency it had before the vehicle stopped. This rapid change in the acceleration of the body's motion state is the main cause of passenger fatigue and motion sickness, resulting in a poor riding experience.

[0051] This application uses vehicle auxiliary equipment to provide prompts on the vehicle's motion status, enabling passengers to adjust their physical state accordingly based on the vehicle's motion status. This avoids situations where passengers experience physical discomfort due to failure to adjust their physical state in time when the vehicle's acceleration changes drastically, thus improving the user's riding experience.

[0052] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device or vehicle assistance device capable of performing the above functions. The following description uses a vehicle assistance device as an example to illustrate this embodiment and the subsequent embodiments.

[0053] Based on this, embodiments of this application provide a status indication method, referring to... Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the status notification method of this application.

[0054] In this embodiment, the status prompting method is applied to a vehicle assistance device, which includes a speaker and a head-mounted display screen. The status prompting method includes steps S10 to S20:

[0055] It should be noted that vehicle auxiliary equipment, such as Figure 2 As shown, the device includes a speaker 11, a head-mounted display screen 12, a pressure sensor 13, an audio acquisition component 14, a vision sensor 15, a massage component 16, a memory 17, a controller 18, a gyroscope 19, and a wireless connection module 20. In this embodiment, the audio acquisition component 14 can be a microphone or other device or equipment capable of audio acquisition; the vision sensor 15 is used to detect the eye state of the user wearing the vehicle assistance device, including whether the eyes are closed. The vision sensor can be an infrared camera, an RGB camera, or a depth camera. This embodiment does not limit the specific composition of the vision sensor; the massage component 16 includes a vibration motor and may also include other devices or equipment capable of massage, which can massage the head of the user wearing the vehicle assistance device; the wireless connection module 20 can support the vehicle assistance device to establish a Bluetooth connection with the vehicle, or a Wi-Fi hotspot connection with the vehicle, or other communication connections, thereby enabling information transmission between the vehicle assistance device and the vehicle.

[0056] It is understood that the vehicle assistance device is part of the vehicle, and in this embodiment it is a head-mounted device. Its corresponding charging and storage box is located next to the passenger seat of the vehicle. The vehicle assistance device can be stored in the charging and storage box. During the vehicle start-up process, the vehicle assistance device in the charging and storage box will be charged through the charging and storage box. During the charging period, the vehicle assistance device does not establish a communication connection with the vehicle.

[0057] Step S10: When the current device status is that a normal communication connection has been established with the vehicle and the vehicle's motion status signal is a preset status signal, a voice prompt signal is generated based on the motion status signal, and the voice prompt signal is broadcast through the speaker.

[0058] It should be noted that, generally, it is more common for rear-seat passengers to experience motion sickness. Front-seat passengers, having a better understanding of road conditions, can anticipate the driver's actions, such as sudden braking or acceleration, and adjust their physical state accordingly, thus reducing the likelihood of motion sickness. Therefore, in this embodiment, the vehicle assistance device primarily aims to provide rear-seat passengers with information about the vehicle's movement. Front-seat passengers can also wear the device and perform related functions; this embodiment does not impose any limitations on this.

[0059] It is understood that in this embodiment, the user refers to the wearer of the vehicle assistance device. Once the user removes the vehicle assistance device from the charging case and wears it correctly, the device immediately establishes a wired / wireless communication connection with the vehicle's computer host system. At this time, the current device status of the vehicle assistance device is that it has established a normal communication connection with the vehicle. In this embodiment, the establishment of a wireless connection between the vehicle assistance device and the vehicle's computer host system is used as an example. The vehicle and the vehicle assistance device can transmit audio signals and video signals via wireless connection.

[0060] In the specific implementation, the preset state signals include the vehicle's emergency braking signal and emergency start signal. When the vehicle's motion state signal is an emergency braking signal or an emergency start signal, it means that the vehicle's motion state signal is the preset state signal. At this time, it is necessary to call the relevant voice prompt signal from the memory according to the motion state signal and use it as the voice prompt signal.

[0061] It should be noted that after generating corresponding voice prompts based on motion status signals, the vehicle assistance system will broadcast these prompts through a speaker. Users can then understand the vehicle's current motion status and adjust their physical condition accordingly. Upon receiving a voice prompt, users can switch prompt modes using the controls on the vehicle assistance system or by issuing voice commands. In this mode, the vehicle assistance system will display motion-related video signals on a head-mounted display screen. Alternatively, users can switch prompt modes using the controls on the vehicle assistance system or by issuing voice commands. In this mode, the vehicle assistance system will massage the user's head using a massage component. In this case, the status prompt function is disabled, and the vehicle assistance system will not broadcast voice prompts or push status prompt images.

[0062] In one feasible implementation, the vehicle auxiliary equipment further includes a pressure sensor, and steps A11 to A13 may be included before step S10:

[0063] Step A11: When the device connection is detected to be in a short-circuit state, the current clamping force is determined based on the pressure data collected by the pressure sensor.

[0064] It should be noted that when the vehicle assistance device is removed from the charging storage box, it detects a short circuit in the connection with the box and acquires pressure data from the pressure sensor. The acquired pressure data is then averaged to reduce noise and anomalies are checked and removed. The processed pressure data is used to determine the current clamping force of the vehicle assistance device.

[0065] Step A12: Determine the current wearing state based on the current clamping force.

[0066] It should be noted that during the design phase, experiments can determine the appropriate clamping force range to ensure the comfort and stability of the vehicle assistance device when worn by the user. When the current clamping force is within the clamping force range, it indicates that the vehicle assistance device has been correctly worn by the user, and the current wearing state is the normal wearing state; when the current clamping force is not within the clamping force range, it indicates that the vehicle assistance device has not been correctly worn by the user, and the current wearing state is the abnormal wearing state.

[0067] Step A13: When the current wearing state is normal wearing state, determine that the current device state is to establish a normal communication connection with the vehicle and obtain the vehicle's motion status signal.

[0068] It should be noted that when the current wearing status is normal, it indicates that the vehicle assistance device has established a normal communication connection with the vehicle. The device also checks whether the status prompt function is enabled. If so, it means the user needs the vehicle assistance device to provide prompts about the vehicle's motion status, and thus acquires the vehicle's motion status signals. Motion status signals include, but are not limited to, constant speed signals, deceleration signals, acceleration signals, emergency braking signals, and emergency start signals, which are calculated from parameters such as engine speed and rate of change of speed. The vehicle will wirelessly transmit real-time motion status signals to the vehicle assistance device.

[0069] Understandably, when the current device status of the vehicle assistance device is that it has established a normal communication connection with the vehicle, but the status prompt function is turned off, the massage component will massage the user's head to relieve the user's discomfort.

[0070] In one feasible implementation, step S10: generating a voice prompt signal based on the motion state signal may include steps B11 to B13:

[0071] Step B11: When the motion state signal is the first state signal, search for the state voice information corresponding to the first state signal in the voice state mapping relationship.

[0072] Step B12: Generate speech based on the state speech information to obtain the speech prompt signal corresponding to the first state signal.

[0073] It should be noted that the first state signal refers to the emergency braking signal. The voice state mapping relationship is stored in the memory. Different motion state signals correspond to different state voice information. For example, the state voice information corresponding to the emergency braking signal is "Vehicle is braking suddenly, please be careful"; the state voice information corresponding to the emergency start signal is "Vehicle is starting suddenly, please be careful".

[0074] Understandably, after identifying the motion state signal as the first state signal, the system searches for the corresponding state voice information in the voice state mapping relationship of the memory. Then, voice generation is performed based on this state voice information to obtain the voice prompt signal corresponding to the first state signal. When the vehicle starts suddenly, the voice prompt signal broadcast through the speaker is "Vehicle starting suddenly, please be careful"; when the vehicle brakes suddenly, the voice prompt signal broadcast through the speaker is "Vehicle braking suddenly, please be careful".

[0075] Step S20: Upon receiving mode selection information from the user, a status prompt screen is generated based on the mode selection information, and the status prompt screen is pushed through the head-mounted display screen.

[0076] It should be noted that when the system receives a user's request to switch the prompt mode via controls or voice commands from the vehicle's auxiliary equipment, it determines that the user has received mode selection information, indicating that the user expects to receive prompts regarding the vehicle's motion status via video signals. In this embodiment, the mode selection information determines the user's desired display mode. Corresponding status prompts are generated for different display modes and pushed through the head-mounted display screen. In this embodiment, the display modes include, but are not limited to, real-time video capture display mode and simulated animation display mode. In this embodiment, when the user presses the control once, the mode selection information is determined to be: prompting regarding the vehicle's motion status via video signals, and the display mode is real-time video capture display mode; when the user presses the control twice, the mode selection information is determined to be: prompting regarding the vehicle's motion status via video signals, and the display mode is simulated animation display mode. Mode selection information can also be received and the display mode selected through other methods; this embodiment does not limit this.

[0077] This embodiment provides a status prompting method applied to a vehicle assistance device, which includes a speaker and a head-mounted display screen. The method includes: when the device is in a state of establishing a normal communication connection with the vehicle and the vehicle's motion status signal is a preset status signal, generating a voice prompt signal based on the motion status signal and broadcasting the voice prompt signal through the speaker; and when receiving mode selection information from the user, generating a status prompt screen based on the mode selection information and pushing the status prompt screen through the head-mounted display screen. By using the vehicle assistance device to prompt the vehicle's motion status, passengers can adjust their physical state accordingly based on the vehicle's motion status, avoiding discomfort caused by sudden changes in vehicle acceleration and improving the user's riding experience.

[0078] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in Embodiment 1 above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 3 Step S20, the status prompting method further includes steps S21 to S23:

[0079] Step S21: Upon receiving mode selection information from the user, determine the screen prompt mode based on the mode selection information.

[0080] In one feasible implementation, after step S21, steps C11 to C14 may also be included:

[0081] Step C11: When the screen prompt mode is the second screen mode, obtain the vehicle's current driving speed and surrounding obstacle information.

[0082] It should be noted that the second screen mode refers to the simulated animation display mode, in which the vehicle's current speed and surrounding obstacle information need to be acquired. The surrounding obstacle information is collected by the vehicle's perception sensors and transmitted wirelessly by the vehicle to the vehicle's auxiliary equipment along with the current speed. In this embodiment, the perception sensors include, but are not limited to, radar, ultrasonic sensors, and cameras; the surrounding obstacle information includes, but is not limited to, obstacle types and quantities.

[0083] Step C12: Determine the congestion level around the vehicle based on the surrounding obstacle information.

[0084] It should be noted that by analyzing the surrounding obstacle information, the number of obstacles per unit area around the vehicle is determined. Different numbers of obstacles per unit area correspond to different levels of congestion. The congestion level per unit area within a preset range around the vehicle is calculated, and the average value is taken to obtain the vehicle's surrounding congestion level. For example, when the number of obstacles per unit area is ≤3, the congestion level is 1; when 3 < number of obstacles per unit area ≤6, the congestion level is 2; and when the number of obstacles per unit area >6, the congestion level is 3. In this embodiment, the vehicle's surrounding congestion level can also be calculated in other ways, such as by assessing the trend of congestion changes over a future period of time based on surrounding obstacle information or other methods. This embodiment does not limit this approach.

[0085] Step C13: Locate the state simulation screen corresponding to the surrounding congestion level and the current driving speed in the state screen mapping relationship.

[0086] It should be noted that in the status screen mapping relationship, different surrounding congestion levels and vehicle speeds correspond to different status simulation screens, which are pre-generated simulation animations.

[0087] Step C14: Generate a status prompt screen based on the status simulation screen, and push the status prompt screen through the head-mounted display screen.

[0088] It should be noted that the simulated state image based on the found surrounding congestion level and the current driving speed will be used as a status prompt image and pushed to the head-mounted display screen, so that users can view it through the head-mounted display screen, thereby understanding the vehicle's movement status and adjusting their physical state in time.

[0089] In this embodiment, in addition to searching for the corresponding simulated status image in the status image mapping relationship based on the surrounding congestion level and vehicle speed, a status prompt image can also be generated based on the current driving parameters and the real-time video signal collected by the vehicle's camera, and then pushed through the head-mounted display screen. In this embodiment, the status prompt image is also the video signal that provides vehicle status prompts.

[0090] Step S22: When the screen prompt mode is the first screen mode, acquire the real-time screen information of the vehicle's screen acquisition device.

[0091] It should be noted that the first screen mode refers to the real-time video capture and display mode. When the screen prompt mode is in the first screen mode, the vehicle auxiliary equipment will acquire real-time video information captured by the vehicle's front-facing camera or surround-view camera. In this embodiment, the video capture device refers to the front-facing vehicle camera, but it can also be a 360-degree surround-view camera or other capture devices capable of capturing vehicle driving images. This embodiment does not limit the scope of the device.

[0092] Step S23: Generate a status prompt screen based on the real-time image information, and push the status prompt screen through the head-mounted display screen.

[0093] It should be noted that the status prompt screen is generated based on real-time video information, that is, the real-time video information is used as a status prompt screen and pushed through the head-mounted display screen. Users can judge the vehicle's movement status based on the status information screen and then adjust their physical state accordingly.

[0094] This embodiment provides a status prompt method. The method determines the display prompt mode based on the mode selection information. When the display prompt mode is a first display mode, it acquires real-time display information from the vehicle's image acquisition device. A status prompt display is generated based on the real-time display information and pushed through the head-mounted display screen. This method allows for the generation and delivery of accurate status prompt displays according to user needs, improving the user experience while enabling timely understanding of the vehicle's movement status via video signals.

[0095] Based on the first and / or second embodiments of this application, in the third embodiment of this application, the content that is the same as or similar to that in embodiments one and two above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 4 The vehicle auxiliary equipment further includes an audio acquisition component; after step S10, the status prompting method further includes steps S01 to S02:

[0096] Step S01: When audio information collected by the audio acquisition component is received within a preset duration, the audio information is analyzed to determine the current audio semantics.

[0097] It should be noted that after broadcasting the voice prompt signal through the speaker, the audio acquisition component is checked to see if it has acquired audio information within the preset duration. If so, the acquired audio information is analyzed to determine the current audio semantics corresponding to the audio information. In this embodiment, during semantic analysis, the audio information can first be converted into text to obtain the corresponding text content. Natural Language Processing (NLP) is then used to perform semantic recognition on the text content to determine the current audio semantics corresponding to the audio information. Other methods can also be used for audio semantic analysis; this embodiment does not limit this approach. In this embodiment, the preset duration can be set to 30 seconds, or it can be set to other values ​​as needed; this embodiment does not limit this approach.

[0098] Step S02: When the current audio semantics is mode selection semantics, determine that the mode selection information fed back by the user has been received.

[0099] It should be noted that when the current audio semantics includes information on switching prompt modes and a specific on-screen prompt mode, it indicates that the current audio semantics is a mode selection semantics. In this case, it is determined that the user's feedback on mode selection information has been received, and the mode selection information is obtained through the conversion of the current audio semantics. In this embodiment, if the current audio semantics only includes information on switching prompt modes, it is also determined that the user's feedback on mode selection information has been received. Subsequently, based on the on-screen prompt mode that has been selected more frequently by historical users, it is used as the on-screen prompt mode for this time, and the status prompt screen is generated.

[0100] Understandably, if user feedback on mode selection is received within the preset duration, it means that the user does not want to switch modes. In this case, a voice prompt signal can be broadcast at a set frequency within the preset duration.

[0101] The vehicle assistance device also includes a vision sensor and a massage component; after step S20, the status prompting method further includes steps D01 to D02:

[0102] Step D01: Determine the user's eye state based on the user's eye data collected by the vision sensor.

[0103] Step D02: When the eyes are in a closed state, the control status prompt function is turned off, and massage is performed through the massage component.

[0104] It should be noted that the vision sensors on the vehicle's auxiliary equipment collect user eye data in real time and analyze it to determine the user's eye state. In this embodiment, eye state includes closed and open states. During eye data analysis, a facial detection algorithm can be used to locate the eye position from the eye data, and then the eyelid height can be detected. If the eyelid height is lower than a set height threshold, the eye state is considered closed; if the eyelid height is not lower than the set height threshold, the eye state is considered open. Other methods can also be used to detect eye state, and this embodiment does not limit this approach.

[0105] Understandably, when the eyes are closed, the user is in a resting state by default. At this time, the control status prompt function is turned off, and it is impossible to broadcast voice prompt signals or push status prompt screens. The massage component will massage the user's head.

[0106] In practice, if the status indicator function remains off, or if it is on but the movement is not characterized by sudden braking or acceleration, the massage component can still massage the user's head to alleviate discomfort. Furthermore, once the vehicle assistance device is correctly worn by the user, a voice or screen prompt can be made to indicate whether to switch directly to massage mode. If so, the massage component will massage the user's head, and the status indicator function will be turned off.

[0107] In this embodiment, the user's eye state is determined based on eye data collected by the visual sensor. When the eye state is closed, the status prompt function is turned off, and massage is performed via the massage component. Through this method, the massage component can provide massage to the user, relieving discomfort and improving the user's travel experience.

[0108] This embodiment provides a status prompting method. When audio information collected by the audio acquisition component is received within a preset duration, the audio information is analyzed to determine the current audio semantics. If the current audio semantics is a mode selection semantics, it is determined that the user's feedback mode selection information has been received. This method lays the foundation for accurate switching of the prompting mode subsequently.

[0109] For example, to help understand the implementation flow of the status indication method obtained by combining the above embodiments one and two, specifically:

[0110] The vehicle assistance device in this embodiment establishes a wireless connection with the vehicle's engine system. When the vehicle experiences sudden braking or acceleration, it wirelessly transmits the engine status signal to the passenger wearing the device. Rear-seat passengers will receive signal alerts from the device, including voice and visual signals. Upon receiving the signal for sudden braking or acceleration, the device will provide prompts via voice and visual means, allowing the wearer to adjust their physical state accordingly based on the prompts or their own understanding, thereby alleviating discomfort. Simultaneously, when the device's visual sensor detects eye closure, it enters massage mode, providing a head massage.

[0111] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the status prompting method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0112] This application also provides a status indication device, please refer to... Figure 5 The status indication device includes:

[0113] The generation module 10 is used to generate a voice prompt signal based on the motion state signal when the current device status is a normal communication connection with the vehicle and the motion state signal of the vehicle is a preset state signal, and to broadcast the voice prompt signal through the speaker.

[0114] The generation module 10 is further configured to generate a status prompt screen based on the mode selection information received from the user, and push the status prompt screen through the head-mounted display screen.

[0115] Optionally, the generation module 10 is further configured to:

[0116] When a short circuit is detected in the device connection status, the current clamping force is determined based on the pressure data collected by the pressure sensor; the current wearing status is determined based on the current clamping force; when the current wearing status is a normal wearing status, the current device status is determined to be a normal communication connection established with the vehicle, and the vehicle's motion status signal is acquired.

[0117] Optionally, the generation module 10 is further configured to:

[0118] When the motion state signal is the first state signal, the state voice information corresponding to the first state signal is searched in the voice state mapping relationship; voice is generated according to the state voice information to obtain the voice prompt signal corresponding to the first state signal.

[0119] Optionally, the generation module 10 is further configured to:

[0120] The screen prompt mode is determined based on the mode selection information; when the screen prompt mode is the first screen mode, the real-time screen information of the vehicle's screen acquisition device is acquired; a status prompt screen is generated based on the real-time screen information, and the status prompt screen is pushed through the head-mounted display screen.

[0121] Optionally, the generation module 10 is further configured to:

[0122] When the screen prompt mode is the second screen mode, the current driving speed of the vehicle and the surrounding obstacle information are obtained; the surrounding congestion level of the vehicle is determined based on the surrounding obstacle information; the state simulation screen corresponding to the surrounding congestion level and the current driving speed is found in the state screen mapping relationship; a state prompt screen is generated based on the state simulation screen, and the state prompt screen is pushed through the head-mounted display screen.

[0123] Optionally, the generation module 10 is further configured to:

[0124] When audio information collected by the audio acquisition component is received within a preset duration, the audio information is analyzed to determine the current audio semantics; when the current audio semantics is a mode selection semantics, it is determined that the mode selection information fed back by the user has been received.

[0125] Optionally, the generation module 10 is further configured to:

[0126] The user's eye state is determined based on the user's eye data collected by the visual sensor; when the eye state is closed, the control status prompt function is turned off, and massage is performed through the massage component.

[0127] The status prompting device provided in this application, employing the status prompting method described in the above embodiments, can solve the technical problem in the prior art where the user's physical state is inconsistent with the vehicle's movement state, leading to physical discomfort and a poor user experience. Compared with the prior art, the beneficial effects of the status prompting device provided in this application are the same as those of the status prompting method provided in the above embodiments, and other technical features of the status prompting device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0128] This application provides a vehicle assistance device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the status indication method in Embodiment 1 above.

[0129] The following is for reference. Figure 6 The diagram illustrates a structural schematic suitable for implementing vehicle assistance devices according to embodiments of this application. Vehicle assistance devices in embodiments of this application may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 6 The vehicle assistance device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0130] like Figure 6As shown, the vehicle auxiliary equipment may include a processing unit 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the vehicle auxiliary equipment. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. The communication device 1009 allows the vehicle assistance equipment to communicate wirelessly or wiredly with other devices to exchange data. Although the figures show vehicle assistance equipment with various systems, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0131] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0132] The vehicle assistance device provided in this application, employing the status prompting method described in the above embodiments, can solve the technical problem in the prior art where the user's physical state is inconsistent with the vehicle's movement state, leading to physical discomfort and a poor user experience. Compared with the prior art, the beneficial effects of the vehicle assistance device provided in this application are the same as those of the status prompting method provided in the above embodiments, and other technical features of this vehicle assistance device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0133] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0134] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0135] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the status prompting method in the above embodiments.

[0136] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0137] The aforementioned computer-readable storage medium may be included in the vehicle auxiliary equipment; or it may exist independently and not be installed in the vehicle auxiliary equipment.

[0138] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a vehicle assistance device, cause the vehicle assistance device to: generate a voice prompt signal based on the motion state signal and broadcast the voice prompt signal through the speaker when the current device state is that a normal communication connection with the vehicle has been established and the motion state signal of the vehicle is a preset state signal; and generate a status prompt screen based on the mode selection information received from the user and push the status prompt screen through the head-mounted display screen.

[0139] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0140] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0141] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0142] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described status indication method. This solves the technical problem in the prior art where the user's physical state is inconsistent with the vehicle's movement state, leading to physical discomfort and a poor user experience. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the status indication method provided in the above embodiments, and will not be repeated here.

[0143] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the status indication method described above.

[0144] The computer program product provided in this application can solve the technical problem in the prior art where the user's physical state is inconsistent with the vehicle's movement state, leading to physical discomfort and a poor user experience. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the status prompting method provided in the above embodiments, and will not be repeated here.

[0145] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A status indication method, characterized in that, The status prompting method is applied to a vehicle assistance device, the vehicle assistance device including: a speaker and a head-mounted display screen, the status prompting method including: When the current device status is that a normal communication connection has been established with the vehicle and the vehicle's motion status signal is a preset status signal, a voice prompt signal is generated based on the motion status signal and the voice prompt signal is broadcast through the speaker. Upon receiving mode selection information from the user, a status prompt screen is generated based on the mode selection information, and the status prompt screen is pushed through the head-mounted display screen.

2. The method as described in claim 1, characterized in that, The vehicle auxiliary equipment also includes a pressure sensor; Before the step of generating a voice prompt signal based on the motion state signal when the current device state is a normal communication connection established with the vehicle and the vehicle's motion state signal is a preset state signal, the method further includes: When a short circuit is detected in the device connection, the current clamping force is determined based on the pressure data collected by the pressure sensor. The current wearing status is determined based on the current clamping force; When the current wearing state is normal wearing state, the current device state is determined to be a normal communication connection established with the vehicle, and the vehicle's motion status signal is acquired.

3. The method as described in claim 1, characterized in that, The step of generating a voice prompt signal based on the motion state signal includes: When the motion state signal is a first state signal, the state voice information corresponding to the first state signal is searched in the voice state mapping relationship; Based on the state voice information, voice is generated to obtain the voice prompt signal corresponding to the first state signal.

4. The method as described in claim 1, characterized in that, The step of generating a status prompt screen based on the mode selection information and pushing the status prompt screen through the head-mounted display screen includes: The screen prompt mode is determined based on the mode selection information; When the screen prompt mode is the first screen mode, the real-time screen information of the vehicle's screen acquisition device is acquired; A status prompt screen is generated based on the real-time video information, and the status prompt screen is pushed through the head-mounted display screen.

5. The method as described in claim 4, characterized in that, After the step of determining the screen prompt mode based on the mode selection information, the method further includes: When the screen prompt mode is the second screen mode, the vehicle's current speed and surrounding obstacle information are obtained; The congestion level around the vehicle is determined based on the surrounding obstacle information; Find the state simulation screen corresponding to the surrounding congestion level and the current driving speed in the state screen mapping relationship; A status prompt screen is generated based on the simulated status screen, and the status prompt screen is pushed through the head-mounted display screen.

6. The method according to any one of claims 1 to 5, characterized in that, The vehicle auxiliary equipment also includes an audio acquisition component; After the step of broadcasting the voice prompt signal through the speaker, the method further includes: When audio information collected by the audio acquisition component is received within a preset duration, the audio information is analyzed to determine the current audio semantics; When the current audio semantics is mode selection semantics, it is determined that the mode selection information fed back by the user has been received.

7. The method according to any one of claims 1 to 5, characterized in that, The vehicle assistance equipment also includes a vision sensor and a massage component; After the step of generating a status prompt screen based on the mode selection information and pushing the status prompt screen through the head-mounted display screen, the method further includes: The user's eye condition is determined based on the user's eye data collected by the visual sensor; When the eyes are in a closed state, the control status prompt function is turned off, and massage is performed through the massage component.

8. A status indication device, characterized in that, The status indication device includes: The generation module is used to generate a voice prompt signal based on the motion state signal when the current device status is a normal communication connection established with the vehicle and the motion state signal of the vehicle is a preset state signal, and to broadcast the voice prompt signal through the speaker. The generation module is also used to generate a status prompt screen based on the mode selection information received from the user, and push the status prompt screen through the head-mounted display screen.

9. A vehicle auxiliary device, characterized in that, The vehicle assistance device includes: a memory, a processor, and a status prompting program stored in the memory and executable on the processor, the status prompting program being configured to implement the status prompting method as described in any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium stores a status prompting program, which, when executed by a processor, implements the status prompting method as described in any one of claims 1 to 7.

Images