Anti-carsickness method, electronic equipment, anti-carsickness system and storage medium

Abstract

The invention relates to the technical field of vehicles, particularly provides an anti-carsickness method, electronic equipment, an anti-carsickness system and a storage medium, and aims to solve the problem of how to prevent or relieve carsickness. In order to achieve the purpose, the method is applied to the carsickness prevention system and comprises the steps that electronic equipment in the system obtains first sensor data and sends the first sensor data to a vehicle; a vehicle in the system obtains second sensor data, obtains a first motion state of the user according to the second sensor data and the first sensor data and sends the first motion state to the electronic equipment; when the vehicle and / or the electronic equipment are / is in a motion sickness compensation mode, the vehicle and / or the electronic equipment determine second motion states of preset animation elements on respective display interfaces according to the first motion states, and motion sickness compensation animations are generated and displayed according to the preset animation elements and the second motion states of the preset animation elements, the second motion state is used for simulating the first motion state. Through the method, the carsickness of the user during riding can be effectively prevented or relieved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to an anti-motion sickness method, an electronic device, an anti-motion sickness system and a storage medium. Background Art

[0002] When passengers in a vehicle are watching the screen of an electronic device (such as a mobile phone, a car computer, etc.), the screen image perceived by the passengers is static, that is, the visual perception is static information, but the vestibular organs will feel the shaking and swinging of the vehicle, that is, the vestibular organs perceive motion information, and the static information and motion information conflict with each other, which may cause the passengers to feel motion sickness. In particular, when the vehicle is in a situation with a large amplitude of movement such as acceleration, bumps and turns, the degree of motion sickness will increase significantly.

[0003] Accordingly, the art needs a new technical solution to solve the above problems. Summary of the invention

[0004] In order to overcome the above-mentioned defects, the present application is proposed to solve or at least partially solve the technical problem of how to prevent or alleviate motion sickness of passengers in a vehicle.

[0005] In a first aspect, a motion sickness prevention method is provided, the method being applied to a motion sickness prevention system, the system comprising a vehicle and an electronic device of a user in the vehicle, the electronic device being communicatively connected to the vehicle, the method comprising:

[0006] The electronic device acquires first sensor data and sends the first sensor data to the vehicle, wherein the first sensor data includes acceleration data and angular velocity data of the electronic device;

[0007] The vehicle acquires second sensor data, fuses the second sensor data with the first sensor data to form fused data, acquires a first motion state of a user according to the fused data, and sends the first motion state to the electronic device, wherein the second sensor data includes acceleration data and angular velocity data of the vehicle;

[0008] When the vehicle and / or the electronic device is in a motion sickness compensation mode, the vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on a respective display interface according to the first motion state, and respectively generate a motion sickness compensation animation according to the preset animation element and the second motion state of the preset animation element on the respective display interface, and display the motion sickness compensation animation on the respective display interface;

[0009] The second motion state is used to simulate the first motion state.

[0010] In a technical solution of the above-mentioned anti-motion sickness method, the acceleration data of the electronic device and the vehicle both include three-axis acceleration, the angular velocity data of the electronic device and the vehicle both include three-axis angular velocity, the three-axis acceleration includes the acceleration of the X-axis, the Y-axis, and the Z-axis in the three-dimensional coordinate system, the three-axis angular velocity includes the angular velocity of the X-axis, the Y-axis, and the Z-axis, and the fusing of the second sensor data and the first sensor data to form fused data includes:

[0011] Performing weighted average calculation on the three-axis acceleration in the second sensor data and the first sensor data to obtain a fused three-axis acceleration;

[0012] Performing weighted average calculation on the three-axis angular velocity in the second sensor data and the first sensor data to obtain a fused three-axis angular velocity;

[0013] The fused data is obtained according to the fused three-axis acceleration and three-axis angular velocity.

[0014] In a technical solution of the above anti-motion sickness method, the acquiring the first motion state of the user according to the fusion data includes:

[0015] Performing a second integration of the three-axis acceleration in the fused data to obtain a three-axis translation (tx, ty, tz), where tx, ty, and tz represent the translation of the user on the X-axis, Y-axis, and Z-axis, respectively;

[0016] Integrate the three-dimensional angular velocity in the fused data once to obtain the three-axis angle (rx, ry, rz), where rx, ry, and rz represent the rotation angles of the user on the X-axis, Y-axis, and Z-axis, respectively;

[0017] The first motion state is acquired according to the three-axis translation (tx, ty, tz) and the three-axis angle (rx, ry, rz).

[0018] In a technical solution of the above anti-motion sickness method, the first motion state includes three-axis translation (tx, ty, tz) and three-axis angle (rx, ry, rz), tx, ty, tz respectively represent the translation of the user on the X axis, Y axis, and Z axis in the three-dimensional coordinate system, rx, ry, rz respectively represent the rotation angle of the current user on the X axis, Y axis, and Z axis,

[0019] The vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on a respective display interface according to the first motion state, including:

[0020] According to (tx, ty) in the three-axis translation (tx, ty, tz), obtaining position information of the preset animation element when displayed on the display interface;

[0021] According to (rx, ry) of the three-axis angles (rx, ry, rz), acquiring posture information of the preset animation element when displayed on the display interface;

[0022] The second motion state is acquired according to the position information and the posture information.

[0023] In a technical solution of the above anti-motion sickness method, the first motion state includes three-axis translation (tx, ty, tz), tx, ty, tz respectively represent the translation of the user along the X-axis, the Y-axis, and the Z-axis in the three-dimensional coordinate system, and the motion sickness compensation animation is generated according to the preset animation element and the second motion state of the preset animation element on the respective display interface, including:

[0024] According to tz in the three-axis translation (tx, ty, tz), the size of the preset animation element when displayed on the display interface is obtained, and the size is positively correlated with the absolute value of tz;

[0025] The motion sickness compensation animation is generated according to the preset animation element, the second motion state and the size.

[0026] In a technical solution of the above anti-motion sickness method, fusing the second sensor data with the first sensor data to form fused data includes:

[0027] filtering the first sensor data and the second sensor data, and fusing the filtered first sensor data and the second sensor data to form first fused data;

[0028] Performing Kalman filtering on the first fused data to obtain second fused data;

[0029] Using a preset data filtering model to filter the second fused data to obtain third fused data, wherein the data filtering model is a pre-trained deep learning model;

[0030] Final fused data is obtained according to the third fused data.

[0031] In a technical solution of the above anti-motion sickness method, the method further includes the vehicle and the electronic device entering the motion sickness compensation mode in the following manner:

[0032] In response to a user's operation on the vehicle or the electronic device, the vehicle or the electronic device enters the motion sickness compensation mode.

[0033] In a technical solution of the above anti-motion sickness method, the electronic device includes a wearable device and a mobile device, the wearable device is provided with a biological sign collection module, and the biological sign collection module is used to collect biological signs of the human body. The method also includes the vehicle and the electronic device entering the motion sickness compensation mode in the following manner:

[0034] The wearable device acquires the body impedance collected by the biological sign collection module, and determines the motion sickness state of the user according to the body impedance; if the body impedance is less than a first threshold, the motion sickness state is motion sickness; otherwise, the motion sickness state is not motion sickness;

[0035] When the motion sickness state is motion sickness, the wearable device enters the motion sickness compensation mode and sends a first instruction to the vehicle and the mobile device, where the first instruction is used to notify the vehicle and the mobile device to enter the motion sickness compensation mode.

[0036] In a technical solution of the above anti-motion sickness method, the method further comprises:

[0037] The wearable device acquires the target physical sign collected by the biological sign collection module, where the target physical sign includes at least one of blood oxygen, blood pressure and heart rate;

[0038] When the motion sickness state is motion sickness, the wearable device determines the degree of motion sickness of the user according to the target physical sign; if at least one of the target physical signs is greater than its corresponding second threshold, the degree of motion sickness is severe; otherwise, the degree of motion sickness is mild;

[0039] When the degree of motion sickness is severe, the wearable device plays preset soothing music and sends a second instruction to the vehicle and the mobile device, where the second instruction is used to notify the vehicle and the mobile device to play the preset soothing music.

[0040] In a second aspect, a motion sickness prevention method is provided. The method is applied to an electronic device, the electronic device is an electronic device of a user in a vehicle, the electronic device is communicatively connected to the vehicle, and the method comprises:

[0041] Acquire first sensor data and send the first sensor data to the vehicle, the first sensor data including acceleration data and angular velocity data of the electronic device;

[0042] Receiving a first motion state of a user sent by the vehicle;

[0043] When the electronic device is in a motion sickness compensation mode, determining a second motion state of a preset animation element on a display interface of the electronic device according to the first motion state, wherein the second motion state is used to simulate the first motion state;

[0044] generating a motion sickness compensation animation according to the preset animation element and the second motion state, and displaying the motion sickness compensation animation on the display interface;

[0045] in,

[0046] The first motion state is obtained by the vehicle according to fusion data, and the fusion data is formed by the vehicle fusing the first sensor data and second sensor data, and the second sensor data includes acceleration data and angular velocity data of the vehicle.

[0047] In a technical solution of the above anti-motion sickness method, the first motion state includes three-axis translation (tx, ty, tz) and three-axis angle (rx, ry, rz), tx, ty, tz respectively represent the translation of the user on the X axis, Y axis, and Z axis in the three-dimensional coordinate system, and rx, ry, rz respectively represent the rotation angle of the user on the X axis, Y axis, and Z axis, and the second motion state of the preset animation element on the display interface of the electronic device according to the first motion state includes:

[0048] According to (tx, ty) in the three-axis translation (tx, ty, tz), obtaining position information of the preset animation element when displayed on the display interface;

[0049] According to (rx, ry) of the three-axis angles (rx, ry, rz), acquiring posture information of the preset animation element when displayed on the display interface;

[0050] The second motion state is acquired according to the position information and the posture information.

[0051] In a technical solution of the above anti-motion sickness method, the first motion state includes three-axis translation (tx, ty, tz), tx, ty, tz respectively represent the translation of the user along the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system, and generating the motion sickness compensation animation according to the preset animation element and the second motion state includes:

[0052] According to tz in the three-axis translation (tx, ty, tz), the size of the preset animation element when displayed on the display interface is obtained, and the size is positively correlated with the absolute value of tz;

[0053] The motion sickness compensation animation is generated according to the preset animation element, the second motion state and the size.

[0054] In a technical solution of the above-mentioned anti-motion sickness method, the method also includes entering the motion sickness compensation mode in the following manner: entering the motion sickness compensation mode in response to a user's operation on the electronic device.

[0055] In a technical solution of the above anti-motion sickness method, the electronic device includes a wearable device and a mobile device, the wearable device is provided with a biological sign collection module, and the biological sign collection module is used to collect biological signs of the human body. The method further includes entering the motion sickness compensation mode in the following manner:

[0056] The wearable device acquires the body impedance collected by the biological sign collection module, and determines the motion sickness state of the user according to the body impedance; if the body impedance is less than a first threshold, the motion sickness state is motion sickness; otherwise, the motion sickness state is not motion sickness;

[0057] When the motion sickness state is motion sickness, the wearable device enters the motion sickness compensation mode and sends a first instruction to the mobile device, where the first instruction is used to notify the mobile device to enter the motion sickness compensation mode.

[0058] In a technical solution of the above anti-motion sickness method, the method further comprises:

[0059] The wearable device acquires the target physical sign collected by the biological sign collection module, where the target physical sign includes at least one of blood oxygen, blood pressure and heart rate;

[0060] When the motion sickness state is motion sickness, the wearable device determines the degree of motion sickness of the user according to the target physical sign; if at least one of the target physical signs is greater than its corresponding second threshold, the degree of motion sickness is severe; otherwise, the degree of motion sickness is mild;

[0061] When the degree of motion sickness is severe, the wearable device plays preset soothing music and sends a second instruction to the mobile device, where the second instruction is used to notify the mobile device to play the preset soothing music.

[0062] In a third aspect, an electronic device is provided, the electronic device is provided with a sensor module, the sensor module is used to collect acceleration data and angular velocity data of the electronic device, the electronic device includes at least one processor; and a memory communicatively connected to the at least one processor; wherein a computer program is stored in the memory, and when the computer program is executed by the at least one processor, the steps performed by the electronic device in any one of the technical solutions provided in the second aspect are implemented.

[0063] In a fourth aspect, an anti-motion sickness system is provided, the system comprising a vehicle and an electronic device of a user in the vehicle, the electronic device being communicatively connected to the vehicle, the system being used to execute any one of the anti-motion sickness methods provided in the first aspect.

[0064] In a fifth aspect, a computer-readable storage medium is provided, wherein a plurality of program codes are stored in the computer-readable storage medium, wherein the program codes are suitable for being loaded and run by at least one processor to execute the anti-motion sickness method provided in any one of the first aspect or the second aspect.

[0065] Solution 1. A motion sickness prevention method, characterized in that the method is applied to a motion sickness prevention system, the system comprising a vehicle and an electronic device of a user in the vehicle, the electronic device being communicatively connected to the vehicle, the method comprising:

[0066] The electronic device acquires first sensor data and sends the first sensor data to the vehicle, wherein the first sensor data includes acceleration data and angular velocity data of the electronic device;

[0067] The vehicle acquires second sensor data, fuses the second sensor data with the first sensor data to form fused data, acquires a first motion state of a user according to the fused data, and sends the first motion state to the electronic device, wherein the second sensor data includes acceleration data and angular velocity data of the vehicle;

[0068] When the vehicle and / or the electronic device is in a motion sickness compensation mode, the vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on a respective display interface according to the first motion state, and respectively generate a motion sickness compensation animation according to the preset animation element and the second motion state of the preset animation element on the respective display interface, and display the motion sickness compensation animation on the respective display interface;

[0069] The second motion state is used to simulate the first motion state.

[0070] Solution 2. The method according to Solution 1 is characterized in that the acceleration data of the electronic device and the vehicle both include three-axis acceleration, the angular velocity data of the electronic device and the vehicle both include three-axis angular velocity, the three-axis acceleration includes the acceleration of the X-axis, the Y-axis, and the Z-axis in the three-dimensional coordinate system, the three-axis angular velocity includes the angular velocity of the X-axis, the Y-axis, and the Z-axis, and the fusing of the second sensor data with the first sensor data to form fused data includes:

[0071] Performing weighted average calculation on the three-axis acceleration in the second sensor data and the first sensor data to obtain a fused three-axis acceleration;

[0072] Performing weighted average calculation on the three-axis angular velocity in the second sensor data and the first sensor data to obtain a fused three-axis angular velocity;

[0073] The fused data is obtained according to the fused three-axis acceleration and three-axis angular velocity.

[0074] Solution 3. The method according to Solution 2 is characterized in that the acquiring the first motion state of the user according to the fusion data comprises:

[0075] Performing a second integration of the three-axis acceleration in the fused data to obtain a three-axis translation (tx, ty, tz), where tx, ty, and tz represent the translation of the user on the X-axis, Y-axis, and Z-axis, respectively;

[0076] Integrate the three-dimensional angular velocity in the fused data once to obtain the three-axis angle (rx, ry, rz), where rx, ry, and rz represent the rotation angles of the user on the X-axis, Y-axis, and Z-axis, respectively;

[0077] The first motion state is acquired according to the three-axis translation (tx, ty, tz) and the three-axis angle (rx, ry, rz).

[0078] Solution 4. The method according to any one of Solutions 1 to 3, characterized in that the first motion state includes three-axis translation (tx, ty, tz) and three-axis angles (rx, ry, rz), tx, ty, tz respectively represent the translation of the user on the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system, and rx, ry, rz respectively represent the rotation angles of the user on the X-axis, Y-axis, and Z-axis,

[0079] The vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on a respective display interface according to the first motion state, including:

[0080] According to (tx, ty) in the three-axis translation (tx, ty, tz), obtaining position information of the preset animation element when displayed on the display interface;

[0081] According to (rx, ry) of the three-axis angles (rx, ry, rz), acquiring posture information of the preset animation element when displayed on the display interface;

[0082] The second motion state is acquired according to the position information and the posture information.

[0083] Solution 5. The method according to any one of solutions 1 to 3, characterized in that the first motion state includes three-axis translation (tx, ty, tz), tx, ty, tz respectively represent the translation of the user along the X-axis, the Y-axis, and the Z-axis in the three-dimensional coordinate system, and the generating of the motion sickness compensation animation according to the preset animation element and the second motion state of the preset animation element on the respective display interface comprises:

[0084] According to tz in the three-axis translation (tx, ty, tz), the size of the preset animation element when displayed on the display interface is obtained, and the size is positively correlated with the absolute value of tz;

[0085] The motion sickness compensation animation is generated according to the preset animation element, the second motion state and the size.

[0086] Solution 6. The method according to Solution 1 is characterized in that fusing the second sensor data with the first sensor data to form fused data comprises:

[0087] filtering the first sensor data and the second sensor data, and fusing the filtered first sensor data and the second sensor data to form first fused data;

[0088] Performing Kalman filtering on the first fused data to obtain second fused data;

[0089] Using a preset data filtering model to filter the second fused data to obtain third fused data, wherein the data filtering model is a pre-trained deep learning model;

[0090] Final fused data is obtained according to the third fused data.

[0091] Solution 7. The method according to Solution 1 is characterized in that the method further comprises the vehicle and the electronic device entering the motion sickness compensation mode in the following manner:

[0092] In response to a user's operation on the vehicle or the electronic device, the vehicle or the electronic device enters the motion sickness compensation mode.

[0093] Solution 8. The method according to Solution 1 is characterized in that the electronic device includes a wearable device and a mobile device, the wearable device is provided with a biological sign collection module, and the biological sign collection module is used to collect biological signs of the human body, and the method also includes the vehicle and the electronic device entering the motion sickness compensation mode in the following manner:

[0094] The wearable device acquires the body impedance collected by the biological sign collection module, and determines the motion sickness state of the user according to the body impedance; if the body impedance is less than a first threshold, the motion sickness state is motion sickness; otherwise, the motion sickness state is not motion sickness;

[0095] When the motion sickness state is motion sickness, the wearable device enters the motion sickness compensation mode and sends a first instruction to the vehicle and the mobile device, where the first instruction is used to notify the vehicle and the mobile device to enter the motion sickness compensation mode.

[0096] Solution 9. The method according to Solution 8, characterized in that the method further comprises:

[0097] The wearable device acquires the target physical sign collected by the biological sign collection module, where the target physical sign includes at least one of blood oxygen, blood pressure and heart rate;

[0098] When the motion sickness state is motion sickness, the wearable device determines the degree of motion sickness of the user according to the target physical sign; if at least one of the target physical signs is greater than its corresponding second threshold, the degree of motion sickness is severe; otherwise, the degree of motion sickness is mild;

[0099] When the degree of motion sickness is severe, the wearable device plays preset soothing music and sends a second instruction to the vehicle and the mobile device, where the second instruction is used to notify the vehicle and the mobile device to play the preset soothing music.

[0100] Solution 10. A motion sickness prevention method, characterized in that it is applied to an electronic device, the electronic device is an electronic device of a user in a vehicle, the electronic device is communicatively connected with the vehicle, and the method comprises:

[0101] Acquire first sensor data and send the first sensor data to the vehicle, the first sensor data including acceleration data and angular velocity data of the electronic device;

[0102] Receiving a first motion state of a user sent by the vehicle;

[0103] When the electronic device is in a motion sickness compensation mode, determining a second motion state of a preset animation element on a display interface of the electronic device according to the first motion state, wherein the second motion state is used to simulate the first motion state;

[0104] generating a motion sickness compensation animation according to the preset animation element and the second motion state, and displaying the motion sickness compensation animation on the display interface;

[0105] The first motion state is obtained by the vehicle according to fusion data, and the fusion data is formed by the vehicle fusing the first sensor data and the second sensor data, and the second sensor data includes acceleration data and angular velocity data of the vehicle.

[0106] Solution 11. The method according to Solution 10 is characterized in that the first motion state includes three-axis translation (tx, ty, tz) and three-axis angles (rx, ry, rz), tx, ty, tz respectively represent the translation of the user on the X axis, Y axis, and Z axis in the three-dimensional coordinate system, and rx, ry, rz respectively represent the rotation angle of the user on the X axis, Y axis, and Z axis, and the second motion state of the preset animation element on the display interface of the electronic device according to the first motion state includes:

[0107] According to (tx, ty) in the three-axis translation (tx, ty, tz), obtaining position information of the preset animation element when displayed on the display interface;

[0108] According to (rx, ry) of the three-axis angles (rx, ry, rz), acquiring posture information of the preset animation element when displayed on the display interface;

[0109] The second motion state is acquired according to the position information and the posture information.

[0110] Solution 12. The method according to Solution 10 is characterized in that the first motion state includes three-axis translation (tx, ty, tz), tx, ty, tz respectively represent the translation of the user along the X-axis, the Y-axis, and the Z-axis in the three-dimensional coordinate system, and generating the motion sickness compensation animation according to the preset animation element and the second motion state includes:

[0111] According to tz in the three-axis translation (tx, ty, tz), the size of the preset animation element when displayed on the display interface is obtained, and the size is positively correlated with the absolute value of tz;

[0112] The motion sickness compensation animation is generated according to the preset animation element, the second motion state and the size.

[0113] Solution 13. The method according to Solution 10 is characterized in that the method also includes entering the motion sickness compensation mode in the following manner: entering the motion sickness compensation mode in response to a user's operation on the electronic device.

[0114] Solution 14. The method according to Solution 10 is characterized in that the electronic device includes a wearable device and a mobile device, the wearable device is provided with a biological sign collection module, and the biological sign collection module is used to collect biological signs of the human body, and the method further includes entering the motion sickness compensation mode in the following manner:

[0115] The wearable device acquires the body impedance collected by the biological sign collection module, and determines the motion sickness state of the user according to the body impedance; if the body impedance is less than a first threshold, the motion sickness state is motion sickness; otherwise, the motion sickness state is not motion sickness;

[0116] When the motion sickness state is motion sickness, the wearable device enters the motion sickness compensation mode and sends a first instruction to the mobile device, where the first instruction is used to notify the mobile device to enter the motion sickness compensation mode.

[0117] Solution 15. The method according to Solution 14, characterized in that the method further comprises:

[0118] The wearable device acquires the target physical sign collected by the biological sign collection module, where the target physical sign includes at least one of blood oxygen, blood pressure and heart rate;

[0119] When the motion sickness state is motion sickness, the wearable device determines the degree of motion sickness of the user according to the target physical sign; if at least one of the target physical signs is greater than its corresponding second threshold, the degree of motion sickness is severe; otherwise, the degree of motion sickness is mild;

[0120] When the degree of motion sickness is severe, the wearable device plays preset soothing music and sends a second instruction to the mobile device, where the second instruction is used to notify the mobile device to play the preset soothing music.

[0121] Solution 16. An electronic device, characterized in that the electronic device is provided with a sensor module, the sensor module is used to collect acceleration data and angular velocity data of the electronic device, and the electronic device further comprises:

[0122] at least one processor;

[0123] and, a memory communicatively coupled to the at least one processor;

[0124] Wherein, a computer program is stored in the memory, and when the computer program is executed by the at least one processor, the anti-motion sickness method described in any one of Schemes 10 to 15 is implemented.

[0125] Scheme 17. A motion sickness prevention system, characterized in that the system includes a vehicle and an electronic device of a user in the vehicle, the electronic device is communicatively connected to the vehicle, and the system is used to execute the motion sickness prevention method described in any one of Schemes 1 to 9.

[0126] Solution 18. A computer-readable storage medium storing a plurality of program codes, wherein the program codes are suitable for being loaded and executed by at least one processor to execute the anti-motion sickness method described in any one of Solutions 1 to 9, or the anti-motion sickness method described in any one of Solutions 10 to 15.

[0127] The above one or more technical solutions of the present application have at least one or more of the following beneficial effects:

[0128] In a technical solution for implementing the anti-motion sickness method provided in the present application, the method is applied to an anti-motion sickness system, the anti-motion sickness system includes a vehicle and an electronic device of a user in the vehicle, the electronic device and the vehicle are communicatively connected, and the method includes the following steps: the electronic device obtains first sensor data and sends the first sensor data to the vehicle, the first sensor data includes acceleration data and angular velocity data of the electronic device; the vehicle obtains second sensor data, fuses the second sensor data with the first sensor data to form fused data, obtains a first motion state of the user according to the fused data, and sends the first motion state to the electronic device, the second sensor data includes acceleration data and angular velocity data of the vehicle; when the vehicle and / or the electronic device is in a motion sickness compensation mode, the vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on their respective display interfaces according to the first motion state, and respectively generate a motion sickness compensation animation according to the preset animation element and the second motion state of the preset animation element on their respective display interfaces, and display the motion sickness compensation animation on their respective display interfaces, and the second motion state is used to simulate the first motion state.

[0129] In the above implementation scheme, the anti-motion sickness system is an interconnected system formed by the communication connection between the vehicle and the electronic device, in which the vehicle and the electronic device cooperate with each other to jointly prevent or alleviate the user's motion sickness. Specifically, the electronic device obtains the first sensor data, and the first sensor data can represent the motion information of the electronic device, and when the user uses or carries the electronic device, the motion information of the electronic device can also indirectly represent the user's motion information; the vehicle obtains the second sensor data, and the second sensor data can represent the vehicle's motion information, and when the user is in the vehicle, the vehicle's motion information can also indirectly represent the user's motion information; the fusion data formed by the vehicle fusing the first and second sensor data can accurately represent the user's motion information, so the user's first motion state can be more accurately obtained according to the fusion data, and the first motion state can represent the motion state felt by the user's vestibule. Further, after determining the second motion state of the preset animation element on the display interface according to the first motion state, the second motion state can simulate the first motion state, so that the motion state of the preset animation element viewed by the user when the user views the display interface is synchronized with the motion state felt by the user's vestibule, and there will be no conflict, thereby preventing or alleviating the user's motion sickness. BRIEF DESCRIPTION OF THE DRAWINGS

[0130] The disclosure of the present application will become easier to understand with reference to the accompanying drawings. It is easy for those skilled in the art to understand that these drawings are only for illustrative purposes and are not intended to limit the scope of protection of the present application. Among them:

[0131] Figure 1 is a partial structural schematic diagram of an anti-motion sickness system according to an embodiment of the present application;

[0132] Figure 2 is a schematic flow chart of the main steps of a motion sickness prevention method according to an embodiment of the present application;

[0133] Figure 3 is a schematic diagram of a motion sickness compensation animation and its display effect on a vehicle display interface according to an embodiment of the present application;

[0134] Figure 4 It is a schematic diagram of the main process of fusing the first and second sensor data to form fused data according to an embodiment of the present application;

[0135] Figure 5 It is a schematic flow chart of main steps of determining the second motion state of a preset animation element on each display interface according to an embodiment of the present application;

[0136] Figure 6is a flowchart of main steps of detecting whether a user is motion sickness and determining whether to actively enter a motion sickness compensation mode based on the detection according to an embodiment of the present application;

[0137] Figure 7 is a flowchart of the main steps of detecting the degree of motion sickness of a user and determining whether to play soothing music based on the degree of motion sickness according to an embodiment of the present application;

[0138] Figure 8 is a schematic diagram of the overall process of a motion sickness prevention method according to an embodiment of the present application;

[0139] Fig. 9 is a schematic flow chart of main steps of a motion sickness prevention method applied to an electronic device according to an embodiment of the present application;

[0140] Fig.10 It is a partial structural diagram of an electronic device according to an embodiment of the present application.

[0141] Reference numerals:

[0142] 11: memory; 12: processor. DETAILED DESCRIPTION

[0143] Some embodiments of the present application are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present application and are not intended to limit the protection scope of the present application.

[0144] In the description of this application, "module" and "processor" may include hardware, software or a combination of the two. A module may include hardware circuits, various suitable sensors, communication ports, and memories, and may also include software parts, such as program codes, or a combination of software and hardware. The processor may be a central processing unit, a microprocessor, an image processor, a digital signal processor, or any other suitable processor. The processor has data and / or signal processing functions. The processor may be implemented in software, hardware, or a combination of the two. Computer-readable storage media include any suitable media that can store program codes, such as magnetic disks, hard disks, optical disks, flash memory, read-only memory, random access memory, etc.

[0145] The relevant user personal information that may be involved in the various embodiments of this application is strictly in accordance with the requirements of laws and regulations, following the principles of legality, legitimacy and necessity, based on the reasonable purposes of business scenarios, to process the personal information that users actively provide during the use of products / services or generated due to the use of products / services, as well as the personal information obtained with the user's authorization.

[0146] The user personal information processed by this application will vary depending on the specific product / service scenario, and shall be based on the specific scenario in which the user uses the product / service, and may involve the user's account information, device information, driving information, vehicle information or other related information. This application will treat the user's personal information and its processing with a high degree of diligence.

[0147] This application attaches great importance to the security of user personal information and has taken reasonable and feasible security protection measures that meet industry standards to protect user information and prevent personal information from being accessed, disclosed, used, modified, damaged or lost without authorization.

[0148] The following is a description of an embodiment of the anti-motion sickness method provided by the present application.

[0149] In the embodiment provided by the present application, the anti-motion sickness method is applied to the anti-motion sickness system, and the system includes a vehicle and at least one electronic device of the user in the vehicle, and the electronic device is communicated with the vehicle. Specifically, if the user wants to use the anti-motion sickness system to prevent or relieve motion sickness, the user can control his electronic device to establish a communication connection with the vehicle to form an anti-motion sickness system, and the system can execute the anti-motion sickness method provided by the present application. The communication connection method between the electronic device and the vehicle includes but is not limited to wireless communication methods such as Bluetooth and UWB (Ultra Wide Band). The above-mentioned anti-motion sickness system can be understood as an interconnected system formed by interconnecting vehicles and electronic devices, which is equivalent to connecting the operating systems of the vehicle and each electronic device, and incorporating the vehicle and each electronic device into the same operating system (or the vehicle and each electronic device share an operating system). In this operating system, the vehicle and each electronic device share hardware capabilities, and the vehicle and each electronic device can transmit data to each other at high speed (including sensor data collected by the IMU sensor), realizing seamless data relay across devices, breaking the barriers between vehicles and electronic devices, and building an intelligent vehicle ecosystem, which helps to improve user experience. For example, after a user takes a photo with a mobile phone, the photo can be immediately displayed on the vehicle screen based on the above system, and the user can view the photo on the vehicle screen; similarly, after a user takes a photo with a vehicle camera, the photo can also be immediately displayed on the mobile phone screen based on the above system, and the user can view the photo on the mobile phone screen. The electronic device can be, but is not limited to, a mobile device and a wearable device (Wearabledevice). The mobile device can be a mobile phone, a handheld computer, etc., and the wearable device can be a smart watch, a smart ring, an augmented reality (AR)\virtual reality (VR) device, etc.

[0150] See attached Figure 1 , Figure 1FIG. 1 is a partial structural diagram of an anti-motion sickness system according to an embodiment of the present application. Figure 1 As shown, the electronic device is a mobile phone, the vehicle and the mobile phone are connected by Bluetooth or UWB communication, the operating systems of the vehicle and the mobile phone are connected, and the two share an operating system. In addition, an IMU sensor is provided in the vehicle cabin. The IMU sensor is an inertial measurement unit (Inertial Measurement Unit). The IMU sensor includes at least a gyroscope and an accelerometer. The gyroscope can obtain the three-axis angular velocity of the object in a three-dimensional coordinate system (such as the IMU coordinate system), and the accelerometer can obtain the three-axis acceleration of the object in the three-dimensional coordinate system. The mobile phone is provided with a gyroscope and an accelerometer, and the combination of the two can also be understood as the IMU sensor of the mobile phone.

[0151] See attached Figure 2 , Figure 2 FIG. 1 is a flow chart of the main steps of the motion sickness prevention method according to an embodiment of the present application. Figure 2 As shown, the anti-motion sickness method in the embodiment of the present application mainly includes the following steps S101 to S104.

[0152] Step S101: the electronic device acquires first sensor data and sends the first sensor data to the vehicle, where the first sensor data includes acceleration data and angular velocity data of the electronic device.

[0153] The acceleration data and angular velocity data of the electronic device include the three-axis acceleration and three-axis angular velocity of the electronic device in the three-dimensional coordinate system, respectively, wherein the three-axis acceleration includes the acceleration of the electronic device in the three-dimensional coordinate system on the X axis, Y axis, and Z axis, and the three-axis angular velocity includes the angular velocity of the electronic device in the three-dimensional coordinate system on the X axis, Y axis, and Z axis. In some embodiments, the three-dimensional coordinate system may be an IMU coordinate system, which is a coordinate system of an IMU sensor composed of a gyroscope and an accelerometer on the electronic device.

[0154] Step S102: the vehicle acquires second sensor data, and fuses the second sensor data with the first sensor data to form fused data, where the second sensor data includes acceleration data and angular velocity data of the vehicle.

[0155] The acceleration data and angular velocity data of the vehicle include the three-axis acceleration and three-axis angular velocity of the vehicle in the three-dimensional coordinate system, respectively, wherein the three-axis acceleration includes the acceleration of the vehicle in the three-dimensional coordinate system along the X-axis, Y-axis, and Z-axis, and the three-axis angular velocity includes the angular velocity of the vehicle in the three-dimensional coordinate system along the X-axis, Y-axis, and Z-axis. In some embodiments, the three-dimensional coordinate system may be the coordinate system of an IMU sensor on the vehicle.

[0156] The first sensor data can represent the motion information (or shaking information) of the electronic device. When a user uses or carries the electronic device, the electronic device moves along with the user's movement. Therefore, the first sensor data is used to indirectly represent the user's motion information (or shaking information).

[0157] The second sensor data can represent the motion information of the vehicle (or the shaking information of the vehicle body). When the user is in the vehicle, the user moves along with the movement of the vehicle. Therefore, the second sensor data is also used to indirectly represent the user's motion information (or shaking information).

[0158] The fusion of the first and second sensor data is actually the fusion of the user's motion information in two different dimensions. The fused data still represents the user's motion information, but because the fused data takes into account the motion information represented by the first and second sensor data at the same time, compared with the first and second sensor data, the fused data can further accurately represent the user's motion information.

[0159] In some embodiments, when the first and second sensor data are fused, the average value of the first and second sensor data can be obtained, and the average value is used as the fused data. The fused data still includes three-axis acceleration and three-axis angular velocity, but at this time, the three-axis acceleration and the three-axis angular velocity respectively represent the three-axis acceleration and three-axis angular velocity of the user in the three-dimensional coordinate system. If the three-dimensional coordinate system is an IMU coordinate system, then the IMU coordinate system can be understood as a virtual coordinate system, which can represent the IMU coordinate system of the IMU sensor on the electronic device, and can also represent the IMU coordinate system of the IMU sensor on the vehicle.

[0160] In some embodiments, the electronic device includes a mobile phone and a smart watch, and the three-axis acceleration in the first sensor data collected by the mobile phone is (g 1x , g 1y , g 1z ), the three-axis angular velocity is (R 1x , R 1y , R 1z ); In the first sensor data collected by the smart watch, the three-axis acceleration is (g 2x , g 2y , g 2z ), the three-axis angular velocity is (R 2x , R 2y , R 2z ); In the second sensor data collected by the vehicle, the three-axis acceleration is (g 3x , g 3y , g 3z ), the three-axis angular velocity is (R 3x , R 3y , R 3z). When fusing the above sensor data, the above sensor data is first formed into a data array. The data array is then used to complete data fusion.

[0161] Step S103: Acquire the user's first motion state according to the fusion data, and send the first motion state to the electronic device.

[0162] It can be known from the aforementioned step S102 that the fused data can represent the motion information of the user, and therefore the motion state of the user can be obtained based on the fused data.

[0163] Step S104: When the vehicle and / or the electronic device is in the motion sickness compensation mode, the vehicle and / or the electronic device generates a motion sickness compensation screen according to the first motion state, and displays the motion sickness compensation screen on the respective display interfaces. Specifically, the vehicle and / or the electronic device determines the second motion state of the preset animation element on the respective display interface according to the first motion state, and generates a motion sickness compensation animation according to the preset animation element and the second motion state of the preset animation element on the respective display interface, and displays the motion sickness compensation animation on the respective display interface, and the second motion state is used to simulate the first motion state.

[0164] In some embodiments, the vehicle may enter the motion sickness compensation mode in response to a user's operation on the vehicle, and the electronic device may enter the motion sickness compensation mode in response to a user's operation on the electronic device. Controls for user operations may be provided on the display interfaces of the vehicle and the electronic device, and the user may click, slide, drag, and perform other operations on the control. After detecting the operation, the vehicle or the electronic device may enter the motion sickness compensation mode.

[0165] The preset animation elements may include attributes such as shape, pattern, color, transparency, etc., and the preset animation elements may be directly called when motion sickness compensation animation needs to be generated.

[0166] When the user watches the display interface, he will watch the preset animation element and feel the second motion state of the preset animation element. Therefore, the second motion state can be understood as the motion state felt by the user's vision; the user's first motion state is obtained based on the actual motion information of the vehicle and the electronic device. Therefore, the first motion state can be understood as the motion state felt by the user's vestibule. Since the second motion state of the preset animation element can simulate the user's first motion state, the first and second motion states are synchronized and will not conflict with each other (such as the first motion state rotates in one direction, while the second motion state rotates in the opposite direction). This ensures that the motion states felt by the user's vision and vestibule will not conflict, thereby preventing or alleviating the user's motion sickness.

[0167] For example, see the attached Figure 3 , Figure 3 The following example shows motion sickness compensation animations at multiple moments and their display effects on the vehicle display interface. Figure 3 As shown, the animation element includes three circular icons arranged in sequence from top to bottom, and the three circular icons move together as a whole. When the user views the content on the display interface ( Figure 3 The movement of the animated elements can also be viewed when viewing the image (not shown).

[0168] Based on the methods described in steps S101 to S104 above, a communication connection can be established between the vehicle and the electronic device to form an anti-motion sickness system, and the anti-motion sickness system can be used to display a motion sickness compensation animation on the display interface of the vehicle and / or the electronic device to prevent or alleviate the user's motion sickness.

[0169] The following continues to describe an embodiment of the motion sickness prevention method provided by the present application, specifically describing the above steps S102 to S104.

[0170] 1. Explain step S102.

[0171] In some implementations of the above step S102, Figure 4 The following steps S1021 to S1023 shown are used to fuse the first and second sensor data to form fused data.

[0172] Step S1021: performing weighted average calculation on the three-axis acceleration in the second sensor data and the first sensor data to obtain a fused three-axis acceleration.

[0173] Specifically, if the three-axis acceleration in the second sensor data is set to (g vx , g vy , g vz ), g vx , g vy , g vz They represent the acceleration of the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system respectively; in the first sensor data obtained by the i-th electronic device (i.e., the i-th first sensor data), the three-axis acceleration is (g ix , g iy , g iz ), i = 1, ..., n, n represents the total number of electronic devices in the motion sickness prevention system, n ≥ 1, gi x , g iv , g iz They represent the acceleration of the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system. Based on this, the fused three-axis acceleration can be expressed as (g x , g y , g z ), g x , g v, g z As shown in the following formula (1).

[0174]

[0175] Among them, w v Represents the weight corresponding to the vehicle, w i Represents the weight corresponding to the i-th electronic device. According to the description of the foregoing embodiment, the first and second sensor data can indirectly represent the user's motion information (hereinafter described as simulated motion information). When setting the weights corresponding to the vehicle and various types of electronic devices (such as mobile phones, smart watches, etc.), the user's real motion information can be obtained, and then the deviation between the real motion information and the above-mentioned simulated motion information is obtained, and the weight is set according to the deviation. Specifically, if the deviation is smaller, the more accurate the simulated motion information is, the greater the weight; conversely, the smaller the weight. This method can be used to set the weights corresponding to the vehicle and various types of electronic devices. When it is necessary to obtain the weight corresponding to the i-th electronic device, the type of the i-th electronic device can be obtained, and then the weight corresponding to the type can be obtained.

[0176] Step S1022: performing weighted average calculation on the three-axis angular velocity in the second sensor data and the first sensor data to obtain a fused three-axis angular velocity.

[0177] Specifically, if the three-axis angular velocity in the second sensor data is set to (R vx , R vy , R vz ), R vx , R vy , R vz Respectively represent the angular velocity of the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system; in the first sensor data obtained by the i-th electronic device (i.e., the i-th first sensor data), the three-axis acceleration is (R ix , R iy , R iz ), i = 1, ..., n, n represents the total number of electronic devices in the anti-motion sickness system, n ≥ 1, R ix , R iy , R iz Respectively represent the acceleration of the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system. Based on this, the fused three-axis acceleration can be expressed as (R x , R y , R z ), R x , R y , R z As shown in the following formula (2).

[0178]

[0179] Among them, wv 、w i The meaning of is the same as w in formula (1) v 、w i have the same meaning.

[0180] Step S1023: Acquire fused data according to the fused three-axis acceleration and three-axis angular velocity. Specifically, the fused three-axis acceleration and three-axis angular velocity are combined to form fused data.

[0181] In the method described in the above steps S1021 to S1023, the fusion data is obtained by weighted average calculation, and the weights corresponding to the first and second sensor data can be flexibly changed, thereby adjusting the proportion of the first and second sensor data in the fusion data, and further improving the accuracy of using the fusion data to represent the user's motion information.

[0182] In some implementations of the above step S102, the first and second sensor data may be fused to form fused data through the following steps 11 to 13.

[0183] Step 11: Filter the first sensor data and the second sensor data.

[0184] Specifically, a conventional data filtering method may be used for filtering, for example, a Kalman filtering method may be used for filtering.

[0185] In some implementations, data complementation may be performed on the first and second sensor data after filtering to further improve the accuracy of the first and second sensor data.

[0186] Specifically, for any one of the first and second sensor data, the data of each axis (including the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system) in the current sensor data (hereinafter described as the first data) are respectively detected to see if there is any obvious abnormality or missing; if there is any obvious abnormality in the data of the current axis in the current sensor data, the data of the current axis in other sensor data (hereinafter described as the second data) is obtained; if there is no obvious abnormality in the second data, the first data is replaced with the second data; if there is any missing data in the current sensor data, the second data without obvious abnormality is used as the data of the current axis in the current sensor data.

[0187] When detecting whether the data of the current axis is obviously abnormal, the detection can be performed in the following manner: for the three-axis acceleration of the current axis, the acceleration of each axis is compared in magnitude. If the deviation between the acceleration of one axis (hereinafter described as the first axis) and the acceleration of the other two axes (hereinafter described as the second axis) is relatively large, it is determined that the acceleration of the first axis is obviously abnormal. Similarly, for the three-axis angular velocity of the current axis, the angular velocity of each axis is compared in magnitude. If the deviation between the angular velocity of one axis (hereinafter described as the third axis) and the angular velocity of the other two axes (hereinafter described as the fourth axis) is relatively large, it is determined that the angular velocity of the third axis is obviously abnormal.

[0188] When judging whether the deviation is relatively large, a deviation threshold can be set. If the deviation is greater than the deviation threshold, it is determined that the deviation is relatively large. When setting the deviation threshold, technical personnel in this field can perform statistical analysis on the deviations between data that do not show obvious abnormalities (i.e., normal data), obtain the largest deviation, and set the deviation threshold based on the largest deviation.

[0189] Step 12: Fusing the filtered first sensor data and the second sensor data to form first fused data. Specifically, the fusion may be performed using the method described in steps S1021 to S1023, and the fusion result is used as the initial fused data.

[0190] Step 13: Perform Kalman filtering on the first fused data to obtain second fused data. Step 14: Use a preset data filtering model to filter the second fused data to obtain third fused data, where the data filtering model is a pre-trained deep learning model. Step 15: Obtain final fused data based on the third fused data.

[0191] In this embodiment, a conventional deep learning-based filtering method can be used to train a deep learning model with data filtering capabilities, and the model can be used as a data filtering model. For example, a time series signal composed of sensor data at multiple moments can be obtained, and the time series signal can be used to train the deep learning model, so that the deep learning model can mine the change characteristics of the sensor data in the time series signal, and can use the change characteristics to identify noise data and remove the noise data. This embodiment does not specifically limit the specific structure and training method of the data filtering model, as long as the data filtering model can be used to complete the data filtering.

[0192] Based on the methods described in steps 11 to 15 above, filtering can be performed before and after data fusion, and the accuracy of the fused data can be further improved by multiple filtering before and after.

[0193] 2. Explain step S103.

[0194] In some implementations of the above step S103, the first motion state of the user may be acquired through the following steps S1031 to S1033.

[0195] Step S1031: Perform a second integration of the three-axis acceleration in the fused data to obtain a three-axis translation (tx, ty, tz), where tx, ty, and tz represent the translation (or position) of the user on the X-axis, Y-axis, and Z-axis in the three-dimensional coordinate system, respectively. Specifically, integrating the three-axis acceleration once can obtain the three-axis velocity, and integrating the three-axis velocity once can obtain the three-axis translation.

[0196] Step S1032: Integrate the three-dimensional angular velocity in the fused data to obtain the three-axis angles (rx, ry, rz), where rx, ry, and rz represent the rotation angles (or postures) of the user on the X-axis, Y-axis, and Z-axis of the three-dimensional coordinate system, respectively.

[0197] Step S1033: Obtain the first motion state according to the three-axis translation (tx, ty, tz) and the three-axis angle (rx, ry, rz). The three-axis translation (tx, ty, tz) can be understood as the position of the user in the three-dimensional coordinate system, and the three-axis angle (rx, ry, rz) can be understood as the posture of the user in the three-dimensional coordinate system. The first motion state includes the three-axis translation (tx, ty, tz) and the three-axis angle (rx, ry, rz). Therefore, the first motion state can be understood as the posture of the user in the three-dimensional coordinate system.

[0198] Based on the method described in steps S1031 to S1033 above, the user's posture can be acquired conveniently and accurately, and the user's motion state can be represented by the posture.

[0199] 3. Explain step S104.

[0200] In some implementations of the above step S104, the user's first motion state includes three-axis translation (tx, ty, tz) and three-axis angle (rx, ry, rz), tx, ty, tz respectively represent the user's translation of the X axis, Y axis, and Z axis in the three-dimensional coordinate system, and rx, ry, rz respectively represent the user's rotation angle of the X axis, Y axis, and Z axis in the three-dimensional coordinate system. Based on this, in this implementation, the vehicle and / or electronic device can be respectively Figure 5 The following steps S1041 to S1043 are shown to determine the second motion state of the preset animation element on the respective display interface.

[0201] Step S1041: According to (tx, ty) in the three-axis translation (tx, ty, tz), obtain the position information of the preset animation element when it is displayed on the display interface.

[0202] The display interfaces of vehicles and electronic devices are all two-dimensional display interfaces. According to (tx, ty), the two-dimensional coordinates of the preset animation elements on the display interface can be obtained, and the two-dimensional coordinates are used as the position information. Specifically, the conversion relationship between the aforementioned three-dimensional coordinate system and the image coordinate system of the display interface on the vehicle or electronic device can be obtained, and then (tx, ty) can be converted from the above-mentioned three-dimensional coordinate system to the above-mentioned image coordinate system according to the conversion relationship to obtain the two-dimensional coordinates of the preset animation elements in the above-mentioned image coordinate system, and the two-dimensional coordinates are used as the position information. Among them, the above-mentioned conversion relationship is a pre-set conversion relationship. When it is necessary to obtain the position information of the preset animation element when it is displayed on the display interface, the conversion relationship can be directly called.

[0203] Step S1042: According to (rx, ry) of the three-axis angles (rx, ry, rz), the posture information of the preset animation element when displayed on the display interface is obtained.

[0204] According to (rx, ry), the two-dimensional posture (i.e., the rotation angle of the X-axis and the Y-axis) of the preset animation element on the display interface can be obtained, and the two-dimensional posture is used as the posture information. Specifically, the conversion relationship between the aforementioned three-dimensional coordinate system and the image coordinate system of the display interface on the vehicle or electronic device can also be obtained, and then (rx, ry) can be converted from the above three-dimensional coordinate system to the above image coordinate system according to the conversion relationship to obtain the two-dimensional posture of the preset animation element in the above image coordinate system, and the two-dimensional posture is used as the posture information.

[0205] Step S1043: Acquire the second motion state according to the position information and the posture information.

[0206] According to the description of the above steps, the second motion state is actually obtained by transforming the coordinate system of the first motion state. Therefore, the second motion state can simulate the first motion state, and there will be no conflict between the first and second motion states.

[0207] Based on the method described in steps S1041 to S1043 above, the second motion state of the preset animation element on the two-dimensional display interface can be obtained conveniently and accurately by utilizing the two-dimensional translation and the two-dimensional angle in the first motion state.

[0208] In some implementations of the above step S104, when the motion sickness compensation animation is generated according to the second motion state of the preset animation element, the motion sickness compensation animation may also be generated through the following steps S1044 to S1045.

[0209] Step S1044: According to tz in the three-axis translation (tx, ty, tz), obtain the size of the preset animation element when it is displayed on the display interface, and the size is positively correlated with the absolute value of tz. The absolute value of tz can represent the degree of up and down bumps endured by the user. The larger the absolute value of tz, the greater the bumps, and the smaller the absolute value of tz, the smaller the bumps. When the size of the preset animation element is positively correlated with the absolute value of tz, the larger the absolute value of tz, the larger the size, that is, the greater the bumps, the larger the size; the smaller the absolute value of tz, the smaller the size, that is, the smaller the bumps, the smaller the size. Based on this, the size of the preset animation element can be used to represent the degree of up and down bumps of the user.

[0210] Step S1045: Generate a motion sickness compensation animation according to the preset animation element, the second motion state and the size, that is, in the motion sickness compensation animation, the second motion state and the size of the preset animation element change simultaneously with the first motion state of the user. Based on this, the motion sickness compensation animation can more realistically reflect the user's motion state.

[0211] Based on the method described in steps S1044 to S1045 above, the compensation effect of the motion sickness compensation animation can be further improved, so that the user can accurately feel his or her own movement state through vision, thereby reducing the user's motion sickness when riding.

[0212] The following is a description of an embodiment of the anti-motion sickness method provided by the present application.

[0213] In some embodiments according to the present application, the electronic device may include a wearable device and a mobile device, and the wearable device is provided with a biological sign collection module, and the biological sign collection module is used to collect biological signs of the human body, including but not limited to body impedance, blood oxygen, blood pressure, heart rate, etc. When a user wears or wears the wearable device, the wearable device can collect the user's biological signs through the biological sign collection module.

[0214] In this embodiment, the biological sign acquisition module can use conventional biological sign acquisition methods to acquire biological signs of the human body, and this embodiment does not specifically limit the implementation method of the biological sign acquisition module. For example, the biological sign acquisition module can be configured to use photoplethysmography (PPG) to acquire PPG signals of the human body, and to acquire electrocardiogram (ECG) signals of the human body, and to acquire blood oxygen, blood pressure and heart rate according to the PPG signals and ECG signals. The biological sign acquisition module can be configured to use body impedance analysis (BIA) to acquire body impedance of the human body.

[0215] In some embodiments of the present application, the wearable device can detect whether the user is motion sickness, and actively enter the motion sickness compensation mode when the user is motion sickness, and send instructions to the vehicle and mobile device so that the vehicle and mobile device can also actively enter the motion sickness compensation mode.

[0216] Specifically, wearable devices can be Figure 6 The following steps S201 to S202 are used to detect whether the user is motion sickness and determine whether to actively enter the motion sickness compensation mode based on this.

[0217] Step S201: The wearable device obtains the body impedance collected by the biological sign collection module, and determines the user's motion sickness state according to the body impedance. Specifically, if the body impedance is less than a first threshold, the motion sickness state is motion sickness; otherwise, the motion sickness state is not motion sickness.

[0218] The inventors of the present application have studied the body impedance of a human body when it is motion sick and when it is not motion sick and found that the body impedance of a human body will be significantly reduced when it is motion sick. Based on this, in this embodiment, body impedance is used to detect whether the user is motion sick. When setting the first threshold, those skilled in the art can obtain the body impedances of a large number of different users when they are motion sick, and obtain the maximum body impedance from these body impedances, and set the value of the first threshold according to the maximum body impedance.

[0219] Step S202: When the motion sickness state is motion sickness, the wearable device enters the motion sickness compensation mode and sends a first instruction to the vehicle and the mobile device, the first instruction being used to notify the vehicle and the mobile device to enter the motion sickness compensation mode. When the motion sickness state is not motion sickness, the wearable device does not enter the motion sickness compensation mode, and does not send the first instruction to the vehicle and the mobile device.

[0220] The vehicle and the mobile device will enter the motion sickness compensation mode after receiving the first command.

[0221] Based on the method described in steps S201 to S202 above, the user does not need to operate the vehicle and the electronic device. The vehicle and the electronic device actively enter the motion sickness compensation mode when the user is motion sickness, thereby alleviating the user's motion sickness and further improving the user experience.

[0222] In some embodiments of the present application, the wearable device can be Figure 7 The following steps S203 to S205 are shown to detect the user's motion sickness level and determine whether to play soothing music based on the level, so as to further alleviate the user's motion sickness.

[0223] Step S203: The wearable device acquires the target vital signs collected by the biological sign collection module, where the target vital signs include at least one of blood oxygen, blood pressure and heart rate.

[0224] The inventors of the present application studied the above-mentioned target signs when a person is motion sick and when not motion sick and found that the above-mentioned target signs will obviously become larger when a person is motion sick, and the higher the degree of motion sickness, the larger the above-mentioned target signs. Based on this, the above-mentioned target signs are used in the present embodiment to detect the degree of motion sickness of the user.

[0225] Step S204: When the motion sickness state is motion sickness, the wearable device determines the degree of motion sickness of the user according to the target physical sign. Specifically, if at least one target physical sign is greater than its corresponding second threshold, the degree of motion sickness is severe; otherwise, the degree of motion sickness is mild.

[0226] Blood oxygen, blood pressure and heart rate each correspond to a second threshold value, and if at least one of the blood oxygen, blood pressure and heart rate is greater than the corresponding second threshold value, the degree of motion sickness is severe. When setting the value of the second threshold value of each target sign, those skilled in the art can obtain a large number of target signs of different users when they are motion sick, and obtain the minimum target sign from these target signs, and set the value of the second threshold value corresponding to the target sign according to the minimum target sign.

[0227] Step S205: When the degree of motion sickness is severe, the wearable device plays preset soothing music and sends a second instruction to the vehicle and the mobile device, the second instruction being used to notify the vehicle and the mobile device to play the preset soothing music. When the degree of motion sickness is mild, the wearable device does not play the preset soothing music, nor does it send the second instruction to the vehicle and the mobile device.

[0228] After receiving the second instruction, the vehicle and the mobile device will play the preset soothing music. Soothing music has the characteristics of soft melody, slow rhythm, etc. Soothing music helps users relax their nerves and relieve motion sickness. Soothing music is one or more pre-set music. When soothing music needs to be played, the preset soothing music can be directly called. This embodiment does not specifically limit the content of soothing music.

[0229] Based on the method described in steps S203 to S205 above, when the degree of motion sickness is severe, soothing music can be played to further alleviate the user's motion sickness.

[0230] The following is combined with Figure 8 The embodiment of the anti-motion sickness method provided by the present application is described. Figure 8 , Figure 8 The overall process of the anti-motion sickness method in one embodiment is exemplified, wherein the electronic device includes a mobile phone and a smart watch, and the smart watch is provided with a biological sign collection module. Figure 8 As shown, in this embodiment, the anti-motion sickness method includes the following steps S301 to S310.

[0231] Step S301: The mobile phone obtains first sensor data, and the first sensor data includes acceleration data and angular velocity data of the mobile phone. Step S302: The smart watch obtains first sensor data, and the first sensor data includes acceleration data and angular velocity data of the smart watch. Step S303: The vehicle obtains second sensor data, and the second sensor data includes acceleration data and angular velocity data of the vehicle. The vehicle is provided with a vehicle computer, and the vehicle computer is used to obtain the second sensor data. Step S304: The vehicle obtains fused data. Specifically, the vehicle computer in the vehicle executes the method described in step S102 in the aforementioned method embodiment, and fuses the first sensor data obtained by the mobile phone, the first sensor data obtained by the smart watch, and the second sensor data obtained by the vehicle computer to form fused data.

[0232] Step S305: The vehicle acquires the first motion state. Specifically, the vehicle computer in the vehicle executes the method described in step S103 in the above method embodiment to acquire the first motion state of the user.

[0233] Step S306: The user turns on the motion compensation animation display switch.

[0234] Specifically, the display interface of the mobile phone, smart watch and vehicle is provided with a motion compensation animation display switch. When the user turns on this switch, the mobile phone, smart watch and vehicle will enter the motion sickness compensation mode. In this embodiment, the user turns on the motion compensation animation display switch on the display interface of the mobile phone, and the mobile phone enters the motion sickness compensation mode. Since the motion compensation animation display switches of the smart watch and the vehicle are not turned on, the smart watch and the vehicle will not enter the motion sickness compensation mode at this time.

[0235] Step S307: Displaying motion sickness compensation animation.

[0236] Specifically, the mobile phone executes the related method of the electronic device in the aforementioned step S104 to generate a motion sickness compensation animation, and displays the motion sickness compensation animation on the display interface of the mobile phone.

[0237] Step S308: The smart watch obtains biological signs.

[0238] Biosigns include body impedance, blood oxygen, blood pressure, and heart rate.

[0239] Step S309: The smart watch determines the motion sickness state and degree.

[0240] Specifically, the smart watch executes the method described in the aforementioned steps S201 to S205 to determine the user's motion sickness state and degree of motion sickness according to the user's body impedance.

[0241] If the motion sickness state is motion sickness, the smart watch will enter the motion sickness compensation mode and will also send a first instruction to the mobile phone and the vehicle to notify the mobile phone and the vehicle to enter the motion sickness compensation mode. The mobile phone will execute the relevant method of the electronic device in the aforementioned step S104 to generate a motion sickness compensation animation, and display the motion sickness compensation animation on the display interface of the mobile phone; the vehicle will execute the relevant method of the vehicle in the aforementioned step S104 to generate a motion sickness compensation animation, and display the motion sickness compensation animation on the display interface of the vehicle. It should be noted that if the user has controlled the mobile phone and the vehicle to enter the motion sickness compensation mode by turning on the motion compensation animation display switch, then the mobile phone and the vehicle will remain in the motion sickness compensation mode after receiving the first instruction.

[0242] Furthermore, if the degree of motion sickness is severe, the smart watch will play soothing music while displaying the motion sickness compensation screen, and will also send a second instruction to the mobile phone and the vehicle to notify the mobile phone and the vehicle to play soothing music. The mobile phone and the vehicle will play soothing music after receiving the second instruction.

[0243] In some embodiments, the vehicle, mobile phone, and smart watch are respectively provided with a SOC (System on Chip) device, and the vehicle, mobile phone, and smart watch can execute the relevant steps in the above method by their respective SOC devices.

[0244] Based on the method described in steps S301 to S310 above, a communication connection can be established between the vehicle, the mobile phone and the smart watch to form an anti-motion sickness system, and the anti-motion sickness system can be used to display motion sickness compensation animations on the display interfaces of the vehicle, the mobile phone and / or the smart watch to prevent or alleviate the user's motion sickness, and soothing music can be played when the user suffers from severe motion sickness to further alleviate the user's motion sickness.

[0245] The following is a description of an embodiment of the anti-motion sickness method provided by the present application.

[0246] In the embodiment provided by the present application, the anti-motion sickness method is applied to an electronic device, which is an electronic device of a user in a vehicle. The electronic device is connected to the vehicle in communication, and an anti-motion sickness system can be formed by connecting the electronic device to the vehicle in communication. Fig. 9 , Fig. 9 FIG. 1 is a flow chart of the main steps of the motion sickness prevention method according to an embodiment of the present application. Fig. 9 As shown, the anti-motion sickness method in the embodiment of the present application mainly includes the following steps S401 to S404.

[0247] Step S401: Acquire first sensor data and send the first sensor data to the vehicle. The first sensor data includes acceleration data and angular velocity data of the electronic device.

[0248] Step S402: receiving the first motion state of the user sent by the vehicle.

[0249] The first motion state is obtained by the vehicle according to fusion data, and the fusion data is formed by the vehicle fusing the first sensor data and the second sensor data, and the second sensor data includes acceleration data and angular velocity data of the vehicle.

[0250] Step S403: When the electronic device is in the motion sickness compensation mode, a second motion state of the preset animation element on the display interface of the electronic device is determined according to the first motion state.

[0251] The second motion state is used to simulate the first motion state.

[0252] Step S404: generating a motion sickness compensation animation according to the preset animation element and the second motion state, and displaying the motion sickness compensation animation on the display interface.

[0253] It should be noted that the implementation method of the above steps is the same as the implementation method of the relevant steps performed by the electronic device in the aforementioned method embodiment, and for the sake of brevity, it will not be repeated here.

[0254] Based on the methods described in steps S401 to S404 above, the electronic device can establish a communication connection with the vehicle, utilize the vehicle to obtain the user's first motion state, and display a motion sickness compensation animation on its own display interface based on the first motion state to prevent or alleviate the user's motion sickness.

[0255] In some embodiments, the electronic device may also enter the motion sickness compensation mode in response to a user operation on the electronic device. A control for user operation may be provided on the display interface of the electronic device, and the user may click, slide, drag, etc. on the control, and the electronic device may enter the motion sickness compensation mode after detecting the operation.

[0256] In some embodiments, the electronic device may include a wearable device and a mobile device, and the wearable device is provided with a biological sign collection module, which has the same meaning as the biological sign collection module in the aforementioned method embodiment. The wearable device may execute the method described in steps S201 to S202 in the aforementioned method embodiment, or may execute the method described in steps S203 to S205 in the aforementioned method embodiment.

[0257] It should be pointed out that although the various steps in the above embodiments are described in a specific order, those skilled in the art can understand that in order to achieve the effect of the present application, different steps do not have to be executed in such an order. They can be executed simultaneously (in parallel) or in other orders. These adjusted schemes are equivalent to the technical schemes described in this application, and therefore will also fall within the scope of protection of this application.

[0258] It is understood by those skilled in the art that all or part of the processes in the method for implementing the above-mentioned embodiment of the present application can also be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device, medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory, random access memory, electrical carrier signal, telecommunication signal and software distribution medium, etc. that can carry the computer program code.

[0259] Another aspect of the present application also provides a computer-readable storage medium.

[0260] In an embodiment of a computer-readable storage medium according to the present application, the computer-readable storage medium may be configured to store a program for executing the anti-motion sickness method of the above method embodiment, and the program may be loaded and run by at least one processor to implement the anti-motion sickness method described in the above method embodiment. For ease of explanation, only the parts related to the embodiment of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present application. The computer-readable storage medium may be a storage device formed by various electronic devices. Optionally, the computer-readable storage medium in the embodiment of the present application is a non-transitory computer-readable storage medium.

[0261] Another aspect of the present application provides an electronic device.

[0262] In an embodiment of an electronic device according to the present application, the electronic device is provided with a sensor module, and the sensor module is used to collect acceleration data and angular velocity data of the electronic device. The electronic device may also include at least one processor; and a memory connected to the at least one processor in communication; wherein a computer program is stored in the memory, and when the computer program is executed by the at least one processor, the anti-motion sickness method applied to the electronic device in the aforementioned method embodiment is implemented. Fig.10 , Fig.10FIG. 4 exemplarily shows that the memory 11 and the processor 12 are communicatively connected via a bus.

[0263] Another aspect of the present application also provides an anti-motion sickness system, which may include a vehicle and an electronic device of a user in the vehicle, wherein the electronic device and the vehicle are in communication connection, and the system is used to execute the anti-motion sickness method applied to the anti-motion sickness system in the aforementioned method embodiment. Figure 1 In some embodiments, the electronic device is a mobile phone, which is communicatively connected to the vehicle. A motion sickness compensation animation can be displayed on the display interface of the mobile phone and / or the vehicle to prevent or relieve the user's motion sickness. The mobile phone and / or the vehicle can also play preset soothing music when the user suffers from severe motion sickness to further relieve the user's motion sickness.

[0264] So far, the technical solution of the present application has been described in conjunction with an embodiment shown in the accompanying drawings, but it is easy for those skilled in the art to understand that the protection scope of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present application.

Claims

1. A method for preventing motion sickness, characterized in that: The method is applied to an anti-motion sickness system, the system comprising a vehicle and an electronic device of a user in the vehicle, the electronic device being communicatively connected with the vehicle, and the method comprising: The electronic device acquires first sensor data and sends the first sensor data to the vehicle, wherein the first sensor data includes acceleration data and angular velocity data of the electronic device; The vehicle acquires second sensor data, fuses the second sensor data with the first sensor data to form fused data, acquires a first motion state of a user according to the fused data, and sends the first motion state to the electronic device, wherein the second sensor data includes acceleration data and angular velocity data of the vehicle; When the vehicle and / or the electronic device is in a motion sickness compensation mode, the vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on a respective display interface according to the first motion state, and respectively generate a motion sickness compensation animation according to the preset animation element and the second motion state of the preset animation element on the respective display interface, and display the motion sickness compensation animation on the respective display interface; The second motion state is used to simulate the first motion state.

2. The method according to claim 1, characterized in that The acceleration data of the electronic device and the vehicle both include three-axis acceleration, the angular velocity data of the electronic device and the vehicle both include three-axis angular velocity, the three-axis acceleration includes acceleration of an X-axis, a Y-axis, and a Z-axis in a three-dimensional coordinate system, the three-axis angular velocity includes angular velocity of the X-axis, the Y-axis, and the Z-axis, and the fusing of the second sensor data and the first sensor data to form fused data includes: Performing weighted average calculation on the three-axis acceleration in the second sensor data and the first sensor data to obtain a fused three-axis acceleration; Performing weighted average calculation on the three-axis angular velocity in the second sensor data and the first sensor data to obtain a fused three-axis angular velocity; The fused data is obtained according to the fused three-axis acceleration and three-axis angular velocity.

3. The method according to claim 2, characterized in that The acquiring the first motion state of the user according to the fusion data includes: Performing a second integration of the three-axis acceleration in the fused data to obtain a three-axis translation (tx, ty, tz), where tx, ty, and tz represent the translation of the user on the X-axis, Y-axis, and Z-axis, respectively; Integrate the three-dimensional angular velocity in the fused data once to obtain the three-axis angle (rx, ry, rz), where rx, ry, and rz represent the rotation angles of the user on the X-axis, Y-axis, and Z-axis, respectively; The first motion state is acquired according to the three-axis translation (tx, tyu, tz) and the three-axis angle (rx, ry, rz).

4. The method according to any one of claims 1 to 3, characterized in that The first motion state includes three-axis translation (tx, ,tz) and three-axis angle (rx, ry, rz), tx, ty, tz respectively represent the translation of the user on the X axis, Y axis, and Z axis in the three-dimensional coordinate system, and rx, ry, rz respectively represent the rotation angle of the user on the X axis, Y axis, and Z axis. The vehicle and / or the electronic device respectively determine a second motion state of a preset animation element on a respective display interface according to the first motion state, including: According to (tx, ty) in the three-axis translation (tx, ty, tz), obtaining position information of the preset animation element when displayed on the display interface; According to (rx, ry) of the three-axis angles (rx, ry, rz), acquiring posture information of the preset animation element when displayed on the display interface; The second motion state is acquired according to the position information and the posture information.

5. The method according to any one of claims 1 to 3, characterized in that The first motion state includes three-axis translation (tx, ty, tz), where tx, ty, and tx respectively represent translations of the user along an X-axis, a Y-axis, and a Z-axis in a three-dimensional coordinate system, and the generating of motion sickness compensation animations according to the preset animation elements and the second motion states of the preset animation elements on their respective display interfaces includes: According to tz in the three-axis translation (tx, ty, tz), the size of the preset animation element when displayed on the display interface is obtained, and the size is positively correlated with the absolute value of tz; The motion sickness compensation animation is generated according to the preset animation element, the second motion state and the size.

6. The method according to claim 1, characterized in that The electronic device includes a wearable device and a mobile device, the wearable device is provided with a biological sign collection module, and the biological sign collection module is used to collect biological signs of a human body. The method also includes the vehicle and the electronic device entering the motion sickness compensation mode in the following manner: The wearable device acquires the body impedance collected by the biological sign collection module, and determines the motion sickness state of the user according to the body impedance; if the body impedance is less than a first threshold, the motion sickness state is motion sickness; otherwise, the motion sickness state is not motion sickness; When the motion sickness state is motion sickness, the wearable device enters the motion sickness compensation mode and sends a first instruction to the vehicle and the mobile device, where the first instruction is used to notify the vehicle and the mobile device to enter the motion sickness compensation mode.

7. The method according to claim 6, characterized in that The method further comprises: The wearable device acquires the target physical sign collected by the biological sign collection module, where the target physical sign includes at least one of blood oxygen, blood pressure and heart rate; When the motion sickness state is motion sickness, the wearable device determines the degree of motion sickness of the user according to the target physical sign; if at least one of the target physical signs is greater than its corresponding second threshold, the degree of motion sickness is severe; otherwise, the degree of motion sickness is mild; When the degree of motion sickness is severe, the wearable device plays preset soothing music and sends a second instruction to the vehicle and the mobile device, where the second instruction is used to notify the vehicle and the mobile device to play the preset soothing music.

8. A method for preventing motion sickness, characterized in that: Applied to an electronic device, the electronic device is an electronic device of a user in a vehicle, the electronic device is communicatively connected with the vehicle, and the method comprises: Acquire first sensor data and send the first sensor data to the vehicle, the first sensor data including acceleration data and angular velocity data of the electronic device; Receiving a first motion state of a user sent by the vehicle; When the electronic device is in a motion sickness compensation mode, determining a second motion state of a preset animation element on a display interface of the electronic device according to the first motion state, wherein the second motion state is used to simulate the first motion state; generating a motion sickness compensation animation according to the preset animation element and the second motion state, and displaying the motion sickness compensation animation on the display interface; in, The first motion state is obtained by the vehicle according to fusion data, and the fusion data is formed by the vehicle fusing the first sensor data and second sensor data, and the second sensor data includes acceleration data and angular velocity data of the vehicle.

9. The method according to claim 8, characterized in that The first motion state includes three-axis translation (tx, ty, tz) and three-axis angle (rx, ry, rz), tx, ty, tz respectively represent the translation of the user on the X axis, Y axis, and Z axis in the three-dimensional coordinate system, and rx, ty, rz respectively represent the rotation angle of the user on the X axis, Y axis, and Z axis, and the second motion state of the preset animation element on the display interface of the electronic device according to the first motion state includes: According to (tx, ty) in the three-axis translation (tx, ty, tz), obtaining position information of the preset animation element when displayed on the display interface; According to (rx, ry) of the three-axis angles (rx, ry, rz), acquiring posture information of the preset animation element when displayed on the display interface; The second motion state is acquired according to the position information and the posture information.

10. The method according to claim 9, characterized in that The first motion state includes three-axis translation (tx, ty, tz), where tx, ty, and tz respectively represent translations of the user along an X-axis, a Y-axis, and a Z-axis in a three-dimensional coordinate system, and generating a motion sickness compensation animation according to the preset animation element and the second motion state includes: According to tz in the three-axis translation (tx, ty, tz), the size of the preset animation element when displayed on the display interface is obtained, and the size is positively correlated with the absolute value of tz; The motion sickness compensation animation is generated according to the preset animation element, the second motion state and the size.

Images