Scene reproduction method, vehicle terminal and vehicle
By collecting and integrating environmental images and parameters in the vehicle, generating historical document data, and reproducing it on display devices and environmental control devices, the problem of vehicles being unable to record and reproduce specific location scenarios is solved, providing an immersive memory experience and enhancing the sense of technology.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- FUJITSU TEN RES & DEV TIANJIN
- Filing Date
- 2026-03-02
- Publication Date
- 2026-06-05
AI Technical Summary
Existing vehicles lack effective mechanisms for recording and reproducing specific locations and scenarios during operation, failing to meet users' needs for recalling specific travel experiences.
Images of the external environment and parameters of the internal environment are collected by image acquisition devices and sensors, historical document data is generated, and the images and environmental parameters are reproduced synchronously through display devices and environmental control devices during the reproduction process.
It achieves simultaneous reproduction of the vehicle's internal and external environment, enhancing the user's memory experience and emotional feelings, and improving the vehicle's technological feel and user satisfaction.
Smart Images
Figure CN122157390A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of intelligent vehicle technology, and in particular to a scene reproduction method, an in-vehicle terminal, a vehicle, a computer-readable medium, and a computer program product. Background Technology
[0002] Currently, vehicles lack an effective mechanism for recording and reproducing specific location scenarios during operation. When a vehicle reaches a noteworthy location, it struggles to retain the current moment and location, including information such as the surrounding environment and the atmosphere inside the vehicle. Furthermore, these records cannot be recreated during subsequent use, failing to meet users' needs for recalling specific travel experiences. Summary of the Invention
[0003] In view of this, embodiments of the present invention provide a scene reproduction method, an in-vehicle terminal, a vehicle, a computer-readable medium, and a computer program product to solve the technical problems existing in the prior art.
[0004] To achieve the above objectives, according to one aspect of the present invention, a scene reproduction method is provided, comprising: In response to the user's recording command, the system obtains the vehicle's current historical location information and continuously collects environmental images around the vehicle as well as environmental parameters inside the vehicle. In response to the user's submission of a collection command, the system integrates and processes environmental images and parameters to obtain historical document data corresponding to historical location information, and saves the historical document data. In response to a user-submitted reproduction command, the system displays environmental images from historical document data on the in-vehicle display device, and simultaneously adjusts the current environmental parameters in the vehicle based on the environmental parameters in the historical document data.
[0005] Optionally, environmental images of the vehicle's surroundings and environmental parameters inside the vehicle are continuously acquired, including: The system continuously acquires images of the environment around the vehicle using image acquisition devices installed on the vehicle, and records the timestamps corresponding to each environmental image. At the same time, it acquires environmental parameters inside the vehicle using various sensors installed inside the vehicle, and records the timestamps corresponding to each environmental parameter.
[0006] Optionally, the environmental images and environmental parameters are integrated to obtain historical document data corresponding to historical location information, including: The environmental images and environmental parameters are sorted according to their timestamps to obtain the environmental image sequence and the environmental parameter sequence. Based on environmental image sequences and environmental parameter sequences, environmental images and environmental parameters with the same timestamp are integrated and processed to obtain historical document data corresponding to historical location information.
[0007] Optionally, in response to a user-submitted reproduction command, an environmental image from historical document data is displayed on a display device within the vehicle, and the current environmental parameters within the vehicle are adjusted based on the environmental parameters in the historical document data, including: In response to a user-submitted reproduction command, the system retrieves the target historical document data that corresponds to the target historical location information closest to the vehicle's current location information from various historical document data. The system displays environmental images from the target historical document data using in-vehicle display devices, and simultaneously adjusts the current environmental parameters within the vehicle based on the environmental parameters in the target historical document data.
[0008] Optionally, in response to a user-submitted reproduction command, an environmental image from historical document data is displayed on a display device within the vehicle, and the current environmental parameters within the vehicle are adjusted based on the environmental parameters in the historical document data, including: In response to a user-submitted command to reproduce target historical document data, the system displays an environmental image from the target historical document data on the in-vehicle display device, and simultaneously adjusts the current environmental parameters in the vehicle based on the environmental parameters in the target historical document data.
[0009] Optionally, in response to a user-submitted reproduction command, an environmental image from historical document data is displayed on a display device within the vehicle, and the current environmental parameters within the vehicle are adjusted based on the environmental parameters in the historical document data, including: During vehicle operation, the system acquires the vehicle's current location information in real time and determines whether there is any historical location information of a target that is less than or equal to the distance threshold of the vehicle's current location information. If so, the system prompts the user whether to reproduce the scene. In response to a user-submitted reproduction command, retrieve the target historical document data corresponding to the target's historical location information; The system displays environmental images from the target historical document data using in-vehicle display devices, and simultaneously adjusts the current environmental parameters within the vehicle based on the environmental parameters in the target historical document data.
[0010] According to another aspect of the present invention, a vehicle-mounted terminal is also provided, comprising: One or more processors; Storage device for storing one or more programs. When one or more programs are executed by one or more processors, the one or more processors implement the methods of any of the above embodiments.
[0011] According to another aspect of the present invention, a vehicle is also provided, the vehicle including a body and an in-vehicle terminal as described in the above embodiments, the in-vehicle terminal being disposed on the vehicle body.
[0012] According to another aspect of the present invention, a computer-readable medium is also provided, on which a computer program is stored, which, when executed by a processor, implements the methods of any of the above embodiments.
[0013] According to another aspect of the present invention, a computer program product is also provided, including a computer program that, when executed by a processor, implements the method of any of the above embodiments.
[0014] One embodiment of the above invention has the following advantages or beneficial effects: The scene reproduction method provided by this invention collects environmental images outside the vehicle and environmental parameters inside the vehicle through image acquisition devices and sensors, and integrates these data into historical document data for storage. During reproduction, based on the image data and environmental parameters in the historical document data, the display device and environmental adjustment device inside the vehicle are controlled respectively to achieve synchronous reproduction of images and environment, thereby allowing the user to experience the scene and feeling at that time.
[0015] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description
[0016] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein: Figure 1 This is a flowchart of a scene reproduction method according to the first embodiment of the present invention; Figure 2 This is a flowchart of a scene reproduction method according to a second embodiment of the present invention; Figure 3 This is a flowchart of a scene reproduction method according to a third embodiment of the present invention; Figure 4 This is a flowchart of a scene reproduction method according to the fourth embodiment of the present invention; Figure 5 This is a flowchart of a scene reproduction method according to the fifth embodiment of the present invention; Figure 6 This is an exemplary vehicle system architecture diagram to which embodiments of the present invention can be applied; Figure 7 This is an exemplary overall system architecture diagram in which embodiments of the present invention can be applied. Detailed Implementation
[0017] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.
[0018] It should be noted that the collection, analysis, use, transmission, and storage of user personal information involved in the technical solution of this invention all comply with relevant laws and regulations, are used for legitimate and reasonable purposes, and are not shared, disclosed, or sold outside of these legitimate uses, and are subject to supervision and management by regulatory authorities. Necessary measures should be taken to prevent unauthorized access to such personal information data, ensure that personnel authorized to access personal information data comply with relevant laws and regulations, and ensure the security of user personal information. Once this user personal information data is no longer needed, the risk should be minimized by restricting or even prohibiting data collection and / or deleting the data.
[0019] Figure 1 This is a flowchart of a scene reproduction method according to a first embodiment of the present invention. As one embodiment of the present invention, such as... Figure 1 As shown, the method for reproducing this scene may include: In step S101, in response to the user's submitted recording instruction, the vehicle's current historical location information is obtained, and environmental images around the vehicle and environmental parameters inside the vehicle are continuously collected.
[0020] Step S101 is the recording stage. In this step, in response to the user's recording instruction, the vehicle's current historical location information is obtained, and from this moment on, environmental images around the vehicle and environmental parameters inside the vehicle are continuously collected at a preset cycle. For example, environmental images around the vehicle can be collected by a camera installed on the vehicle, while environmental parameters inside the vehicle can be collected by various sensors installed on the vehicle. Optionally, environmental parameters can be one or more of the following: temperature, humidity, fragrance, music, etc.
[0021] It should be noted that if the vehicle is in motion and the vehicle system receives a recording instruction submitted by the user, it will obtain the vehicle's current location information upon receiving the instruction and use this location information as the vehicle's current historical location information. The vehicle's location information will not be obtained again afterward.
[0022] When a driver arrives at a location (such as a tourist attraction, memorial hall, or amusement park), the vehicle's infotainment system will activate its recording function if the driver (or another passenger) presses the record button. Specifically, the system acquires the vehicle's current location information (i.e., the location of the tourist attraction, memorial hall, or amusement park) as historical location information. Simultaneously, the vehicle's cameras begin capturing images of the surrounding environment, and the infotainment system uses various sensors to synchronously collect environmental parameters inside the vehicle, such as temperature, fragrance, and music. The cameras are high-definition wide-angle cameras, capable of clearly and comprehensively capturing images of the vehicle's surroundings. The infotainment system uses various sensors to collect various environmental parameters inside the vehicle, ensuring data accuracy and real-time performance.
[0023] Optionally, the system continuously collects environmental images of the vehicle's surroundings and environmental parameters inside the vehicle. This includes: continuously collecting environmental images of the vehicle's surroundings using image acquisition devices installed on the vehicle and recording the timestamps corresponding to each environmental image; simultaneously, collecting environmental parameters inside the vehicle using various sensors installed inside the vehicle and recording the timestamps corresponding to each environmental parameter. For example, when the driver drives the vehicle to a certain location, if the driver (or another passenger in the vehicle) presses the record button, the vehicle's infotainment system obtains the vehicle's current location information as historical location information. At this time, a high-definition camera installed outside the vehicle begins to collect environmental images of the vehicle's surroundings at a rate of 30 frames per second and records the timestamps corresponding to each environmental image. Simultaneously, the vehicle's infotainment system synchronously collects environmental parameters inside the vehicle, such as temperature, fragrance type, and currently playing music information, through temperature sensors, fragrance sensors, and a music playback system, and records the timestamps corresponding to each environmental parameter. The temperature sensor can accurately measure the temperature inside the vehicle; the fragrance sensor can accurately identify the type and concentration of fragrance; and the music playback system records information such as the name, artist, and volume of the currently playing music.
[0024] Step S102: In response to the user's submitted collection instruction, the environmental image and environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, and the historical document data is saved.
[0025] Step S102 is the saving stage. In this step, in response to the user's submitted save command, the environmental image and environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, and the historical document data is saved. When the driver (or other passengers in the vehicle) presses the save button, the vehicle system integrates and processes the collected image data and environmental parameters to generate a document containing key information (mainly image data and environmental parameters) for a specific location. This document serves as the historical document data corresponding to the historical location information, and is saved to the vehicle's storage device or uploaded to the cloud. It should be noted that the storage device has a large storage capacity and stable data read / write performance to ensure secure document storage and fast retrieval.
[0026] Understandably, repeating steps S101 and S102 yields various historical location information and their corresponding historical document data; that is, each historical location information corresponds to one historical document data. The historical document data records environmental images of the vehicle's surroundings and environmental parameters inside the vehicle collected between the user submitting a record instruction and the user submitting a favorite instruction. This data is stored as a single historical document for future scene reproduction.
[0027] In the embodiments of the present invention, the specific location is user-defined and refers to the location of the vehicle when the vehicle system receives the recording instruction submitted by the user in step S101, which is the historical location information. It can be a tourist attraction, memorial hall, amusement park, or any other arbitrary location. The embodiments of the present invention do not limit this.
[0028] Optionally, the environmental images and environmental parameters are integrated to obtain historical document data corresponding to historical location information. This includes: sorting each environmental image and each environmental parameter according to its timestamp to obtain an environmental image sequence and an environmental parameter sequence; and integrating environmental images and parameters with the same timestamp based on the environmental image sequence and environmental parameter sequence to obtain historical document data corresponding to historical location information. It should be noted that the acquisition period for environmental images and the acquisition period for environmental parameters are preferably the same, which facilitates the integration of environmental images and parameters with the same timestamp. That is, in the historical document data, each timestamp corresponds to one environmental image and one set of environmental parameters, and these data are sorted sequentially by timestamp to facilitate scene reproduction in a sequential manner.
[0029] Optionally, when the driver (or another passenger) presses the save button, the vehicle's infotainment system integrates and processes the collected environmental images and parameters to generate an encrypted historical document, which is then saved to the vehicle's high-capacity storage device or uploaded to the cloud. The storage device uses a solid-state drive (SSD) to ensure fast data storage and stable retrieval. The historical document data can be encrypted using encryption algorithms to guarantee data security and privacy.
[0030] In step S103, in response to the user's submitted reproduction command, the environmental image in the historical document data is displayed through the display device in the vehicle, and the current environmental parameters in the vehicle are adjusted according to the environmental parameters in the historical document data.
[0031] Step S103 is the reproduction stage. In this step, in response to the user's submitted reproduction command, environmental images from the historical document data are displayed through the vehicle's display device (such as an in-vehicle display screen or a holographic projection device). Simultaneously, the current environmental parameters within the vehicle are adjusted based on the environmental parameters in the historical document data. It should be noted that the environmental images are displayed sequentially from earliest to latest timestamp, and the environmental parameters are also adjusted sequentially from earliest to latest timestamp. Furthermore, environmental images and parameters with the same timestamp are displayed and adjusted synchronously.
[0032] When the driver (or another passenger) presses the "Replay Yesterday" button, the vehicle's infotainment system uses a holographic projection device to continuously display environmental images from historical data, projecting them into the car and showcasing the original environment. Simultaneously, the system adjusts parameters such as temperature, fragrance, and music based on these parameters to simulate the original scene. The holographic projection provides realistic imagery, making the user feel as if they are actually in the environment; the in-car climate control precisely regulates temperature, fragrance concentration, and music playback, achieving a highly realistic simulation.
[0033] For example, when a driver wants to recreate a scene from a tourist attraction, they press the "Yesterday Replay" button. The vehicle's infotainment system reads the corresponding historical data from its storage device, transmits the image data from that historical data to the holographic projection device, and projects it into the car for playback. Simultaneously, based on the environmental parameters in the historical data, it controls the car's climate control system to adjust the interior temperature to the temperature at that time, release the same type of fragrance, and play the music from that time, simulating the scene. If the interior temperature was 25°C, the fragrance was lavender, and the music playing was a soothing piano piece, then during the recreation, the climate control system will adjust the temperature to 25°C, release the lavender fragrance, and play the same piano piece.
[0034] Therefore, the scene reproduction method provided in this embodiment of the invention collects environmental images outside the vehicle and environmental parameters inside the vehicle through image acquisition devices and sensors, and integrates these data into historical document data for storage. During reproduction, based on the image data and environmental parameters in the historical document data, the display device and environmental adjustment device inside the vehicle are controlled respectively to achieve synchronous reproduction of images and environment, thereby allowing the user to experience the scene and feeling at that time.
[0035] Figure 2 This is a flowchart of a scene reproduction method according to a second embodiment of the present invention. As another embodiment of the present invention, such as... Figure 2 As shown, the method for reproducing this scene may include: In step S201, in response to the user's submitted recording instruction, the vehicle's current historical location information is obtained, and environmental images around the vehicle and environmental parameters inside the vehicle are continuously collected.
[0036] Step S202: In response to the user's submitted collection instruction, the environmental image and environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, and the historical document data is saved.
[0037] Step S203: In response to the user's submitted reproduction command, find the target historical document data corresponding to the target historical location information that is closest to the vehicle's current location information from various historical document data.
[0038] Step S204: Display the environmental image from the target historical document data through the display device inside the vehicle, and adjust the current environmental parameters inside the vehicle according to the environmental parameters in the target historical document data.
[0039] The recording and saving phases are similar to those in the above embodiments and will not be described again.
[0040] During the reproduction phase, in response to the user's reproduction command, the vehicle's current location information is obtained. Then, the target historical document data is retrieved from various historical document data sets, and the target historical location information corresponding to this target historical document data is closest to the vehicle's current location information. After retrieving the target historical document data from various historical document data sets, the environmental images and environmental parameters corresponding to each timestamp are obtained from the target historical document data. Then, the environmental images from the target historical document data are displayed through the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the target historical document data.
[0041] In this embodiment, the user can submit a reproduction command to the vehicle system when the vehicle is at any location. In response to the reproduction command submitted by the user, the vehicle system uses the historical document data corresponding to the historical location information closest to the current location information of the vehicle as the target historical document data, and reproduces the scene based on the target historical document data.
[0042] This invention provides users with a novel way of recalling memories by recording and recreating scenes at specific locations, enhancing their emotional experience. When using this function to recreate specific travel scenarios, users can clearly recall the situation and feelings at the time. Simultaneously, this function also enhances the vehicle's technological appeal and added value, increasing user satisfaction and loyalty.
[0043] Figure 3 This is a flowchart of a scene reproduction method according to a third embodiment of the present invention. As another embodiment of the present invention, such as... Figure 3 As shown, the method for reproducing this scene may include: In step S301, in response to the user's submitted recording instruction, the vehicle's current historical location information is obtained, and environmental images around the vehicle and environmental parameters inside the vehicle are continuously collected.
[0044] Step S302: In response to the user's submitted collection instruction, the environmental image and environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, and the historical document data is saved.
[0045] In step S303, in response to the user's instruction to reproduce the target historical document data, the environmental image in the target historical document data is displayed through the display device in the vehicle, and the current environmental parameters in the vehicle are adjusted according to the environmental parameters in the target historical document data.
[0046] The recording and saving phases are similar to those in the above embodiments and will not be described again.
[0047] During the reproduction phase, users can actively search for the target historical document data for which they wish to reproduce the scene. When a user selects the target historical document data and presses the "Reproduce Yesterday" button, the vehicle system responds to the user's reproduction command for the target historical document data, retrieves the environmental images and environmental parameters corresponding to each timestamp from the target historical document data, and then displays the environmental images from the target historical document data through the in-vehicle display device. At the same time, it adjusts the current environmental parameters in the vehicle based on the environmental parameters in the target historical document data.
[0048] In this embodiment, the vehicle system responds to a user's command to reproduce a target historical document, and reproduces the scene based on the user-selected target historical document. This embodiment of the invention provides users with an immersive memory experience by recording and reproducing environmental images and in-vehicle environmental parameters at specific locations during vehicle operation.
[0049] Figure 4 This is a flowchart of a scene reproduction method according to the fourth embodiment of the present invention. As another embodiment of the present invention, such as... Figure 4 As shown, the method for reproducing this scene may include: In step S401, in response to the user's submitted recording instruction, the vehicle's current historical location information is obtained, and environmental images around the vehicle and environmental parameters inside the vehicle are continuously collected.
[0050] In step S402, in response to the user's submitted collection instruction, the environmental image and environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, and the historical document data is saved.
[0051] Step S403: During the vehicle's operation, the vehicle's current location information is obtained in real time.
[0052] Step S404: Determine whether there is any target historical location information that is less than or equal to the distance threshold from the vehicle's current location information; if yes, proceed to step S405; if no, proceed to step S403.
[0053] Step S405: Prompt the user to confirm whether the scene should be reproduced.
[0054] Step S406: In response to the user's submitted reproduction command, obtain the target historical document data corresponding to the target historical location information.
[0055] Step S407: Display the environmental image from the target historical document data through the display device inside the vehicle, and adjust the current environmental parameters inside the vehicle according to the environmental parameters in the target historical document data.
[0056] The recording and saving phases are similar to those in the above embodiments and will not be described again.
[0057] During the scene reproduction phase, the vehicle's infotainment system acquires the vehicle's current location information in real time and calculates the distance between the current location and each historical location. It then determines if any historical location exists at a distance less than or equal to a distance threshold. If such a historical location exists, it is selected as the target historical location, and the system prompts the user whether to reproduce the scene. This prompt can be delivered via voice or displayed on the in-vehicle screen. If the user wishes to reproduce the scene at the current location, they submit a confirmation command. The system responds to this command by acquiring the target historical document data corresponding to the target historical location. It then retrieves the environmental images and parameters corresponding to each timestamp from the target historical document data. The system displays the environmental images from the target historical document data on the in-vehicle display and adjusts the current environmental parameters based on these parameters. It should be noted that the distance threshold can be preset, for example, to 200 meters, 500 meters, 1000 meters, 2000 meters, or 3000 meters. This embodiment of the invention does not impose any limitations on this.
[0058] In this embodiment, the vehicle system continuously determines whether there is a target historical location information that is less than or equal to a distance threshold from the vehicle's current location. If such information exists, a prompt is issued to the user. Responding to the user's submitted reproduction command, the vehicle system reproduces the scene based on the target historical document data. This embodiment of the invention provides users with an immersive memory experience by recording and reproducing environmental images and in-vehicle environmental parameters at specific locations during vehicle operation.
[0059] Figure 5 This is a flowchart of a scene reproduction method according to the fifth embodiment of the present invention. As another embodiment of the present invention, such as... Figure 5 As shown, the method for reproducing this scene may include: Step S501: In response to the user's submitted recording instruction, obtain the vehicle's current historical location information.
[0060] In step S502, the image acquisition device installed on the vehicle continuously acquires environmental images around the vehicle and records the timestamps corresponding to each environmental image; at the same time, the environmental parameters inside the vehicle are acquired by various sensors installed inside the vehicle and the timestamps corresponding to each environmental parameter are recorded.
[0061] Step S503: In response to the user's submitted collection instruction, sort each environmental image and each environmental parameter according to the timestamp to obtain the environmental image sequence and the environmental parameter sequence.
[0062] Step S504: Based on the environmental image sequence and the environmental parameter sequence, integrate the environmental images and environmental parameters with the same timestamp to obtain the historical document data corresponding to the historical location information.
[0063] Step S505: Save historical document data.
[0064] Step S506: In response to the user's submitted reproduction command, display the environmental image from the historical document data through the display device in the vehicle, and adjust the current environmental parameters in the vehicle according to the environmental parameters in the historical document data.
[0065] The purpose of this invention is to solve the technical problem that existing vehicles have difficulty recording specific locations and cannot reproduce the scene. This invention provides users with an immersive memory experience by recording and reproducing environmental images and in-vehicle environmental parameters at specific locations during vehicle operation.
[0066] This invention also provides a vehicle-mounted terminal, including: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method of any of the above embodiments.
[0067] This invention also provides a vehicle, which includes a vehicle body and the vehicle-mounted terminal described in the above embodiments, the vehicle-mounted terminal being mounted on the vehicle body.
[0068] Figure 6 An exemplary vehicle system architecture 600 to which the scene reproduction method or scene reproduction apparatus of the present invention can be applied is shown.
[0069] like Figure 6 As shown, the vehicle system architecture 600 may include various systems, such as an autonomous driving system 601, a powertrain system 602, a sensor system 603, a control system 604, one or more peripheral devices 605, a power supply 606, a computer system 607, and a user interface 608. Optionally, the vehicle system architecture 600 may include more or fewer systems, and each system may include multiple components. Furthermore, each system and component of the vehicle system architecture 600 may be interconnected via wired or wireless means.
[0070] The vehicle system architecture 600 includes an autonomous driving system 601, which can be in a fully or partially autonomous driving mode. For example, the autonomous driving system 601 can automatically control the vehicle's movement without human interaction; the autonomous driving system 601 can also control the vehicle's autonomous driving while in autonomous driving mode, and can also adjust its autonomous driving behavior through human interaction.
[0071] The powertrain 602 may include components that provide power to the vehicle. For example, the powertrain 602 may include an engine, an energy source, a transmission, wheels, tires, etc. The engine may be an internal combustion engine, an electric motor, an air-compressed engine, or other combinations of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air-compressed engine. The engine converts the energy source into mechanical energy to supply the transmission. Examples of energy sources may include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other electrical sources. The energy source may also provide energy to other systems in the vehicle. Furthermore, the transmission may include a gearbox, a differential, a drive shaft, and a clutch, etc.
[0072] Sensor system 603 may include sensors for sensing the vehicle's surrounding environment. Examples include a positioning system (which may be a Global Positioning System (GPS), BeiDou Navigation Satellite System, or other positioning systems), radar, a laser rangefinder, an inertial measurement unit (IMU), and a camera. The positioning system can be used to determine the vehicle's geographical location. The IMU is used to sense changes in the vehicle's position and orientation based on inertial acceleration. In one embodiment, the IMU may be a combination of an accelerometer and a gyroscope. The radar can use radio signals to sense objects in the vehicle's surrounding environment. In some embodiments, in addition to sensing objects, the radar can also be used to sense the speed and / or direction of travel of objects.
[0073] To detect environmental information and objects located in front of, behind, or to the sides of the vehicle, radar, cameras, and other devices can be configured at appropriate locations on the exterior of the vehicle. For example, to acquire an image of the front of the vehicle, a camera can be configured inside the vehicle and close to the windshield. Alternatively, the camera can be configured around the front bumper or radiator grille. Similarly, to acquire an image of the rear of the vehicle, a camera can be configured inside the vehicle and close to the rear window. Alternatively, the camera can be configured around the rear bumper, trunk, or tailgate. To acquire images of the sides of the vehicle, a camera can be configured inside the vehicle and close to at least one of the side windows. Alternatively, the camera can be configured around the side mirrors, fenders, or doors.
[0074] Laser rangefinders use lasers to sense objects in the environment in which a vehicle is located.
[0075] A camera can be used to capture multiple images of the vehicle's surroundings. The camera can be a still camera or a video camera.
[0076] The control system 604 may include software systems for implementing autonomous driving, such as a route planning system, an obstacle avoidance system, and a vision system for image analysis. The control system 604 may also include hardware systems such as an accelerator and steering wheel system. Furthermore, the control system 604 may add or replace components other than those shown and described. Alternatively, some of the components shown above may be omitted.
[0077] The control system 604 interacts with external sensors, other autonomous driving devices, other computer systems, or occupants via peripheral devices 605. Peripheral devices 605 may include wireless communication systems, on-board computers, microphones, and / or speakers.
[0078] In some embodiments, peripheral device 605 provides a means for occupant-to-occupant interface interaction with control system 604. For example, an on-board computer may provide information to the occupants of the vehicle. The occupant interface may also operate the on-board computer to receive occupant input. The on-board computer may be operated via a touchscreen. In other cases, peripheral device may provide a means for communicating with other devices located within the vehicle. For example, a microphone may receive audio (e.g., voice commands or other audio input) from the occupants of control system 604. Similarly, a speaker may output audio to the occupants of control system 604.
[0079] Wireless communication systems can communicate wirelessly with one or more devices, either directly or via a communication network. For example, wireless communication systems can use networks such as cellular networks, WiFi, and wireless local area networks (WLANs), or they can use infrared links, Bluetooth, or ZigBee to communicate directly with devices. Other wireless protocols include those used in various autonomous driving communication systems.
[0080] The power source 606 can provide power to various components of the vehicle. The power source 606 can be a rechargeable lithium-ion or lead-acid battery.
[0081] The computer system 607 controls some or all of the functions enabling autonomous driving. The computer system 607 may include at least one processor that executes instructions stored in a non-transitory computer-readable medium such as memory. The computer system 607 provides the execution code for the aforementioned autonomous driving system to implement autonomous driving.
[0082] The processor can be any conventional processor, such as a commercially available central processing unit (CPU). Alternatively, the processor can be a special-purpose device such as an application-specific integrated circuit (ASIC) or other hardware-based processor. Those skilled in the art will understand that the processor, computer, or memory can actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, memory can be a hard disk drive or other storage media located in a housing different from that of a computer. Therefore, references to processors or computers will be understood to include references to a collection of processors or computers or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as steering and deceleration components, may each have their own processor, which performs calculations only related to the component's specific function.
[0083] User interface 608 is used to provide information to or receive information from users of the vehicle. Optionally, user interface 608 may include one or more input / output devices within a set of peripheral devices 605, such as wireless communication systems, on-board computers, microphones, and speakers.
[0084] It should be understood that the components described above are merely an example. In actual applications, components in the various modules or systems mentioned above may be added or removed as needed. Figure 6 This should not be construed as a limitation on the embodiments of this application.
[0085] According to another aspect of the present invention, a computer-readable medium is also provided, on which a computer program is stored, which, when executed by a processor, implements the methods described in any of the above embodiments.
[0086] According to another aspect of the present invention, a computer program product is also provided, including a computer program that, when executed by a processor, implements the methods described in any of the above embodiments.
[0087] Figure 7 This is an exemplary overall system architecture diagram in which embodiments of the present invention can be applied, as shown below. Figure 7 As shown, the system architecture 700 may include a vehicle infotainment system 701, a network 702, an application server 703, and a cloud 704. The network 702 serves as a medium to provide a communication link between the vehicle infotainment system 701 and the application server 703 and cloud 704, enabling interaction. The network 702 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.
[0088] Application server 703 can be a server providing various services, such as a backend management server supporting navigation requests sent by users to vehicle system 701 via in-vehicle interactive devices (for example only). Vehicle system 701 can respond to a user-submitted record command by obtaining the vehicle's current historical location information and continuously collecting environmental images around the vehicle and environmental parameters inside the vehicle; respond to a user-submitted save command by integrating the environmental images and parameters to obtain historical document data corresponding to the historical location information and saving the historical document data; and respond to a user-submitted replay command by displaying the environmental images from the historical document data through the in-vehicle display device, while simultaneously adjusting the current environmental parameters inside the vehicle based on the environmental parameters in the historical document data.
[0089] It should be noted that the scene reproduction method provided in the embodiments of the present invention is generally executed by the vehicle system 701.
[0090] It should be understood that Figure 7 The number of in-vehicle systems, networks, application servers, and cloud components shown is merely illustrative. Depending on implementation needs, there can be any number of in-vehicle systems, networks, application servers, and cloud components.
[0091] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.
Claims
1. A method for reproducing a scene, characterized in that, include: In response to a user-submitted recording command, the system obtains the vehicle's current historical location information and continuously collects environmental images around the vehicle and environmental parameters inside the vehicle. In response to a user's submission of a collection instruction, the environmental image and the environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, and the historical document data is saved. In response to a user-submitted reproduction command, the environmental image from the historical document data is displayed on the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the historical document data.
2. The scene reproduction method according to claim 1, characterized in that, Continuously acquire environmental images of the area surrounding the vehicle and environmental parameters inside the vehicle, including: The vehicle continuously acquires environmental images of its surroundings using image acquisition devices installed on the vehicle, and records the timestamps corresponding to each environmental image. Simultaneously, the vehicle acquires environmental parameters of its interior using various sensors installed inside the vehicle, and records the timestamps corresponding to each environmental parameter.
3. The scene reproduction method according to claim 2, characterized in that, The environmental image and the environmental parameters are integrated and processed to obtain historical document data corresponding to the historical location information, including: The environmental images and environmental parameters are sorted according to their timestamps to obtain an environmental image sequence and an environmental parameter sequence. Based on the environmental image sequence and the environmental parameter sequence, environmental images and environmental parameters with the same timestamp are integrated and processed to obtain historical document data corresponding to the historical location information.
4. The scene reproduction method according to claim 1, characterized in that, In response to a user-submitted reproduction command, the environmental image from the historical document data is displayed on the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the historical document data, including: In response to a user-submitted reproduction command, the system retrieves the target historical document data corresponding to the target historical location information that is closest to the current location information of the vehicle from various historical document data. The environmental image in the target historical document data is displayed through the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the target historical document data.
5. The scene reproduction method according to claim 1, characterized in that, In response to a user-submitted reproduction command, the environmental image from the historical document data is displayed on the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the historical document data, including: In response to a user-submitted instruction to reproduce target historical document data, an environmental image from the target historical document data is displayed on a display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted based on the environmental parameters in the target historical document data.
6. The scene reproduction method according to claim 1, characterized in that, In response to a user-submitted reproduction command, the environmental image from the historical document data is displayed on the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the historical document data, including: During the vehicle's operation, the system acquires the vehicle's current location information in real time and determines whether there is any target historical location information that is less than or equal to a distance threshold from the vehicle's current location information. If so, the system prompts the user to confirm whether the scene should be reproduced. In response to a user-submitted reproduction command, the target historical document data corresponding to the target historical location information is obtained; The environmental image in the target historical document data is displayed through the display device inside the vehicle, and the current environmental parameters inside the vehicle are adjusted according to the environmental parameters in the target historical document data.
7. A vehicle-mounted terminal, characterized in that, include: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-6.
8. A vehicle, characterized in that, The vehicle includes a body and the vehicle-mounted terminal as described in claim 7, wherein the vehicle-mounted terminal is disposed on the vehicle body.
9. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-6.
10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-6.