Method and device for generating virtual scene

Abstract

The invention provides a method and a device for generating a virtual scene. The method comprises the following steps: determining attribute information of a plurality of original objects in an environment image and a scene material matched with a scene theme according to the environment image of an external real environment of the vehicle and the scene material; determining security levels of the original objects according to the attribute information of the plurality of original objects; processing the image of the original object by adopting a processing mode corresponding to the security level of the original object to obtain a processed object; generating a virtual scene corresponding to the real environment according to the processed object; and displaying the virtual scene in a predetermined area of the vehicle.

Description

Technical Field

[0001] The present disclosure relates to the technical field of virtual scene generation, and in particular to a method and device for generating a virtual scene. Background Art

[0002] With the development of technology, the entertainment functions available in cars are becoming increasingly diverse. In-car systems now provide functions such as radio, audio and video playback, and intelligent voice assistant Q&A, which enhances the riding experience. However, during long-distance driving, the limited functions provided by existing in-car systems can easily lead to boredom. Summary of the Invention

[0003] In view of the above problems, the present disclosure provides a method and apparatus for generating a virtual scene.

[0004] According to a first aspect of the present disclosure, a method for generating a virtual scene is provided, comprising: determining attribute information of multiple original objects in an environmental image of a real environment outside a vehicle and scene materials matching a scene theme based on the environmental image; determining a safety level of the original objects based on the attribute information of the multiple original objects; processing the image of the original object using a processing mode corresponding to the safety level of the original object to obtain a processed object; generating a virtual scene corresponding to the real environment based on the processed object; and displaying the virtual scene in a predetermined area of ​​the vehicle.

[0005] According to an embodiment of the present disclosure, the attribute information includes at least one of the following: safety information, which includes indicator light information and signboard information; basic driving information related to driving, which includes road information, lane line information and obstacle information; and additional information related to the riding experience, which includes: natural environment information, building information, time information and weather information.

[0006] According to an embodiment of the present disclosure, determining the safety level of the original object based on the attribute information of multiple original objects includes: in response to detecting that the safety information in the attribute information of the original object is empty, determining a total evaluation value based on the basic driving information and additional information in the attribute information; in response to detecting that the total evaluation value is greater than or equal to a predetermined threshold, determining that the safety level of the original object is the second level; and in response to detecting that the total evaluation value is less than a predetermined threshold, determining that the safety level of the original object is the third level.

[0007] According to an embodiment of the present disclosure, determining a total evaluation value based on the basic driving information and additional information in the attribute information of the original object includes: determining a first evaluation value based on the basic driving information in the attribute information of the original object; determining a second evaluation value based on the additional information in the attribute information of the original object; and determining a total evaluation value based on the first evaluation value and the second evaluation value.

[0008] According to an embodiment of the present disclosure, determining the security level of the original object based on the attribute information of the plurality of original objects includes: in response to detecting that the attribute information of the original object includes security information, determining the security level of the original object to be the first level.

[0009] According to an embodiment of the present disclosure, a processing mode corresponding to the security level of the original object is adopted to process the image of the original object, and the processed object obtained includes at least one of the following: for an original object with a security level of the first level, the object is used as the first object; for an original object with a security level of the second level, a virtual image of the original object is generated as the second object based on a virtual reality processing mode; and for an original object with a security level of the third level, the original object is input into a generation model to obtain a third object.

[0010] According to an embodiment of the present disclosure, generating a virtual scene corresponding to a real environment based on the processed object includes: combining a first object, a second object, and a third object to obtain a virtual scene.

[0011] According to an embodiment of the present disclosure, the method further includes: determining a scene theme according to the environment image and the reference information; and selecting a scene material matching the scene theme from a material library according to the scene theme.

[0012] A second aspect of the present disclosure provides a device for generating a virtual scene, comprising: an attribute determination module for determining attribute information of multiple original objects in an environmental image of a real environment outside a vehicle and scene materials matching the scene theme; a level determination module for determining a safety level of the original object based on the attribute information of the multiple original objects; a processing module for processing the image of the original object using a processing mode corresponding to the safety level of the original object to obtain a processed object; a generation module for generating a virtual scene corresponding to the real environment based on the processed object; and a display module for displaying the virtual scene in a predetermined area of ​​the vehicle.

[0013] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors execute the above method.

[0014] A fourth aspect of the present disclosure further provides a computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to execute the above method.

[0015] The fifth aspect of the present disclosure further provides a computer program product, comprising a computer program, which implements the above method when executed by a processor.

[0016] The sixth aspect of the present disclosure also provides a vehicle comprising the above-mentioned electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0018] Figure 1 The flowchart of the method for generating a virtual scene according to an embodiment of the present disclosure is schematically shown;

[0019] Figure 2 Schematically shows another flow chart of a method for generating a virtual scene according to an embodiment of the present disclosure;

[0020] Figure 3 The following schematically shows a structural block diagram of an apparatus for generating a virtual scene according to an embodiment of the present disclosure;

[0021] Figure 4 A block diagram of an electronic device suitable for implementing the method for generating a virtual scene according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0022] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present disclosure. In the detailed description below, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0023] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise," "include," etc. used herein indicate the presence of the features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0024] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0025] When expressions such as "at least one of A, B and C, etc." are used, they should generally be interpreted in accordance with the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0026] In the technical solutions disclosed herein, the collection, storage, use, processing, transmission, provision, disclosure and application of the data involved (including but not limited to user personal information) comply with the provisions of relevant laws and regulations, take necessary confidentiality measures, and do not violate public order and good morals.

[0027] An embodiment of the present disclosure provides a method and device for generating a virtual scene, the method comprising: determining attribute information of multiple original objects in an environmental image of a real environment outside a vehicle and scene materials matching a scene theme based on an environmental image; determining a safety level of the original objects based on the attribute information of the multiple original objects; processing the image of the original object using a processing mode corresponding to the safety level of the original object to obtain a processed object; generating a virtual scene corresponding to the real environment based on the processed object; and displaying the virtual scene in a predetermined area of ​​the vehicle.

[0028] Figure 1 The flowchart of the method for generating a virtual scene according to an embodiment of the present disclosure is schematically shown.

[0029] like Figure 1 As shown, the vehicle distress alert method of this embodiment includes operations S110 to S150.

[0030] In operation S110, attribute information of a plurality of original objects in the environment image and the scene material is determined based on the environment image of the real environment outside the vehicle and the scene material matching the scene theme.

[0031] For example, environmental images and environmental information can be obtained through cameras, sensors and other devices. Environmental images may include images around the vehicle, images of distant areas on both sides of the road, images of the sky above the vehicle, etc. Environmental information may include temperature, humidity, brightness, etc.

[0032] The objects in the acquired environmental images may include indicator lights, traffic lights, signs and other objects that can convey important information, nearby vehicles, lane lines, pedestrians, fire hydrants, roadblocks and other obstacles on the driving route, buildings, public facilities, coastlines, trees on both sides of the road, as well as flying objects in the sky and in the air.

[0033] For example, scene themes can include pre-configured themes with some relatively obvious elements or features, such as tropical rainforest, cyberpunk, ink painting, Christmas, etc. Each scene theme can correspond to several scene assets. For example, the scene assets corresponding to "Christmas" may include Christmas trees, bells, elk, gingerbread men, etc. Each scene asset can represent an object.

[0034] The original object can represent all objects in the above-mentioned environmental images and scene materials. Each original object includes multiple basic information, and the basic information may include source, category, motion state information, etc. The source can indicate whether the object comes from the environmental image or the material library. The category may include obstacles (vehicles, pedestrians, etc.), buildings, trees, environmental information, etc. The motion state information may include whether the object is moving, as well as the speed, direction, position, etc. of the moving object. The basic information can be obtained from the original object through image recognition technology and sensor equipment, such as the text information, icon information, outline information, color information, distance information, etc. included in the original object based on the recognition.

[0035] In some embodiments of the present disclosure, attribute information may be obtained based on the above-mentioned basic information of the original object.

[0036] Attribute information may include safety information. For example, safety information includes at least one of the following: indicator light information, sign information, road information, lane line information, and information about a first obstacle. The distance between the first obstacle and the vehicle is less than or equal to a predetermined distance, and the direction of travel of the first obstacle is consistent with or intersects with the direction of travel of the vehicle. For example, if the object category is indicator light, sign, road, lane line, or first obstacle, then the object has corresponding safety information.

[0037] Attribute information may also include basic driving information related to driving. For example, basic driving information may include a second obstacle, the distance between the second obstacle and the vehicle being greater than a predetermined distance, or the second obstacle and the vehicle being in parallel lanes but in opposite directions. The second type of attribute information may also include objects of predetermined categories, such as trees, utility poles, and streetlights.

[0038] The attribute information may also include additional information related to the riding experience, including natural environment information, building information, time information, and weather information.

[0039] Attribute information is used to determine whether the original object affects the user's driving behavior. The original objects with safety information are objects that need to be paid special attention to during driving. Therefore, such original objects can be left unchanged when generating the virtual scene. The original objects with basic driving information are objects that need to be paid attention to during driving. When generating the virtual scene, such original objects can be slightly modified, such as trees on both sides of the road, vehicles in the distance, etc., which can be artistically processed through virtual reality technology without changing the position information. The original objects with additional information are irrelevant objects in the driving process, such as the sky, lakes and seas around the driving route, forests, tower bridges, etc., which can be significantly changed in the process of generating the virtual scene.

[0040] In some embodiments of the present disclosure, an original object may include one or more attribute information among safety information, basic driving information and additional information, indicating that the original object has attribute information that affects the driving process and also has attribute information that does not affect the driving process.

[0041] For example, when the original object is a highway, the basic information may include the contour information, color information and / or text information of the highway. According to the contour information, the direction of the highway and the obstacles near the highway (such as roadblocks, roadside trash cans, trees, etc.) can be obtained, among which the direction of the highway and roadblocks belong to road information, and the roadside trash cans and trees belong to the natural environment information in the additional information; according to the color information and / or text information, the traffic markings on the road (such as white dotted lines, yellow solid lines, arrows, text, etc.) can be obtained, which belong to the lane line information.

[0042] For example, if the original object is a vehicle on the road, basic information may include the vehicle's driving status. If a vehicle's driving status has a certain impact on the user's driving process, such as when the vehicle is close to the user's vehicle, or when the vehicle changes lanes, slows down, or stops in front of the user's vehicle, then the vehicle's driving status is considered safety information. If a vehicle's driving status has no impact on the user's driving process, such as when the vehicle is driving on the other side of the road or is far away from the user's vehicle, then the vehicle's driving status is considered basic driving information.

[0043] For example, if the original object is a sign, the basic information may include the sign's color and text. The color and text information can be used to determine whether the sign is a traffic sign or a billboard. If the original object is a traffic sign, the original object is characterized as including safety information. If the original object is a billboard, the original object is characterized as including additional information and / or basic driving information.

[0044] In some embodiments of the present disclosure, the original objects in the scene materials are materials obtained from a material library, so the original objects in the scene materials all contain additional information that does not affect the driving process.

[0045] For example, a vehicle is traveling on a highway. By acquiring the environment image and scene material, the original objects obtained include: the highway, highway signs, distant vehicles, toll booths, mountains, and the sky in the environment image; and birds, windmills, flowers, and trees in the scene material. The highway signs contain safety information, the toll booths, highways, and distant vehicles contain basic driving information and additional information, and the mountains, sky, birds, windmills, flowers, and trees contain additional information.

[0046] In some embodiments, the attribute information may also include weather information and time information in the environmental image. For example, the weather information obtained from the image is heavy rain, and the time information is dusk. A corresponding virtual scene is generated based on the weather information and time information.

[0047] In operation S120, a safety level of the original object is determined based on the attribute information of the plurality of original objects. A higher safety level indicates a greater impact of the original object on the driving process.

[0048] In some embodiments of the present disclosure, in response to detecting that the attribute information of an original object includes safety information, the safety level of the original object is determined to be level 1, indicating that changing the image of the original object is likely to affect normal vehicle driving. Therefore, the original image of the original object can be retained in the generated virtual scene. For example, the original image may include a sign, a lane change ahead, or a slow-moving vehicle.

[0049] In some embodiments of the present disclosure, if the safety information in the attribute information of the original object is empty, the total evaluation value can be determined based on the basic driving information and additional information in the attribute information. For example, the first evaluation value is determined based on the basic driving information in the attribute information of the original object; and the second evaluation value is determined based on the additional information in the attribute information of the original object. The first evaluation value can evaluate the degree of influence of the object on the safe driving of the main vehicle, and the second evaluation value can evaluate the degree of influence of the object on the riding experience of the main vehicle user. For example, the correspondence between various attribute information and evaluation values ​​can be pre-configured, and then the evaluation values ​​of each basic driving information possessed by the object are added together as the first evaluation value, and the evaluation values ​​of each additional information possessed by the object are added together as the second evaluation value.

[0050] Next, a total evaluation value is determined based on the first evaluation value and the second evaluation value. For example, the total evaluation value may be a weighted average of the first evaluation value and the second evaluation value, and the weight coefficient may be pre-configured.

[0051] After obtaining the total evaluation value, if the total evaluation value is greater than or equal to a predetermined threshold, the security level of the original object can be determined to be level two, and the image of the original object can be slightly modified when generating the virtual scene. If the total evaluation value is less than the predetermined threshold, the security level of the original object is determined to be level three, and the image of the original object can be significantly modified when generating the virtual scene.

[0052] In operation S130, the image of the original object is processed using a processing mode corresponding to the security level of the original object to obtain a processed object.

[0053] In one example, for an original object with a safety level of level 1, the object may be used as the first object. For example, for a signboard, a light, and a first obstacle with a safety level of level 1, the images of these original objects are not changed.

[0054] In another example, for an original object with a second-level safety rating, a virtual image of the original object can be generated based on a virtual reality processing mode as a second object. For example, for other vehicles, pedestrians, roadside trees, and other objects that are far away from the vehicle, the original object in the environmental image can be simulated and processed using augmented reality (AR) technology to generate a virtual object that can be mapped on a screen, display, or other device as the second object. Furthermore, during this processing, the image style of the newly generated second object can be consistent with the scene theme, for example, a distant vehicle can be processed as a Christmas-themed cartoon vehicle.

[0055] In another example, for an original object with a third-level security level, the original object can be input into a generative model to generate a third object. For example, the generative model can be an AIGC (Artificial Intelligence Generated Content) model, a large language model, or the like, though this description does not limit the generative model. During use, images of several third-level original objects can be input into the generative model, or text corresponding to each third-level original object can be input into the generative model. The text can be used to describe the properties of the original object. Furthermore, the input to the generative model can include prompts, which are natural language snippets that can represent the task or role of the generative model. For example, the prompt could be, "You are an AI artist. Please generate a new image based on the following multiple images or texts. The style of the new image must match the theme of the XX scene, and then output the new image. The example of the new image is XX." In this way, the generative model can output a new image, which can be used as the third object. For example, images of third-level original objects such as the sky, buildings, or mountains, along with prompts, can be input into the generative model, and the model can output a new image, which can be used as the third object.

[0056] In operation S140, a virtual scene corresponding to the real environment is generated based on the processed object.

[0057] For example, the first object, the second object, and the third object may be combined to obtain a virtual scene. In operation S150, the virtual scene is displayed in a predetermined area of ​​the vehicle.

[0058] The predetermined area may include windows, walls and other parts of the vehicle except for the driver's position. The virtual scene can be displayed by installing a screen and projector that can be freely raised and lowered and using a glass screen instead of the window.

[0059] In some embodiments of the present disclosure, while displaying a virtual scene, the in-vehicle system can create an in-vehicle environment that is closer to the virtual scene by calling on the car's audio, fragrance, and air-conditioning equipment to work with the virtual scene.

[0060] According to the embodiments of the present disclosure, by acquiring external environmental images and scene materials, certain processing is performed on objects that do not affect the driving process, and with the cooperation of other equipment in the car, the scene outside the car is virtualized and artistically processed and presented inside the vehicle for users in the car to appreciate, thereby adding fun to users during long-distance driving and improving the riding experience.

[0061] Figure 2Another flowchart of the method for generating a virtual scene according to an embodiment of the present disclosure is schematically shown.

[0062] In operation S201 , a vehicle acquires an environmental image of an external scene.

[0063] In operation S202 , reference information is acquired.

[0064] For example, the reference information may include information such as date and weather, and the date may include holidays, anniversaries, and the like.

[0065] In operation S203, a scene theme is determined.

[0066] For example, the scene theme can be determined through manual selection by the user.

[0067] For another example, the scene theme can be determined based on the environmental image and reference information.

[0068] In the process of determining the scene theme, for example, a first correspondence between certain specific dates and scene themes can be pre-configured. If the actual date is a specific date, the scene theme can be determined based on the first correspondence and the actual date. For example, the scene theme corresponding to December 25th is Christmas. If the actual date is a date other than a specific date, target detection can be performed on the environmental image to obtain multiple objects in the environmental image. Then, at least one core object can be determined from the multiple objects. The core object can be an object that is relatively large in number or area in the environmental image. The scene theme can then be determined based on a pre-configured second correspondence between the core object and the scene theme. For example, if the core objects include trees, the scene theme can be a tropical rainforest.

[0069] In operation S204 , according to the scene theme, a scene material matching the scene theme is selected from a material library.

[0070] After obtaining the scene theme, you can select scene materials that match the scene theme from the material library. For example, if the scene theme is Christmas, you can pre-configure the matching relationship between the scene theme and the scene materials. For example, if the scene theme is Christmas, you can select Christmas trees, bells, elk, gingerbread men, etc. from the material library as scene materials that match the Christmas theme. In addition, you can enter keywords and associate and search the material library to obtain scene materials that match the keywords.

[0071] In operation S205 , attribute information of a plurality of original objects in the environment image and the scene material is acquired.

[0072] In operation S206 , it is determined whether the attribute information of the original object includes security information.

[0073] If the attribute information of the original object includes security information, operation S207 is performed; if not, operation S208 is performed.

[0074] In operation S207, the original object containing the security information is used as the first object.

[0075] In operation S208 , a total evaluation value of the original object is determined based on the driving basic information and the added value information included in the attribute information.

[0076] In operation S209 , it is determined whether the total evaluation value is greater than or equal to a preset threshold.

[0077] If the total evaluation value is greater than or equal to the preset threshold, operation S210 is performed; if the total evaluation value is less than the preset threshold, operation S211 is performed.

[0078] In operation S210 , a second object is obtained through AR technology.

[0079] In operation S211, information is input into the AIGC model to obtain a third object.

[0080] In operation S212 , the first object, the second object, and the third object are combined to form a virtual scene.

[0081] In operation S213, an immersive riding experience is created by setting other facilities in the vehicle in conjunction with the generated virtual scene.

[0082] Based on the above method for generating a virtual scene, the present disclosure also provides a device for generating a virtual scene. Figure 3 The device is described in detail.

[0083] Figure 3 The structural block diagram of the apparatus for generating a virtual scene according to an embodiment of the present disclosure is schematically shown.

[0084] like Figure 3 As shown, the apparatus 300 for generating a virtual scene in this embodiment includes an attribute determination module 310 , a level determination module 320 , a processing module 330 , a generation module 340 and a presentation module 350 .

[0085] The attribute determination module 310 is used to determine attribute information of multiple original objects in the environment image and the scene material based on the environment image of the real environment outside the vehicle and the scene material that matches the scene theme. In one embodiment, the attribute determination module 310 can be used to perform the operation S110 described above.

[0086] The level determination module 320 is used to determine the security level of the original object based on the attribute information of the multiple original objects. In one embodiment, the level determination module 320 can be used to perform the operation S120 described above.

[0087] The processing module 330 is used to process the image of the original object using a processing mode corresponding to the security level of the original object to obtain a processed object. In one embodiment, the processing module 330 can be used to perform the operation S130 described above.

[0088] The generation module 340 is used to generate a virtual scene corresponding to the real environment based on the processed object. In one embodiment, the generation module 340 can be used to perform the operation S140 described above.

[0089] The display module 350 is used to display a virtual scene in a predetermined area of ​​the vehicle. In one embodiment, the display module 350 can be used to perform the operation S150 described above.

[0090] In this embodiment, the attribute information includes at least one of the following: safety information, which includes at least one of the following: indicator light information, signboard information, road information, lane line information, and information about the first obstacle, the distance between the first obstacle and the vehicle is less than or equal to a predetermined distance, and the traveling direction of the first obstacle is consistent with or intersects with the traveling direction of the vehicle; basic driving information related to driving; and additional information related to the riding experience, which includes: natural environment information, building information, time information, and weather information.

[0091] In this embodiment, the level determination module 320 includes a first determination submodule, a second determination submodule, and a third determination submodule. The first determination submodule is configured to determine a total evaluation value based on the basic driving information and additional information in the attribute information in response to detecting that the safety information in the original object's attribute information is empty. The second determination submodule is configured to determine that the safety level of the original object is level 2 in response to detecting that the total evaluation value is greater than or equal to a predetermined threshold. The third determination submodule is configured to determine that the safety level of the original object is level 3 in response to detecting that the total evaluation value is less than a predetermined threshold.

[0092] In this embodiment, the first determination submodule includes a first determination unit, a second determination unit, and a third determination unit. The first determination unit is configured to determine a first evaluation value based on basic driving information in the original object's attribute information. The second determination unit is configured to determine a second evaluation value based on additional information in the original object's attribute information. The third determination unit is configured to determine a total evaluation value based on the first and second evaluation values.

[0093] In this embodiment, the level determination module includes: a fourth determination submodule, configured to determine that the security level of the original object is the first level in response to detecting that the attribute information of the original object includes security information.

[0094] In this embodiment, the processing module includes at least one of the following: a first processing submodule, a second processing submodule, and a third processing submodule. The first processing submodule is configured to, for an original object with a first security level, treat the object as a first object. The second processing submodule is configured to, for an original object with a second security level, generate a virtual image of the original object based on a virtual reality processing mode as a second object. The third processing submodule is configured to, for an original object with a third security level, input the original object into a generation model to generate a third object.

[0095] In this embodiment, the generation module includes: a combination submodule, which is used to combine the first object, the second object and the third object to obtain a virtual scene.

[0096] In this embodiment, the apparatus further includes a theme determination module and a selection module. The theme determination module is configured to determine a scene theme based on the environment image and reference information. The selection module is configured to select scene materials that match the scene theme from a material library based on the scene theme.

[0097] According to an embodiment of the present disclosure, any multiple modules among the attribute determination module 310, the level determination module 320, the processing module 330, the generation module 340 and the display module 350 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the attribute determination module 310, the level determination module 320, the processing module 330, the generation module 340 and the display module 350 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or can be implemented in any one of the three implementation methods of software, hardware and firmware or in an appropriate combination of any of them. Alternatively, at least one of the attribute determination module 310 , the level determination module 320 , the processing module 330 , the generation module 340 and the presentation module 350 may be at least partially implemented as a computer program module, which may perform corresponding functions when executed.

[0098] Figure 4A block diagram of an electronic device suitable for implementing a vehicle distress alert method according to an embodiment of the present disclosure is schematically shown.

[0099] like Figure 4 As shown, the electronic device 400 according to an embodiment of the present disclosure includes a processor 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage part 408 into a random access memory (RAM) 403. The processor 401 may, for example, include a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 401 may also include an onboard memory for caching purposes. The processor 401 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0100] Various programs and data required for the operation of the electronic device 400 are stored in the RAM 403. The processor 401, ROM 402, and RAM 403 are connected to each other via a bus 404. The processor 401 executes the various operations of the method flow according to the embodiment of the present disclosure by executing the programs in the ROM 402 and / or RAM 403. It should be noted that the programs may also be stored in one or more memories other than the ROM 402 and RAM 403. The processor 401 may also execute the various operations of the method flow according to the embodiment of the present disclosure by executing the programs stored in the one or more memories.

[0101] According to an embodiment of the present disclosure, electronic device 400 may further include an input / output (I / O) interface 405, which is also connected to bus 404. Electronic device 400 may further include one or more of the following components connected to I / O interface 405: an input portion 406 including a keyboard, a mouse, etc.; an output portion 407 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers; a storage portion 408 including a hard disk; and a communication portion 409 including a network interface card such as a LAN card or a modem. Communication portion 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to I / O interface 405 as needed. Removable media 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed in drive 410 as needed, so that computer programs read therefrom can be installed into storage portion 408 as needed.

[0102] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments, or may exist independently and not be incorporated into the device / apparatus / system. The computer-readable storage medium carries one or more programs, and when executed, implements the method according to the embodiments of the present disclosure.

[0103] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 402 and / or RAM 403 described above and / or one or more memories other than ROM 402 and RAM 403.

[0104] The embodiments of the present disclosure also include a computer program product, which includes a computer program containing program code for executing the method shown in the flowchart. When the computer program product is executed in a computer system, the program code is used to cause the computer system to implement the item recommendation method provided by the embodiments of the present disclosure.

[0105] The computer program executes the above functions defined in the system / device of the embodiment of the present disclosure when the processor 401 executes the computer program. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0106] In one embodiment, the computer program may be stored on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may be transmitted and distributed in the form of a signal on a network medium, downloaded and installed via the communication portion 409, and / or installed from a removable medium 411. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0107] In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 409, and / or installed from the removable medium 411. When the computer program is executed by the processor 401, the above-mentioned functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the systems, devices, means, modules, units, etc. described above can be implemented by computer program modules.

[0108] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, python, "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect via the Internet).

[0109] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0110] Those skilled in the art will appreciate that the features described in the various embodiments and / or claims of this disclosure may be combined and / or coupled in various ways, even if such combinations and / or couplings are not explicitly described in this disclosure. In particular, the features described in the various embodiments and / or claims of this disclosure may be combined and / or coupled in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or couplings are intended to fall within the scope of this disclosure.

[0111] The embodiments of the present disclosure are described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be used in combination to advantage. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A method for generating a virtual scene, comprising: Determining attribute information of a plurality of original objects in an environmental image of a real environment outside a vehicle and a scene material matching a scene theme; determining a security level of the original object according to the attribute information of the plurality of original objects; Processing the image of the original object using a processing mode corresponding to the security level of the original object to obtain a processed object; generating a virtual scene corresponding to the real environment according to the processed object; as well as The virtual scene is displayed in a predetermined area of ​​the vehicle.

2. The method according to claim 1, wherein The attribute information includes at least one of the following: Safety information, the safety information including at least one of the following: indicator light information, sign information, road information, lane line information, and information about a first obstacle, where the distance between the first obstacle and the vehicle is less than or equal to a predetermined distance, and the direction of travel of the first obstacle is consistent with or intersects with the direction of travel of the vehicle; Basic driving information related to driving; as well as Additional information related to the riding experience, including natural environment information, building information, time information, and weather information.

3. The method according to claim 2, wherein: The determining, based on the attribute information of the plurality of original objects, the security level of the original objects comprises: In response to detecting that the safety information in the attribute information of the original object is empty, determining a total evaluation value based on the basic driving information and the additional information in the attribute information; In response to detecting that the total evaluation value is greater than or equal to a predetermined threshold, determining that the safety level of the original object is the second level; and In response to detecting that the total evaluation value is less than the predetermined threshold, the safety level of the original object is determined to be the third level.

4. The method according to claim 3, wherein: Determining the total evaluation value according to the basic driving information and the additional information in the attribute information of the original object includes: determining a first evaluation value according to basic driving information in the attribute information of the original object; determining a second evaluation value according to the additional information in the attribute information of the original object; and The total evaluation value is determined according to the first evaluation value and the second evaluation value.

5. The method according to claim 2, wherein: The determining, based on the attribute information of the plurality of original objects, the security level of the original objects comprises: In response to detecting that the attribute information of the original object includes security information, the security level of the original object is determined to be a first level.

6. The method according to any one of claims 1 to 5, wherein: The processing mode corresponding to the security level of the original object is used to process the image of the original object, and the processed object obtained includes at least one of the following: For an original object with a security level of the first level, the object is used as the first object; For an original object with a second security level, generating a virtual image of the original object as a second object based on a virtual reality processing mode; as well as For an original object with a third security level, the original object is input into the generation model to obtain a third object.

7. The method according to claim 6, wherein: Generating a virtual scene corresponding to the real environment according to the processed object includes: The first object, the second object and the third object are combined to obtain the virtual scene.

8. The method according to claim 1, further comprising: Determining the scene theme according to the environment image and reference information; as well as According to the scene theme, the scene material that matches the scene theme is selected from a material library.

9. A device for generating a virtual scene, comprising: an attribute determination module for determining attribute information of a plurality of original objects in an environment image of a real environment outside the vehicle and a scene material matching a scene theme based on the environment image; A level determination module, configured to determine the security level of the original object based on the attribute information of the plurality of original objects; a processing module, configured to process the image of the original object using a processing mode corresponding to the security level of the original object to obtain a processed object; A generating module, configured to generate a virtual scene corresponding to the real environment based on the processed object; as well as A display module is used to display the virtual scene in a predetermined area of ​​the vehicle.

10. An electronic device comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors are enabled to perform the method according to any one of claims 1 to 8.

11. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to perform the method according to any one of claims 1 to 8. 12 . A computer program product, comprising a computer program, wherein the computer program is stored on at least one of a readable storage medium and an electronic device, and when the computer program is executed by a processor, implements the method according to claim 1 .

13. A vehicle comprising the electronic device according to claim 10.

Images