Virtual vehicle exhibition implementation method and system, storage medium and electronic equipment

Abstract

The invention provides a virtual vehicle exhibition implementation method and system, a storage medium and electronic equipment, and relates to the technical field of virtual vehicle exhibitions. According to the technical scheme provided by the invention, the initial character model corresponding to the second user is generated by responding to the invitation instruction of the first user, and then the initial attention picture for the specific attention part at the view angle position of the first user is generated according to the view angle position of the first user and the spatial position of the target vehicle model; when the initial character model appears in the initial attention picture, the shielding proportion of the initial character model is calculated, and the initial character model is adjusted to be the target character model under the condition that the shielding proportion is greater than the preset first threshold value, so that the target attention picture of the specific attention part at the visual angle position is regenerated. Therefore, the shielding effect of other people on the vehicle model in the virtual vehicle exhibition can be reduced, and the impression experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of virtual auto shows, and in particular to a method, system, storage medium, and electronic device for implementing a virtual auto show. Background Art

[0002] With the continuous development of digital technology, online virtual auto shows have gradually emerged as a new way of displaying vehicles. Users can browse and understand various vehicle information in real time in online virtual exhibition halls through the Internet.

[0003] In online virtual auto shows, when users lack sufficient knowledge of the vehicle, the approach often employed is to add a virtual avatar to the virtual show to showcase and introduce the vehicle model part by part. However, in practice, due to the complex spatial relationship between the avatar and the vehicle model in the virtual scene and the lack of an effective position management mechanism, this approach can result in the avatar of the introducer obscuring the vehicle model during the presentation, making it difficult for users to fully understand the details of the vehicle model and resulting in a poor user experience. Summary of the Invention

[0004] The present application provides a method, system, storage medium, and electronic device for realizing a virtual auto show, which can reduce the obstruction effect of other people on vehicle models in the virtual auto show, thereby improving the user viewing experience.

[0005] In a first aspect, the present application provides a method for implementing a virtual auto show, the method comprising: In response to an invitation instruction from a first user who participates in a virtual auto show, generating an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show; Acquiring voice information and action information of the initial character model to determine a specific part of the target vehicle model in the virtual auto show that the second user is interested in; Acquiring the viewing angle position of the first user and the spatial position of the target vehicle model, and generating an initial focus image for the specific focus area at the viewing angle position; When the initial character model appears in the initial focus picture, calculating the occlusion ratio of the initial character model in the initial focus picture; If the occlusion ratio is greater than a preset first threshold, the initial character model is adjusted to a target character model, and a target focus image for the specific focus part at the viewing angle position is regenerated according to the target character model.

[0006] By adopting the above technical solution, an initial character model corresponding to the second user is generated in response to the invitation instruction of the first user, and the voice information and action information of the initial character model are obtained, so that the specific focus area of ​​the target vehicle model in the virtual auto show by the second user can be accurately identified; further, by obtaining the viewing angle position of the first user and the spatial position of the target vehicle model, an initial focus screen for the specific focus area at the viewing angle position of the first user can be generated, thereby achieving accurate positioning and display of the focus area of ​​the target vehicle model; when the initial character model appears in the initial focus screen, the occlusion ratio of the initial character model is calculated, and when the occlusion ratio is greater than a preset first threshold, the initial character model is adjusted to the target character model, and then the target focus screen for the specific focus area at the viewing angle position is regenerated, thereby reducing the occlusion effect of other people on the vehicle model in the virtual auto show, thereby improving the user viewing experience.

[0007] Optionally, in response to an invitation instruction from a first user participating in a virtual auto show, generating an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show includes: In response to an invitation instruction from a first user participating in a virtual auto show, the invitation instruction is sent to a second user, where the second user accepts the invitation instruction and enters the virtual auto show; The identity information input by the second user is verified, and an initial character model corresponding to the second user is generated, where the initial character model is a three-dimensional model in the virtual auto show.

[0008] By adopting the above technical solution, an invitation instruction is sent to the second user, and the identity information input by the second user is verified after the second user accepts the invitation instruction, thereby ensuring that the identity of the user entering the virtual auto show is authentic and reliable; at the same time, by generating the verified second user into a three-dimensional model in the virtual auto show, the second user can be more realistically presented in the virtual auto show in the form of an initial character model, thereby enhancing the user's sense of reality in participating in the virtual auto show.

[0009] Optionally, the acquiring of the voice information and action information of the initial character model to determine the specific part of the target vehicle model in the virtual auto show that the second user is interested in includes: Acquiring voice information and action information of the initial character model; parsing the voice information to extract voice keywords related to the target vehicle model; Analyzing the action direction of the initial character model to the target vehicle model according to the action information; The specific part of the target vehicle model in the virtual auto show that the second user is interested in is determined by combining the voice keyword and the action direction.

[0010] By adopting the above technical solution, the voice information and action information of the initial character model are obtained, and the voice information is analyzed to extract voice keywords related to the target vehicle model. At the same time, combined with the analysis of the initial character model's action information, its action direction to the target vehicle model is obtained. It is possible to accurately identify that the second user, as the explainer, is explaining the specific focus areas of the target vehicle model to the first user, thereby providing an accurate judgment basis for the subsequent targeted display of the focus areas.

[0011] Optionally, obtaining the viewing angle position of the first user and the spatial position of the target vehicle model, and generating an initial focus image for the specific focus area at the viewing angle position includes: Acquire the viewing angle position of the first user and the spatial position of the target vehicle model; Determining a viewing focus of the target vehicle model at the viewing position according to a spatial positional relationship between the viewing position and the spatial position; Determining a display angle of the target vehicle model relative to the viewing angle according to an actual position of the specific focus portion on the target vehicle model; An initial focus picture of the specific focus area at the perspective position is generated according to the perspective focus and the display angle.

[0012] By employing this technical solution, the user's viewing angle and the spatial position of the target vehicle model are acquired. Based on the spatial relationship between the two, the viewing focus is determined. The display angle is then determined based on the specific area of ​​focus being explained by the tour guide. This generates an initial focus image from the user's perspective. This initial focus image is then used to calculate the degree of occlusion of the vehicle model by the tour guide's figure model, thereby assessing whether the user's actual viewing experience is affected by the tour guide's position.

[0013] Optionally, when the initial character model appears in the initial focused picture, calculating the occlusion ratio of the initial character model in the initial focused picture includes: Identifying the initial focus picture, and segmenting a first pixel region corresponding to the initial person model and a second pixel region corresponding to the target vehicle model in the initial focus picture; Calculating a pixel overlap area between the first pixel area and the second pixel area; The ratio of the pixel overlapping area to the second pixel area is determined as the occlusion ratio of the initial character model.

[0014] By adopting the above technical solution, the initial focus screen is identified and segmented into a first pixel area corresponding to the initial character model and a second pixel area corresponding to the target vehicle model, the overlapping part of the two pixel areas is calculated, and the ratio of the pixel overlapping area to the second pixel area is determined as the occlusion ratio of the initial character model. This can accurately quantify the degree of occlusion of the target vehicle model by the tour guide from the exhibitors.

[0015] Optionally, if the occlusion ratio is greater than a preset first threshold, adjusting the initial character model to a target character model, and regenerating a target focus image for the specific focus area at the viewing angle position according to the target character model, includes: If the occlusion ratio is greater than a preset first threshold and less than a preset second threshold, determining an offset distance of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the offset distance, and the first threshold is less than the second threshold; If the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the transparency; A target focus picture of the specific focus part at the viewing angle position is regenerated according to the target person model.

[0016] By adopting the above technical solution, a preset first threshold and a preset second threshold are set to perform graded processing on the occlusion degree. When the occlusion ratio is between the two thresholds, the system calculates the offset distance of the initial character model according to the occlusion ratio and adjusts the position; when the occlusion ratio exceeds the preset second threshold, the transparency of the initial character model is adjusted to reduce the occlusion effect; then, based on the adjusted target character model, the target focus image of the specific focus part at the viewing position is regenerated, thereby realizing dynamic optimization of the tour guide's character model, which can not only ensure the natural display effect of the tour guide during the explanation process, but also ensure the exhibitors' clear viewing experience of the specific focus parts of the target vehicle model.

[0017] Optionally, if the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the transparency, includes: If the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio; The transparency interval in which the transparency lies is determined, and the transparency of the initial character model is dynamically adjusted according to the standard transparency corresponding to the transparency interval to obtain a target character model.

[0018] By adopting the above technical solution, when the occlusion ratio is greater than or equal to the preset second threshold, the transparency of the initial character model is determined according to the occlusion ratio, and the transparency is mapped to the corresponding transparency interval. The initial character model is dynamically adjusted according to the standard transparency of the interval. This enables the system to select the most appropriate transparency parameters based on different degrees of occlusion, avoid sudden changes in the transparency adjustment process, and achieve smooth transition and dynamic adjustment of the lecturer's character model.

[0019] In a second aspect, the present application provides a virtual auto show implementation system, the system comprising: An interaction module, configured to generate, in response to an invitation instruction from a first user participating in a virtual auto show, an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show; an attention part determination module, configured to obtain voice information and action information of the initial character model, and determine a specific attention part of the second user on the target vehicle model in the virtual auto show; A first picture generation module is configured to obtain a viewing angle position of the first user and a spatial position of the target vehicle model, and generate an initial focus picture of the specific focus area at the viewing angle position; a calculation module, configured to calculate an occlusion ratio of the initial character model in the initial focus picture when the initial character model appears in the initial focus picture; The second picture generation module is used to adjust the initial character model to a target character model if the occlusion ratio is greater than a preset first threshold, and regenerate a target focus picture of the specific focus part at the viewing angle position according to the target character model.

[0020] In a third aspect, the present application provides a computer storage medium, which stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing any one of the above methods.

[0021] In a fourth aspect, the present application provides an electronic device comprising a processor, a memory and a transceiver, wherein the memory is used to store instructions, the transceiver is used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device performs any one of the above methods.

[0022] In summary, the beneficial effects brought about by the technical solution of this application include: By adopting the above technical solution, an initial character model corresponding to the second user is generated in response to the invitation instruction of the first user, and the voice information and action information of the initial character model are obtained, so that the specific focus area of ​​the target vehicle model in the virtual auto show by the second user can be accurately identified; further, by obtaining the viewing angle position of the first user and the spatial position of the target vehicle model, an initial focus screen for the specific focus area at the viewing angle position of the first user can be generated, thereby achieving accurate positioning and display of the focus area of ​​the target vehicle model; when the initial character model appears in the initial focus screen, the occlusion ratio of the initial character model is calculated, and when the occlusion ratio is greater than a preset first threshold, the initial character model is adjusted to the target character model, and then the target focus screen for the specific focus area at the viewing angle position is regenerated, thereby reducing the occlusion effect of other people on the vehicle model in the virtual auto show, thereby improving the user viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is a flowchart of a method for implementing a virtual auto show according to an embodiment of the present application; Figure 2 This is a structural diagram of a virtual auto show implementation system according to an embodiment of the present application; Figure 3 This is a structural diagram of an electronic device provided in an embodiment of the present application.

[0024] Description of reference numerals: 300, electronic device; 301, processor; 302, communication bus; 303, user interface; 304, network interface; 305, memory. DETAILED DESCRIPTION

[0025] In order to enable people skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0026] In the description of the embodiments of this application, words such as "exemplary," "for example," or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary," "for example," or "for example" in the embodiments of this application should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary," "for example," or "for example" is intended to present the relevant concepts in a concrete manner.

[0027] In the description of the embodiments of the present application, the term "multiple" means two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0028] See Figure 1 This is a flow chart illustrating a method for implementing a virtual auto show, as provided in an embodiment of the present application. This method can be implemented using a computer program, a single-chip microcontroller, or a virtual auto show implementation system based on the von Neumann architecture. The computer program can be integrated into an application or run as a standalone tool application. The specific steps of the virtual auto show implementation method are described in detail below.

[0029] S101: In response to an invitation instruction from a first user participating in a virtual auto show, generating an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show; The first user refers to a user who participates in the online virtual auto show through a mobile terminal or computer device. In the embodiment of the present application, it can be understood as a user who uses a terminal device such as a VR headset, AR glasses, a tablet computer, a smartphone, a desktop computer or a laptop computer to access the online virtual auto show through a network connection.

[0030] The invitation instruction refers to an operation instruction sent by the first user via a terminal device to the virtual auto show system to request professional commentary services when the first user needs professional assistance to understand vehicle information during the virtual auto show. In the embodiment of the present application, it can be understood as a trigger signal received by the virtual auto show system to establish a real-time connection between the first user and the professional commentator (the second user), which is used to initiate the commentary request, establish the connection, and start the interaction.

[0031] The second user refers to a user who joins the virtual auto show after receiving an invitation from the first user via the virtual auto show system. In this embodiment of the present application, this user is invited to the virtual auto show and can introduce vehicles to the first user, thereby providing the first user with real-time explanations and consulting services related to the vehicle.

[0032] The initial character model refers to the default three-dimensional model of the second user in the virtual auto show space, which has preset human anatomy, appearance characteristics, and motion parameters. In this embodiment of the application, this can be understood as a standardized virtual character image assigned by the system to the second user who enters the virtual auto show after receiving the invitation instruction. It is used to display the second user's position and motion status in the virtual auto show scene, enabling visual interaction between the second user and the first user.

[0033] In a specific implementation, when a first user requires a professional commentary during a visit to a virtual auto show, they send an invitation to the virtual auto show system. Upon receiving the invitation, the system first determines whether a second user has accepted the invitation and confirmed their entry into the virtual auto show. After confirming the second user's acceptance, the system generates an initial character model representing the second user in the virtual auto show's three-dimensional space. This model is a three-dimensional model with the second user's personalized features, allowing the first user to intuitively visualize the second user's appearance, position, and movements in the virtual space. In a specific implementation, the system obtains the second user's personal characteristics and generates a corresponding initial character model, which accurately represents the second user's image in the virtual space. This initial character model allows the first user to clearly identify the second user's virtual image, enhancing the first user's sense of immersion and realism in the virtual auto show. In an alternative implementation based on the above embodiment, in response to an invitation from a first user participating in the virtual auto show, the system sends an invitation to a second user, who has accepted the invitation and entered the virtual auto show. The system then verifies the identity information entered by the second user and generates an initial character model corresponding to the second user, which is a three-dimensional model within the virtual auto show.

[0034] In specific implementation, when a first user requires professional commentary during a visit to a virtual auto show, they send an invitation to the virtual auto show system. The system then sends this invitation to a second user, who then chooses whether to accept the invitation and enter the virtual auto show. After the second user accepts the invitation, they are required to enter their identity information, including their account number, password, and ID card. The system then verifies this information to confirm the authenticity and legitimacy of the second user's identity. After authentication is successful, the system generates an initial character model with the second user's characteristics in the three-dimensional space of the virtual auto show based on their personal information and features. This model is a three-dimensional model that incorporates the second user's personalized appearance, allowing the first user to intuitively see the second user's true image, position, and movements in the virtual space. By authenticating the user's identity and generating the initial character model, the authenticity of the second user entering the virtual auto show is ensured, while the first user can clearly identify the second user's virtual image, enhancing the first user's sense of immersion and realism in the virtual auto show.

[0035] S102: Acquire voice information and action information of the initial character model to determine the specific part of the target vehicle model in the virtual auto show that the second user is interested in; Among them, the voice information refers to the voice data sent by the second user through the initial character model in the virtual auto show. In the embodiment of the present application, it can be understood as the language text information obtained after the system collects and recognizes the real-time voice of the second user.

[0036] Among them, the action information refers to the movement and posture data of the initial character model corresponding to the second user in the virtual auto show. In the embodiment of the present application, it can be understood as the dynamic information such as gestures, position movements, etc. of the second user during the explanation process collected by the system and mapped to the corresponding initial character model, which is used to guide the first user to pay attention to the specific parts of the target vehicle model, so that the second user can accurately indicate and display the vehicle in three dimensions through the initial character model.

[0037] Among them, the specific focus area refers to the specific area on the target vehicle model that the second user is explaining. In the embodiment of the present application, it can be understood as the specific position coordinates and area range on the target vehicle model determined by the second user's voice information and action information, such as the front, rear, side, roof and other parts of the vehicle body, which are used to accurately locate the area of ​​the vehicle body that the second user is explaining, so that the system can focus on display and interactive operations on this part.

[0038] During specific implementation, when the second user provides a vehicle explanation to the first user using an initial character model, the system needs to obtain the initial character model's voice and motion information in real time. Voice information is the textual language information obtained by the system after collecting and recognizing the second user's real-time voice. Motion information is the dynamic information collected by the system from the second user's gestures, positional movements, and other actions during the explanation and mapped to the corresponding initial character model. By analyzing the textual language content in the voice information and combining it with the gesture direction and position changes in the motion information, the system can accurately determine the specific focus area of ​​the target vehicle model that the second user is explaining, namely, the location coordinates and area range of specific areas on the vehicle body, such as the front, rear, sides, and roof. By obtaining voice and motion information and determining the specific focus area, the system can accurately understand the second user's explanation intentions, thereby enabling focused display and interactive operation of specific parts of the target vehicle model.

[0039] Based on the above embodiment, as an optional implementation, step S102 specifically further includes steps S201-S204.

[0040] S201: Acquire voice information and action information of the initial character model; S202: parsing the voice information to extract voice keywords related to the target vehicle model; Among them, voice keywords refer to the key words used by the second user to describe specific parts of the target vehicle model during the explanation process. In the embodiment of the present application, they can be understood as feature words related to the description of various parts of the vehicle body in the language text obtained by the system from the voice information analysis.

[0041] To accurately identify the second user's description of various parts of the target vehicle model during their voice explanation, the system needs to parse and process the acquired voice information. Specifically, the system first converts the voice information into corresponding language text. Then, based on a pre-set vehicle-related vocabulary, it extracts voice keywords related to the target vehicle model from the language text. These voice keywords include, but are not limited to, descriptors of various vehicle body parts, such as the front, rear, and side. By parsing the voice information and extracting voice keywords, the system is able to understand the key points of the second user's explanation at a semantic level.

[0042] S203: Analyzing the direction of the initial character model's movement toward the target vehicle model based on the movement information; Among them, action pointing refers to the direction in which the initial character model indicates a specific area of ​​the target vehicle model in the virtual space. In the embodiment of the present application, it can be understood as the spatial vector and pointing coordinates of the initial character model relative to the target vehicle model calculated by the system based on the action information, which is used to determine the specific part on the target vehicle model indicated by the second user through gestures, positions and other action behaviors, and realize the spatial positioning of the second user's explanation intention.

[0043] During a vehicle explanation, the second user often uses gestures and movements to emphasize specific vehicle parts. Therefore, the system needs to analyze and process the acquired motion information. Specifically, based on the second user's gestures, position, and other dynamic data contained in the motion information, the system calculates the spatial position and pointing direction of the initial character model relative to the target vehicle model, thereby determining the initial character model's pointing direction relative to the target vehicle model.

[0044] S204: Determine the specific part of the target vehicle model in the virtual auto show that the second user is interested in, based on the voice keywords and the action directions.

[0045] Specifically, the system combines voice keywords extracted from the speech information with action pointers analyzed from the action information. The voice keywords reflect the vehicle body parts described by the second user at a semantic level, while the action pointers indicate the spatial coordinates of the initial character model. When the voice keywords and the action pointers match, the system can accurately determine the specific area of ​​interest in the target vehicle model currently being explained by the second user.

[0046] S103: Acquire the viewing angle position of the first user and the spatial position of the target vehicle model, and generate an initial focus image for the specific focus part at the viewing angle position; Among them, the viewing angle position refers to the viewing angle and spatial position of the first user viewing the target vehicle model in the virtual auto show. In the embodiment of the present application, it can be understood as the spatial coordinates and orientation parameters determined by the system based on the virtual viewpoint of the first user, which is used to control the visual field and viewing direction of the first user when viewing the target vehicle model.

[0047] Among them, the initial focus screen refers to the visual scene generated by the system for the specific focus part of the target vehicle model based on the viewing angle position. In the embodiment of the present application, it can be understood that when the second user is explaining the vehicle, the system observes the specific focus part (such as the front, rear, side and other body areas) that the second user is explaining from the current viewing angle of the first user. The screen content presented fully records the visual effect when viewing the specific part of the target vehicle model from the current viewing angle.

[0048] Specifically, the system first obtains the first user's perspective position within the virtual auto show—that is, the spatial coordinates and orientation parameters of their virtual viewpoint—and simultaneously obtains the spatial position of the target vehicle model in virtual space. Based on these two spatial parameters, combined with the specific area of ​​interest (such as the front, rear, or side of the vehicle) that the second user is currently explaining, the system generates an initial focus image of that specific area of ​​interest from the current perspective. This image fully captures the visual experience of the first user viewing that specific part of the target vehicle model from their current perspective.

[0049] Based on the above embodiment, as an optional implementation, step S103 specifically further includes steps S301-S304.

[0050] S301: Acquire the viewing angle position of the first user and the spatial position of the target vehicle model; S302: Determine a viewing focus of the target vehicle model at the viewing position according to a spatial position relationship between the viewing position and the spatial position; In this embodiment, to accurately locate the first user's current viewing focus, the system needs to calculate the first user's visual focal point when viewing the target vehicle model. Specifically, based on the spatial geometric relationship between the first user's viewing position (i.e., the spatial coordinates and orientation parameters of the virtual viewpoint) and the spatial position of the target vehicle model, the system calculates the intersection of the line of sight and the surface of the target vehicle model, thereby determining the viewing focal point of the target vehicle model at the first user's current viewing position.

[0051] S303: Determine the display angle of the target vehicle model relative to the viewing angle according to the actual position of the specific focus part on the target vehicle model; In this embodiment, to ensure that the first user can optimally view the area being explained by the second user, the system calculates the ideal display orientation of the target vehicle model relative to the current viewing position. Specifically, the system first obtains the actual coordinates of the specific area of ​​interest (e.g., the front, rear, or side of the vehicle) on the target vehicle model. Then, based on the vehicle's styling characteristics and viewing habits, the system calculates the optimal viewing angle for that area, thereby determining the desired display angle for the target vehicle model relative to the first user's current viewing position.

[0052] S304: generating an initial focus image for a specific focus area at the viewing angle position according to the viewing angle focus and the display angle.

[0053] Specifically, the system calculates and generates an initial focus image for the first user viewing a specific area of ​​interest (such as the front, rear, or side of the vehicle) based on the first user's current viewing position's focal point (i.e., the intersection of their line of sight and the vehicle body surface) and the target vehicle model's ideal display angle for that current viewing position. This image truly reflects the visual experience of the first user viewing the specific area of ​​interest being explained by the second user from their current viewing position, including factors such as viewing angle, visible range, and detail clarity. By simultaneously considering both the focal point and display angle to generate the initial focus image, the system can more accurately assess the viewing experience at the current viewing position.

[0054] S104: When the initial character model appears in the initial focus picture, calculating the occlusion ratio of the initial character model in the initial focus picture; Among them, the occlusion ratio refers to the degree to which a specific part of interest is blocked by other car body areas at the current viewing angle position. In the embodiment of the present application, it can be understood that the system calculates the ratio of the blocked area of ​​the specific part of interest (such as the front, rear, side and other car body areas) that the second user is explaining in the initial focus screen to its complete visible area, which is used to evaluate the visibility of the specific part of interest at the current viewing angle position and determine whether the first user can fully and clearly see the detailed features of the part.

[0055] In this embodiment, when the second user is explaining the vehicle, the corresponding initial character model may appear in the viewing screen of the first user, thereby affecting the viewing effect of the specific part of interest. Therefore, when the system detects the appearance of the initial character model in the initial focus screen, it is necessary to calculate the degree of occlusion of the specific part of interest by the model. Specifically, the system analyzes the position and projection area of ​​the initial character model in the initial focus screen, and calculates the ratio of the occlusion area caused by the initial character model to the specific part of interest being explained (such as the front, rear, side and other body areas of the vehicle) to the complete visible area of ​​the part, that is, the occlusion ratio. By calculating the occlusion ratio, the system can quantitatively evaluate the impact of the initial character model on the viewing experience of the first user, provide a visibility judgment basis for subsequent judgments on whether adjustments are needed, and ensure that the first user can clearly and completely view the detailed features of the specific part of interest.

[0056] Based on the above embodiment, as an optional implementation, step S103 specifically further includes steps S401-S403.

[0057] S401: Identify the initial focus picture and segment the initial pixel area corresponding to the initial person model and the second pixel area corresponding to the target vehicle model in the initial focus picture; Among them, the first pixel area refers to the pixel area occupied by the initial character model in the initial focus screen. In the embodiment of the present application, it can be understood as the set of all pixel points contained in the initial character model corresponding to the second user extracted from the initial focus screen, which is used to determine the specific position and coverage range of the initial character model in the screen.

[0058] The second pixel area refers to the pixel area occupied by the target vehicle model in the initial focus picture. In the embodiment of the present application, it can be understood as the set of all pixel points contained in the specific focus parts (such as the front, rear, side and other body areas of the vehicle) that the second user is explaining, extracted from the initial focus picture through image recognition and semantic segmentation algorithms, which is used to determine the specific position and coverage range of the target vehicle model in the picture.

[0059] Specifically, the initial focus image is a real-time image of a first user watching a second user's initial character model explain the scene in an online virtual auto show. It contains specific focus areas of the target vehicle model (e.g., the front, rear, and sides) as well as the second user's initial character model. Based directly on the rendering information in the virtual scene, the system extracts the initial character model's projection area in the initial focus image as a first pixel region, representing all pixels occupied by the second user's avatar within the image. Simultaneously, the system extracts the target vehicle model's projection area as a second pixel region, representing all pixels occupied by the vehicle within the image.

[0060] S402: Calculating a pixel overlap area between the first pixel area and the second pixel area; Specifically, since the initial focus screen is a real-time screen of the first user watching the second user's explanation in an online virtual auto show, the system has obtained the first pixel area occupied by the initial character model in the screen, and the second pixel area occupied by the target vehicle model. Next, the system compares the spatial distribution relationship of the two pixel areas and uses pixel coordinate matching to detect whether each pixel point belongs to both areas at the same time. If the coordinates of a certain pixel point appear in the first pixel area and the second pixel area at the same time, the pixel point is marked as an overlapping pixel. By traversing all pixels and making this judgment, the system finally obtains a complete pixel overlapping area, which contains all the target vehicle model pixels that are blocked by the initial character model. This pixel-level overlap calculation method can accurately reflect which parts of the vehicle model are specifically blocked by the second user's virtual image from the current perspective of the first user, as well as the precise range of the occlusion.

[0061] S403: Determine the ratio of the pixel overlap area to the second pixel area as the occlusion ratio of the initial character model.

[0062] Specifically, since the system has already obtained the pixel overlap area between the initial person model and the target vehicle model in the initial focus image, as well as the second pixel area corresponding to the target vehicle model, the system then calculates the ratio of the number of pixels contained in the pixel overlap area to the number of pixels contained in the second pixel area to obtain the occlusion ratio of the initial person model. This ratio intuitively reflects the proportion of the vehicle model that is obscured by the second user's avatar from the first user's current perspective. For example, a large occlusion ratio indicates that the second user's avatar is seriously affecting the first user's viewing experience of the specific area of ​​the vehicle that they are focusing on; a small occlusion ratio indicates that the viewing experience from the current perspective is relatively ideal.

[0063] S105: If the occlusion ratio is greater than a preset first threshold, the initial character model is adjusted to a target character model, and a target focus image for the specific focus part at the viewing angle position is regenerated according to the target character model.

[0064] Among them, the target character model refers to a virtual image generated by adjusting the spatial position and / or posture of the initial character model. In the embodiment of the present application, it can be understood as a new virtual image obtained after the system optimizes and adjusts the initial character model corresponding to the second user based on the occlusion ratio. It is used to ensure that the second user can conduct vehicle explanations normally while reducing the occlusion effect on the first user's viewing of the target vehicle model, thereby improving the display effect of the online virtual auto show.

[0065] Among them, the target focus screen refers to the viewing screen regenerated by the first user at the current viewing angle of the specific focus part of the target vehicle model after the system adjusts the initial character model to the target character model when the occlusion ratio of the initial character model is greater than the preset first threshold. In the embodiment of the present application, it can be understood that the system responds to the situation where the occlusion is too large, and after adjusting the initial character model, the screen of the first user viewing the specific focus part of the vehicle is regenerated.

[0066] Specifically, after obtaining the occlusion ratio of the initial character model, the system compares the ratio with a preset first threshold. When the occlusion ratio is greater than the preset first threshold, it indicates that the initial character model corresponding to the second user has caused a large occlusion of the specific focus area of ​​the target vehicle model viewed by the first user. At this time, the system will trigger an adaptive adjustment mechanism to adjust the initial character model to the target character model. After the adjustment is completed, the system will regenerate the target focus screen of the first user at the current viewing position for the specific focus area based on the target character model. Through this adjustment mechanism based on threshold judgment, the system can adjust the character model in a timely manner and generate a new viewing screen when the occlusion level exceeds an acceptable range, thereby effectively improving the viewing effect of the first user on the specific focus area of ​​the vehicle.

[0067] Based on the above embodiment, as an optional implementation, step S105 specifically further includes steps S501-S503.

[0068] S501: If the occlusion ratio is greater than a preset first threshold and less than a preset second threshold, determining an offset distance of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the offset distance, and the first threshold is less than the second threshold; Specifically, the system establishes an intermediate range of occlusion ratios using a preset first threshold and a preset second threshold (where the first threshold is smaller than the second threshold). When the system detects that the initial character model (i.e., the second user's avatar) has an occlusion ratio within this intermediate range, it indicates that the initial character model corresponding to the second user is obstructing the first user's view of the target vehicle model to a certain extent. Based on the currently calculated specific occlusion ratio value, the system determines the specific offset distance that the initial character model needs to be adjusted. Once the offset distance is determined, the system adjusts the initial character model's position according to this specific offset distance to generate the target character model.

[0069] S502: If the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the transparency; In an online virtual auto show, when the initial character model corresponding to a second user significantly obscures a specific area of ​​interest to the first user's target vehicle model, the system needs to adjust its transparency. Specifically, when the system detects that the initial character model's occlusion ratio is greater than or equal to a preset second threshold, it first calculates the desired transparency based on the current occlusion ratio. Transparency calculations can be performed as follows: A baseline transparency range is set, for example, from 0 to 1, where 0 represents complete opacity and 1 represents complete transparency. The system then calculates a corresponding transparency coefficient based on the difference between the occlusion ratio and the preset second threshold. A higher occlusion ratio results in a higher transparency coefficient. The system then applies the calculated transparency coefficient to the initial character model and adjusts the model's material properties to achieve the desired transparency, thereby generating a target character model with a specific transparency. For example, when the occlusion ratio is significantly greater than the preset second threshold, the system may adjust the initial character model to a semi-transparent state (with a transparency of 0.5), allowing the first user to clearly view the obscured vehicle area through the semi-transparent target character model.

[0070] Based on the above embodiment, as an optional implementation method, the method of adjusting the initial character model using transparency also specifically includes the following method: if the occlusion ratio is greater than or equal to a preset second threshold, the transparency of the initial character model is determined according to the occlusion ratio; the transparency range in which the transparency lies is determined, and the transparency of the initial character model is dynamically adjusted according to the standard transparency corresponding to the transparency range to obtain the target character model.

[0071] Specifically, when the system detects that the occlusion ratio of the initial character model is greater than or equal to a preset second threshold, it first calculates an initial transparency value based on the current occlusion ratio. The system then matches the calculated transparency value with multiple pre-set transparency intervals to determine the specific transparency interval to which the transparency value belongs. Each transparency interval corresponds to an optimized standard transparency value, which is designed to ensure both visual quality and image aesthetics. After determining the transparency interval, the system dynamically adjusts the transparency of the initial character model to the standard transparency value corresponding to that interval, thereby generating the target character model. For example, the system can set multiple transparency intervals (e.g., 0-0.3 for light transparency, standard value 0.2; 0.3-0.6 for moderate transparency, standard value 0.4; 0.6-1 for high transparency, standard value 0.8). This interval-based transparency adjustment mechanism avoids the waste of computational resources that could result from continuous transparency changes while ensuring a more standardized and consistent effect.

[0072] S503: regenerating a target focus image for the specific focus part at the viewing angle position according to the target person model.

[0073] Specifically, the system will recalculate and render the scene image containing the target character model based on the latest status of the target character model (including its position information or transparency information) and with the current viewing position of the first user as the reference point. During the rendering process, the system will focus on the display effect of the specific focus area of ​​the target vehicle model at the current viewing position to ensure that the specific focus area can be clearly presented in the generated target focus image. When the target character model adopts a transparency adjustment solution, the system will apply the standard transparency value to the model rendering process, so that the first user can see the obscured specific focus area of ​​the vehicle through the target character model with appropriate transparency; when the target character model adopts a position offset solution, the system will recalculate the scene effect based on the offset position.

[0074] Based on the above embodiment, as an optional implementation method, when there are multiple users, when different users observe and understand the same target vehicle model, in order to ensure the interactivity between different users in the virtual auto show, multiple three-dimensional character models will be generated. However, this approach will cause occlusion when users observe key areas of interest. The technical solution of this application can also solve this problem. By using a method of blurring or moving character models, multiple people can participate in the online virtual auto show without occluding each other. That is, the second user in this application can actually include multiple subjects.

[0075] The following are system embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the system embodiments of the present application, please refer to the method embodiments of the present application.

[0076] See Figure 2 , which shows a schematic diagram of the structure of a virtual auto show implementation system provided by an exemplary embodiment of the present application. The system can be implemented as all or part of the system through software, hardware, or a combination of both. The virtual auto show implementation system includes: An interaction module, configured to generate, in response to an invitation instruction from a first user participating in the virtual auto show, an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show; The focus part determination module is used to obtain the voice information and action information of the initial character model and determine the specific focus part of the second user on the target vehicle model in the virtual auto show; A first image generation module is configured to obtain a viewing angle position of the first user and a spatial position of the target vehicle model, and generate an initial focus image of a specific focus area at the viewing angle position; a calculation module, configured to calculate an occlusion ratio of the initial character model in the initial focus picture when the initial character model appears in the initial focus picture; The second picture generation module is used to adjust the initial character model to a target character model if the occlusion ratio is greater than a preset first threshold, and regenerate a target focus picture for the specific focus part at the viewing angle position according to the target character model.

[0077] Based on the above embodiment, as an optional embodiment, the interaction module is further used to respond to the invitation instruction of the first user participating in the virtual auto show, send the invitation instruction to the second user, and the second user is the user who accepts the invitation instruction to enter the virtual auto show; verify the identity information input by the second user, and generate an initial character model corresponding to the second user, and the initial character model is a three-dimensional model in the virtual auto show.

[0078] Based on the above embodiment, as an optional embodiment, the focus part determination module is further used to obtain voice information and action information of the initial character model; parse the voice information to extract voice keywords related to the target vehicle model; analyze the action direction of the initial character model to the target vehicle model based on the action information; and determine the specific focus part of the second user on the target vehicle model in the virtual auto show based on the voice keywords and action directions.

[0079] Based on the above embodiment, as an optional embodiment, the first screen generation module is also used to obtain the viewing position of the first user and the spatial position of the target vehicle model; determine the viewing focus of the target vehicle model at the viewing position based on the spatial position relationship between the viewing position and the spatial position; determine the display angle of the target vehicle model to the viewing position based on the actual position of the specific focus part on the target vehicle model; generate an initial focus screen for the specific focus part at the viewing position based on the viewing focus and the display angle.

[0080] Based on the above embodiment, as an optional embodiment, the calculation module is also used to identify the initial focus picture, segment the first pixel area corresponding to the initial character model in the initial focus picture, and the second pixel area corresponding to the target vehicle model; calculate the pixel overlapping area between the first pixel area and the second pixel area; and determine the ratio of the pixel overlapping area to the second pixel area as the occlusion ratio of the initial character model.

[0081] Based on the above embodiment, as an optional embodiment, the second picture generation module is also used to determine the offset distance of the initial character model according to the occlusion ratio if the occlusion ratio is greater than a preset first threshold and less than a preset second threshold, and adjust the initial character model to the target character model according to the offset distance, and the first threshold is less than the second threshold; if the occlusion ratio is greater than or equal to the preset second threshold, determine the transparency of the initial character model according to the occlusion ratio, and adjust the initial character model to the target character model according to the transparency; according to the target character model, regenerate the target focus picture of the specific focus part at the viewing position.

[0082] Based on the above embodiment, as an optional embodiment, the second picture generation module is further used to determine the transparency of the initial character model according to the occlusion ratio if the occlusion ratio is greater than or equal to a preset second threshold; determine the transparency range in which the transparency lies, and dynamically adjust the transparency of the initial character model according to the standard transparency corresponding to the transparency range to obtain the target character model.

[0083] The embodiment of the present application further provides a computer storage medium, which can store multiple instructions. The instructions are suitable for being loaded by a processor and executed by the virtual auto show implementation method of the above embodiment. The specific execution process can be found in the specific description of the embodiment and will not be repeated here.

[0084] See Figure 3 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 3 As shown, the electronic device 300 may include: at least one processor 301 , at least one network interface 304 , a user interface 303 , a memory 305 , and at least one communication bus 302 .

[0085] The communication bus 302 is used to implement the connection and communication between these components.

[0086] The user interface 303 may include a standard wired interface or a wireless interface.

[0087] The network interface 304 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0088] The processor 301 may include one or more processing cores. Using various interfaces and circuits, the processor 301 connects to various components within the server. It executes instructions, programs, code sets, or instruction sets stored in the memory 305, as well as accesses data stored in the memory 305, to perform various server functions and process data. Optionally, the processor 301 may be implemented using at least one of the following hardware forms: a digital signal processing (DSP), a field-programmable gate array (FPGA), or a programmable logic array (PLA). The processor 301 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing content displayed on the display screen; and the modem handles wireless communications. It is understood that the modem may not be integrated into the processor 301 but implemented as a separate chip.

[0089] Among them, the memory 305 may include a random access memory (RAM) or a read-only memory (Read-Only Memory). Optionally, the memory 305 includes a non-transitory computer-readable storage medium. The memory 305 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 305 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 305 may also be optionally at least one storage device located away from the aforementioned processor 301. As Figure 3 As shown, the memory 305 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for a method for implementing a virtual auto show.

[0090] exist Figure 3In the electronic device 300 shown, the user interface 303 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 301 can be used to call an application program storing a method for implementing a virtual auto show in the memory 305. When executed by one or more processors, the electronic device executes one or more methods in the above-mentioned embodiments.

[0091] An electronic device readable storage medium stores instructions, which, when executed by one or more processors, enable the electronic device to execute one or more methods in the above embodiments.

[0092] It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for this application.

[0093] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0094] In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are merely schematic, such as the division of units, which is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interface, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0095] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0096] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0097] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of this application, or the portion that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the method of this application. The aforementioned memory includes various media that can store program code, such as USB flash drives, mobile hard drives, magnetic disks, or optical disks.

[0098] The above are merely exemplary embodiments of the present disclosure and are not intended to limit the scope of the present disclosure. That is, any equivalent changes and modifications made in accordance with the teachings of the present disclosure are still within the scope of the present disclosure. After considering the disclosure of the specification and the truth of practice, those skilled in the art will easily think of other embodiments of the present disclosure. This application is intended to cover any variations, uses or adaptive changes of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the field of the present disclosure that are not recorded in the present disclosure.

Claims

1. A method for realizing a virtual auto show, characterized in that: The method comprises: In response to an invitation instruction from a first user who participates in a virtual auto show, generating an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show; Acquiring voice information and action information of the initial character model to determine a specific part of the target vehicle model in the virtual auto show that the second user is interested in; Acquiring the viewing angle position of the first user and the spatial position of the target vehicle model, and generating an initial focus image for the specific focus area at the viewing angle position; When the initial character model appears in the initial focus picture, calculating the occlusion ratio of the initial character model in the initial focus picture; If the occlusion ratio is greater than a preset first threshold, the initial character model is adjusted to a target character model, and a target focus image for the specific focus part at the viewing angle position is regenerated according to the target character model.

2. The method according to claim 1, characterized in that The step of generating, in response to an invitation instruction from a first user participating in a virtual auto show, an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show, includes: In response to an invitation instruction from a first user participating in a virtual auto show, the invitation instruction is sent to a second user, where the second user accepts the invitation instruction and enters the virtual auto show; The identity information input by the second user is verified, and an initial character model corresponding to the second user is generated, where the initial character model is a three-dimensional model in the virtual auto show.

3. The method according to claim 1, characterized in that The acquiring of the voice information and action information of the initial character model and determining the specific part of the target vehicle model in the virtual auto show that the second user is interested in includes: Acquiring voice information and action information of the initial character model; parsing the voice information to extract voice keywords related to the target vehicle model; Analyzing the action direction of the initial character model to the target vehicle model according to the action information; The specific part of the target vehicle model in the virtual auto show that the second user is interested in is determined by combining the voice keyword and the action direction.

4. The method according to claim 1, wherein The obtaining of the viewing angle position of the first user and the spatial position of the target vehicle model, and generating an initial focus image for the specific focus area at the viewing angle position, includes: Acquire the viewing angle position of the first user and the spatial position of the target vehicle model; Determining a viewing focus of the target vehicle model at the viewing position according to a spatial positional relationship between the viewing position and the spatial position; Determining a display angle of the target vehicle model relative to the viewing angle according to an actual position of the specific focus portion on the target vehicle model; An initial focus picture of the specific focus area at the perspective position is generated according to the perspective focus and the display angle.

5. The method according to claim 1, wherein When the initial character model appears in the initial focus picture, calculating the occlusion ratio of the initial character model in the initial focus picture includes: Identifying the initial focus picture, and segmenting a first pixel region corresponding to the initial person model and a second pixel region corresponding to the target vehicle model in the initial focus picture; Calculating a pixel overlap area between the first pixel area and the second pixel area; The ratio of the pixel overlapping area to the second pixel area is determined as the occlusion ratio of the initial character model.

6. The method according to claim 1, characterized in that If the occlusion ratio is greater than a preset first threshold, adjusting the initial character model to a target character model, and regenerating a target focus image for the specific focus part at the viewing angle position according to the target character model, including: If the occlusion ratio is greater than a preset first threshold and less than a preset second threshold, determining an offset distance of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the offset distance, and the first threshold is less than the second threshold; If the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the transparency; A target focus picture of the specific focus part at the viewing angle position is regenerated according to the target person model.

7. The method according to claim 6, characterized in that If the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio, and adjusting the initial character model to a target character model according to the transparency, including: If the occlusion ratio is greater than or equal to a preset second threshold, determining the transparency of the initial character model according to the occlusion ratio; The transparency interval in which the transparency lies is determined, and the transparency of the initial character model is dynamically adjusted according to the standard transparency corresponding to the transparency interval to obtain a target character model.

8. A virtual auto show realization system, characterized in that: The system comprises: An interaction module, configured to generate, in response to an invitation instruction from a first user participating in a virtual auto show, an initial character model corresponding to a second user who accepts the invitation instruction and enters the virtual auto show; an attention part determination module, configured to obtain voice information and action information of the initial character model, and determine a specific attention part of the second user on the target vehicle model in the virtual auto show; A first picture generation module is configured to obtain a viewing angle position of the first user and a spatial position of the target vehicle model, and generate an initial focus picture of the specific focus area at the viewing angle position; a calculation module, configured to calculate an occlusion ratio of the initial character model in the initial focus picture when the initial character model appears in the initial focus picture; The second picture generation module is used to adjust the initial character model to a target character model if the occlusion ratio is greater than a preset first threshold, and regenerate a target focus picture of the specific focus part at the viewing angle position according to the target character model.

9. A computer storage medium, characterized in that The computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: The electronic device comprises a processor, a memory and a transceiver, wherein the memory is used to store instructions, the transceiver is used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes the method according to any one of claims 1 to 7.

Images