Image display method and device, equipment and medium
By acquiring and analyzing the environmental images and images to be displayed on the headset display device, determining the target area and reducing its brightness, the problem of short battery life of the headset display device is solved and the device's usage time is extended.
Patent Information
- Application Number
- CN202411215214.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2024-11-26
AI Technical Summary
The battery life of the head-mounted display device is short, which affects the wearer's experience.
By acquiring the currently displayed image and the target environment image, it is determined that the pixel value of the target area is in the pixel range of the same color, and the brightness of the pixels in the target area is reduced during display, thereby reducing battery power consumption.
It extends the battery life of the head-mounted display device and improves the wearer's experience.
Smart Images

Figure CN119028247A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and more specifically, to an image display method, an image display device, a head-mounted display device, and a medium. Background Art
[0002] In order to ensure the wearing experience of the wearer of the head mounted display device, the capacity of the battery of the head mounted display device is usually reduced to reduce the weight of the battery and thus reduce the weight of the head mounted display device, which will result in a shortened battery life of the head mounted display device.
[0003] However, battery life is also one of the important performance indicators of head-mounted display devices. Therefore, how to extend the battery life of head-mounted display devices has become a technical problem that needs to be solved urgently. Summary of the invention
[0004] One object of the present application is to provide a new technical solution for image display.
[0005] According to a first aspect of the present application, there is provided an image display method, which is applied to a head mounted display device, and the method comprises:
[0006] Acquire a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within a visual field of a wearer of the head mounted display device at a time when the current image to be displayed is displayed;
[0007] Determine a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein pixel values of pixels in the target environment image and the image to be displayed corresponding to pixels in the target area are within a pixel value range of the same color;
[0008] When displaying the current image to be displayed, the brightness of pixels in the current image to be displayed that are located in the target area is reduced.
[0009] Optionally, the step of acquiring the current image to be displayed and the corresponding target environment image includes a step of acquiring the target environment image, and the step includes:
[0010] Collecting environmental images of the head mounted display device in different positions and postures to obtain an environmental image set;
[0011] Obtaining the current position of the head mounted display device;
[0012] According to the current position and posture, an environment image matching the current position and posture is determined from the environment image set as the target environment image.
[0013] Optionally, before determining the target area in the current image to be displayed according to the current image to be displayed and the target environment image, the method further includes:
[0014] For any environment image in the environment image set, color division is performed on the environment image according to pixel values of pixels in the environment image to determine different colors included in the environment image and corresponding first area ranges;
[0015] The step of determining the target area in the current image to be displayed according to the current image to be displayed and the target environment image includes:
[0016] Determine a second area range where a target pixel is located from the image to be displayed, the target pixel being a pixel in the image to be displayed having the same color as that of the target environment image;
[0017] An overlapping area corresponding to the first area range and the second area range in the image to be displayed is determined as the target area.
[0018] Optionally, the color division of the environment image according to the pixel values of the pixels in the environment image to determine the different colors included in the environment image and the corresponding first area ranges includes:
[0019] According to the pixel values of the pixels in the environment image, the environment image is divided into colors to obtain different colors included in the environment image and corresponding third area ranges;
[0020] The third area range and the corresponding color in the environmental image that are larger than the preset area ratio of the environmental image are determined as the different colors included in the environmental image and the corresponding first area range.
[0021] Optionally, before acquiring the current image to be displayed and the corresponding target environment image, the method further includes:
[0022] Obtaining an application identifier of an application currently running in the foreground of the head mounted display device;
[0023] In the case where the application identifier is a target application identifier, a current image to be displayed and a corresponding target environment image are acquired.
[0024] Optionally, before collecting the environment images of the head mounted display device in different positions to obtain the environment image set, the method further includes:
[0025] Output prompt information to prompt the wearer that the wearer is in an environment of a preset type of background.
[0026] According to a second aspect of the present application, an image display device is provided, which is applied to a head mounted display device, and the device includes:
[0027] An acquisition module, used to acquire a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within the field of view of the wearer of the head mounted display device at the time when the current image to be displayed is displayed;
[0028] A determination module, configured to determine a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein pixel values of pixels in the target environment image and the image to be displayed corresponding to pixels in the target area are within a pixel value range of the same color;
[0029] The control module is used to reduce the brightness of the pixels located in the target area in the current image to be displayed when displaying the current image to be displayed.
[0030] Optionally, the determining module is further used for:
[0031] Collecting environmental images of the head mounted display device in different positions and postures to obtain an environmental image set;
[0032] Obtaining the current position of the head mounted display device;
[0033] According to the current position and posture, an environment image matching the current position and posture is determined from the environment image set as the target environment image.
[0034] According to a third aspect of the present application, a head-mounted display device is provided, the head-mounted display device comprising any one of the devices described in the second aspect;
[0035] Alternatively, the head-mounted display device includes a memory and a processor, the memory is used to store computer instructions, and the processor is used to call the computer instructions from the memory to execute the method as described in any one of the first aspects.
[0036] According to a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method according to any one of the first aspects is implemented.
[0037] The present application provides an image display method, which is applied to a head-mounted display device, and the method includes: obtaining a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within the field of view of the wearer of the head-mounted display device at the time when the current image to be displayed is displayed; determining a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein the pixel values of the pixels in the target area corresponding to the target environment image and the image to be displayed are within the same color pixel value range; and when displaying the current image to be displayed, reducing the brightness of the pixels in the target area in the current image to be displayed. This method can extend the battery life of the head-mounted display device.
[0038] Other features and advantages of the present application will become apparent from the following detailed description of exemplary embodiments of the present application with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with the description, serve to explain the principles of the application.
[0040] Figure 1 A hardware configuration of a head mounted display device for implementing an image display method according to an embodiment of the present application is provided. Figure 1 ;
[0041] Figure 2 It is a flowchart of a method for realizing image display provided according to an embodiment of the present application;
[0042] Figure 3 is a structural schematic diagram of an image display device provided according to an embodiment of the present application;
[0043] Figure 4 A hardware configuration of a head mounted display device for implementing an image display method according to an embodiment of the present application is provided. Figure 2 . DETAILED DESCRIPTION
[0044] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that unless otherwise specifically stated, the relative arrangement of components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present application.
[0045] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present application, its application, or uses.
[0046] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.
[0047] In all examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.
[0048] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.
[0049] Figure 1 A hardware configuration of a head mounted display device for implementing an image display method according to an embodiment of the present application is provided. Figure 1 .
[0050] The head mounted display device 1000 may be, for example, an AR, MR or other helmet or glasses.
[0051] The head mounted display device 1000 may include a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and the like. The processor 1100 may be a central processing unit CPU, a microprocessor MCU, and the like. The memory 1200 may include, for example, a ROM (read-only memory), a RAM (random access memory), a non-volatile memory such as a hard disk, and the like. The interface device 1300 may include, for example, a USB interface, a headphone interface, and the like. The communication device 1400 may, for example, be capable of wired or wireless communication. The display device 1500 may be, for example, a liquid crystal display screen, a touch display screen, and the like. The input device 1600 may include, for example, a touch screen, a keyboard, and the like. The user may input / output voice information through the speaker 1700 and the microphone 1800.
[0052] Despite Figure 1 In the figure, multiple devices are shown for the head-mounted display device 1000, but the present application may only involve some of the devices, for example, the head-mounted display device 1000 only involves the memory 1200 and the processor 1100.
[0053] In the embodiment of the present application, the memory 1200 of the head mounted display device 1000 is used to store instructions, and the instructions are used to control the processor 1100 to execute the image display method provided in the embodiment of the present application.
[0054] In the above description, the technician can design instructions according to the scheme disclosed in this application. How instructions control the processor to operate is well known in the art, so it will not be described in detail here.
[0055] Taking the head-mounted display device as an AR head-mounted display device as an example, the display screen of the head-mounted display device can be displayed in a perspective manner. While the wearer is watching the image displayed on the display screen, he can also see the environment behind the display screen as the background through perspective. In some scenarios, for example, when the wearer faces a white wall and uses a head-mounted display device to watch a movie, the color of the background environment is white. In this scenario, when the display screen of the head-mounted display device displays a display image including a white area, the brightness of the pixels in the white area of the display image can be reduced, and then color compensation is performed through the white environment as the background to achieve brightness compensation in visual effects. In this way, since the brightness of some pixels in the image to be displayed is reduced when displayed, the power consumption of the head-mounted display device will also be reduced. On this basis, the battery life of the head-mounted display device can be extended. Based on this concept, the image display method provided by the present application is proposed.
[0056] like Figure 2 As shown, the image display method provided by the present application includes the following steps S2100 to S2300.
[0057] Step S2100, obtaining the current image to be displayed and the corresponding target environment image.
[0058] The target environment image is an environment image within the field of view of the wearer of the head mounted display device at the time when the current image to be displayed is displayed.
[0059] In this embodiment, when the wearer wears the head mounted display device, he is usually in a relatively fixed environment. To this end, image acquisition can be performed on the relatively fixed environment where the wearer is located to obtain multiple frames of environmental images in advance. On this basis, the target environmental image corresponding to the image to be displayed is obtained from the multiple frames of environmental images obtained in advance. Based on this, the above step S2100 includes the step of obtaining the target environmental image. This step is specifically implemented by the following steps S2110 to S2112.
[0060] Step S2110: Collect environmental images of the head mounted display device in different positions and postures to obtain an environmental image set.
[0061] In this embodiment, the wearer wears the head mounted display device according to his / her wearing habits. In this process, the head mounted display device records the posture of the head mounted display device and collects environmental images at different postures. The head mounted display device uses the environmental images collected at different postures as an environmental image set. That is to say, the environmental image set includes multiple frames of environmental images, and each frame of the environmental image has a corresponding posture.
[0062] It is understandable that in order to obtain a complete and comprehensive set of environmental images, the wearer can wear the head-mounted display device according to his / her own wearing habits and perform a 360° rotation around the environment. In this process, the head-mounted display device implements the above step S2110.
[0063] In one embodiment of the present application, an IMU sensor is provided in the head mounted display device, and the head mounted display device records the posture through its own IMU sensor.
[0064] Step S2111, obtaining the current posture of the head mounted display device.
[0065] Step S2112: According to the current posture, determine from the environmental image set an environmental image that matches the current posture as a target environmental image.
[0066] In this embodiment, the environmental image in the environmental image set that matches the current posture refers to the environmental image in the environmental image set whose corresponding posture is closest to the current posture of the head-mounted display device.
[0067] Based on the above content, it can be known that when the head-mounted display device displays the image to be displayed, the environment seen through the display screen of the head-mounted display device is specifically the environment corresponding to the target environment image.
[0068] It should be noted that, when the posture of the head mounted display device does not change, multiple frames of images to be displayed correspond to one target environment image. Based on this, the method of obtaining the environment image set in step S2210 can greatly reduce the amount of data processing of the head mounted display device in the process of displaying the image to be displayed, compared with obtaining the real-time environment image corresponding to the image to be displayed as the target environment image, thereby reducing the display delay of the image to be displayed.
[0069] Step S2200: determining a target area in the current image to be displayed according to the current image to be displayed and the target environment image.
[0070] The pixel values of the pixels in the target area corresponding to the target environment image and the image to be displayed are within the same color pixel value range.
[0071] In this embodiment, the pixel value ranges corresponding to pixels of different colors are divided by color. In one example, the pixel value range of white corresponding to RGB is: the R value is any value from 255-a1 to 255, the G value is any value from 255-b1 to 255, and the B value is any value from 255-c1 to 255. The pixel value range of black corresponding to RGB is: the R value is any value from 0 to a2, the G value is any value from 0 to b2, and the B value is any value from 0 to c2, where a1, a2, b1, b2, c1 and c2 can be set based on experience.
[0072] It is understandable that the display areas of the current image to be displayed and the target environment image on the display screen are completely overlapped. Through the above step S2200, an area that has the same color as the target environment image and overlaps with the corresponding area range can be determined from the current image to be displayed, that is, the target area. That is to say, the color of the area in the target environment image corresponding to the target area is the same as the color of the target area in the current image to be displayed.
[0073] Step S2300: when displaying the current image to be displayed, reducing the brightness of pixels located in the target area in the current image to be displayed.
[0074] In one embodiment of the present application, the brightness of pixels in the target display area in the current image to be displayed may be reduced by 20% of the original brightness, that is, the pixels in the target area in the current image to be displayed may be displayed at 80% of the original brightness.
[0075] Since the color of the area corresponding to the target area in the target environment image is the same as the color of the target area in the current image to be displayed, based on the target environment image being the environment image within the field of view of the wearer of the head-mounted display device at the time of display of the current image to be displayed, when the head-mounted display device displays the current image to be displayed, the wearer can see through the environment with the same color as the target area when viewing the target area of the image to be displayed. At this time, when the brightness of the pixels in the target area of the current image to be displayed is reduced, the environment that the wearer sees through the target area will perform color compensation for the brightness of the target area of the image to be displayed, thereby achieving brightness compensation in visual effect. On this basis, since the brightness of some pixels in the image to be displayed is reduced when displayed, the power consumption of the head-mounted display device will also be reduced. Based on this, the battery life of the head-mounted display device can be extended.
[0076] It should be noted that when executing the above steps S2100 to S2300, the power consumption of the head mounted display device due to data processing is less than the display power consumption of the head mounted display device. Therefore, when the head mounted display device executes the image display method provided by the present application, the power consumption generated is reduced as a whole.
[0077] The present application provides an image display method, which is applied to a head-mounted display device, and the method includes: obtaining a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within the field of view of the wearer of the head-mounted display device at the time when the current image to be displayed is displayed; determining a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein the pixel values of the pixels in the target area corresponding to the target environment image and the image to be displayed are within the same color pixel value range; and when displaying the current image to be displayed, reducing the brightness of the pixels in the target area in the current image to be displayed. This method can extend the battery life of the head-mounted display device.
[0078] In one embodiment of the present application, the image display method provided by the present application further includes the following step S2210 before the above step S2200.
[0079] Step S2210: for any environment image in the environment image set, color division is performed on the environment image according to pixel values of pixels in the environment image to determine different colors included in the environment image and corresponding first area ranges.
[0080] Each color in the environment image appears in the form of a color block, and the human eye does not have a clear visual perception of the subtle differences in color. On this basis, the target environment image is divided into color blocks corresponding to different colors according to the pixel value range of pixels corresponding to different colors. In one embodiment of the present application, the area range corresponding to each color block can be recorded as the first area range, and the color corresponding to each color block is determined at the same time. Based on this, the above step S2210 can be implemented.
[0081] It should be noted that by dividing the pixel value ranges corresponding to pixels of different colors in the target environment image by color, it is possible to avoid dividing the target environment image into a large number of color blocks whose corresponding first area range is too small. This helps to reduce the number of target areas determined in the implementation process of the following steps S2220 to S2221, that is, reduces the amount of data processing of the head-mounted display device. At the same time, compared to obtaining a real-time environment image corresponding to the image to be displayed as the target environment image and determining the range of the first area, it is possible to determine the range of the first area in advance. Based on this, the display delay of the image to be displayed and the power consumption of the head-mounted display device can be reduced.
[0082] On the basis of the above step S2210, the above step S2200 can be specifically implemented through the following step S2220 and step S2221.
[0083] Step S2220: determine a second area range where the target pixel is located from the image to be displayed.
[0084] The target pixel is a pixel in the image to be displayed that has the same color as the target environment image.
[0085] In an example of the present application, when the color included in the target environment image is white, and the pixel value range of RGB corresponding to white is: R value is any value from 255-a1 to 255, G value is any value from 255-b1 to 255, and B value is any value from 255-c1 to 255, then the target pixels are pixel values: R value is any value from 255-a1 to 255, G value is any value from 255-b1 to 255, and B value is any value from 255-c1 to 255.
[0086] Step S2221: determine the overlapping area corresponding to the first area range and the second area range in the image to be displayed as the target area.
[0087] In one embodiment of the present application, the above step S2210 can be specifically implemented through the following steps S2211 and S2212.
[0088] Step S2211, dividing the environment image into different colors according to the pixel values of the pixels in the environment image, and obtaining different colors included in the environment image and corresponding third area ranges.
[0089] Each color in the environment image appears in the form of a color block, and the human eye does not have a clear visual perception of the subtle differences in color. On this basis, the target environment image is divided into color blocks corresponding to different colors according to the pixel value range of pixels corresponding to different colors. In this embodiment, the area range corresponding to each color block is recorded as the third area range, and the color corresponding to each color block is determined at the same time. Based on this, the above step S2211 can be implemented.
[0090] Step S2212: Determine the third area range and the corresponding color in the environment image that is larger than the preset area ratio of the environment image as the different colors included in the environment image and the corresponding first area range.
[0091] In one embodiment of the present application, the preset proportion may be generally 20%.Based on the above step S2212, a third area range having a preset proportion greater than the area range of the image to be displayed may be screened out from the third area range and recorded as the first area range.
[0092] In this embodiment, the third area range that is larger than the preset proportion is recorded as the first area range. In this way, it is possible to avoid executing step S2200 for the third area range with a smaller area range. In this way, the amount of data processing of the head mounted display device in the process of displaying the image to be displayed can be reduced, thereby reducing the display delay of the image to be displayed.
[0093] In one embodiment of the present application, the image display method provided by the present application further includes the following step S2120 and step S2121 before the above step S2100.
[0094] Step S2120: Obtain an application identifier of an application currently running in the foreground of the head mounted display device.
[0095] Step S2121: when the application identifier is a target application identifier, obtain the current image to be displayed and the corresponding target environment image.
[0096] In this embodiment, the target application identifier refers to the identifier of the application with a relatively fixed background. In this way, the color of the target environment image is relatively single. On this basis, the number of target areas divided based on the above step S2200 will be relatively small. This helps to reduce the amount of data processing for the head-mounted display device.
[0097] In an example, the target application identifier may be an application identifier corresponding to a movie APP, an application identifier corresponding to a learning APP, or an application identifier corresponding to a driving simulation APP.
[0098] In one embodiment of the present application, the image display method provided by the present application further includes the following step S2213 before the above step S2210.
[0099] Step S2213, outputting prompt information to remind the wearer that he is in an environment of a preset type of background.
[0100] In this embodiment, the prompt information may be a voice prompt information or a graphic prompt information. The prompt information is used to prompt the wearer to face a single-color background. In this way, the wearer can cooperate with the head-mounted display device in acquiring the environmental image set.
[0101] The present application also provides an image display device 300, which is applied to a head mounted display device, such as Figure 3 As shown, the device comprises:
[0102] An acquisition module 310 is used to acquire a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within the field of view of the wearer of the head mounted display device at the time when the current image to be displayed is displayed;
[0103] A determination module 320, configured to determine a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein pixel values of pixels in the target environment image and the image to be displayed corresponding to pixels in the target area are within a pixel value range of the same color;
[0104] The control module 330 is configured to reduce the brightness of pixels located in the target area in the current image to be displayed when displaying the current image to be displayed.
[0105] In one embodiment of the present application, the acquisition module 310 is specifically used to:
[0106] Collecting environmental images of the head mounted display device in different positions and postures to obtain an environmental image set;
[0107] Obtaining the current position of the head mounted display device;
[0108] According to the current position and posture, an environment image matching the current position and posture is determined from the environment image set as the target environment image.
[0109] In one embodiment of the present application, the determination module 320 is further used to: for any environment image in the environment image set, divide the environment image into colors according to pixel values of pixels in the environment image, and determine different colors included in the environment image and corresponding first area ranges;
[0110] In this embodiment, the determination module 320 is further specifically used to: determine a second area range where a target pixel is located from the image to be displayed, the target pixel being a pixel in the image to be displayed having the same color as that of the target environment image;
[0111] An overlapping area corresponding to the first area range and the second area range in the image to be displayed is determined as the target area.
[0112] In one embodiment of the present application, the determination module 320 is further specifically used to: perform color division on the environment image according to pixel values of pixels in the environment image to obtain different colors included in the environment image and corresponding third area ranges;
[0113] The third area range and the corresponding color in the environmental image that are larger than the preset area ratio of the environmental image are determined as the different colors included in the environmental image and the corresponding first area range.
[0114] In one embodiment of the present application, the acquisition module 310 is further specifically used for:
[0115] Obtaining an application identifier of an application currently running in the foreground of the head mounted display device;
[0116] In the case where the application identifier is a target application identifier, a current image to be displayed and a corresponding target environment image are acquired.
[0117] In one embodiment of the present application, the image display device 300 provided by the present application further includes:
[0118] The prompt module is used to output prompt information to prompt the wearer that the wearer is in an environment of a preset type of background.
[0119] The present application also provides a head-mounted display device, the head-mounted display device comprising any one of the image display devices 300 provided in the above device embodiments;
[0120] Or, if Figure 4 As shown, the head mounted display device 400 includes a memory 410 and a processor 420, the memory 410 is used to store computer instructions, and the processor 420 is used to call the computer instructions from the memory 410 to execute the method as described in any one of the above method embodiments.
[0121] The present application also provides a computer-readable storage medium having a computer program stored thereon, and the computer program, when executed by a processor, implements the method according to any one of the above method embodiments.
[0122] The present application may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present application.
[0123] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.
[0124] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.
[0125] The computer program instructions for performing the operation of the present application can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions can be executed completely on a user's computer, partially on a user's computer, executed as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet). In some embodiments, by using the state information of a computer-readable program instruction to personalize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA) or a programmable logic array (PLA), the electronic circuit can execute a computer-readable program instruction, thereby realizing various aspects of the present application.
[0126] Various aspects of the present application are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0127] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0128] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0129] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a part of a module, program segment or instruction, and the part of the module, program segment or instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.
[0130] The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the present application is defined by the appended claims.
Claims
1. An image display method, characterized in that: Applied to a head mounted display device, the method comprises: Acquire a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within a visual field of a wearer of the head mounted display device at a time when the current image to be displayed is displayed; Determine a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein pixel values of pixels in the target environment image and the image to be displayed corresponding to pixels in the target area are within a pixel value range of the same color; When displaying the current image to be displayed, the brightness of pixels in the current image to be displayed that are located in the target area is reduced.
2. The method according to claim 1, characterized in that The step of acquiring the current image to be displayed and the corresponding target environment image includes the step of acquiring the target environment image, and the step includes: Collecting environmental images of the head mounted display device in different positions and postures to obtain an environmental image set; Obtaining the current position of the head mounted display device; According to the current position and posture, an environment image matching the current position and posture is determined from the environment image set as the target environment image.
3. The method according to claim 2, characterized in that Before determining the target area in the current image to be displayed according to the current image to be displayed and the target environment image, the method further includes: For any environment image in the environment image set, color division is performed on the environment image according to pixel values of pixels in the environment image to determine different colors included in the environment image and corresponding first area ranges; The step of determining the target area in the current image to be displayed according to the current image to be displayed and the target environment image includes: Determine a second area range where a target pixel is located from the image to be displayed, the target pixel being a pixel in the image to be displayed having the same color as that of the target environment image; An overlapping area corresponding to the first area range and the second area range in the image to be displayed is determined as the target area.
4. The method according to claim 3, characterized in that The color division of the environment image according to the pixel values of the pixels in the environment image to determine the different colors included in the environment image and the corresponding first area ranges includes: According to the pixel values of the pixels in the environment image, the environment image is divided into colors to obtain different colors included in the environment image and corresponding third area ranges; The third area range and the corresponding color in the environmental image that are larger than the preset area ratio of the environmental image are determined as the different colors included in the environmental image and the corresponding first area range.
5. The method according to claim 1, characterized in that Before acquiring the current image to be displayed and the corresponding target environment image, the method further includes: Obtaining an application identifier of an application currently running in the foreground of the head mounted display device; In the case where the application identifier is a target application identifier, a current image to be displayed and a corresponding target environment image are acquired.
6. The method according to claim 2, characterized in that Before collecting the environment images of the head mounted display device in different positions to obtain the environment image set, the method further includes: Output prompt information to prompt the wearer that the wearer is in an environment of a preset type of background.
7. An image display device, characterized in that: Applied to a head mounted display device, the device comprises: An acquisition module, used to acquire a current image to be displayed and a corresponding target environment image, wherein the target environment image is an environment image within the field of view of the wearer of the head mounted display device at the time when the current image to be displayed is displayed; A determination module, configured to determine a target area in the current image to be displayed according to the current image to be displayed and the target environment image, wherein pixel values of pixels in the target environment image and the image to be displayed corresponding to pixels in the target area are within a pixel value range of the same color; The control module is used to reduce the brightness of the pixels located in the target area in the current image to be displayed when displaying the current image to be displayed.
8. The device according to claim 7, characterized in that The acquisition module is specifically used for: Collecting environmental images of the head mounted display device in different positions and postures to obtain an environmental image set; Obtaining the current position of the head mounted display device; According to the current position and posture, an environment image matching the current position and posture is determined from the environment image set as the target environment image.
9. A head mounted display device, characterized in that: The head mounted display device comprises the apparatus as claimed in claim 7 or 8; Alternatively, the head mounted display device comprises a memory and a processor, the memory being used to store computer instructions, and the processor being used to call the computer instructions from the memory to execute the method as described in any one of claims 1-6.
10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
