Display device, display method, and display program

The display device addresses the communication burden in information distribution systems by autonomously selecting and displaying objects based on preference matching, reducing the need for frequent user communication.

JP7690976B2Active Publication Date: 2025-06-11JVC KENWOOD CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023172059
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-03
Publication Date
2025-06-11
Estimated Expiration
2039-09-25

AI Technical Summary

Technical Problem

In existing information distribution systems, the user acting as a substitute for shopping needs to frequently communicate with the requester to provide video content matching their preferences, leading to a heavy communication burden.

Method used

A display device equipped with a video acquisition unit, video analysis unit, preference storage unit, and display control unit that acquires and analyzes video images, extracts objects, matches preferences, and displays the objects in a predetermined mode based on preference matching degrees, reducing the need for frequent user communication.

Benefits of technology

The solution reduces the communication burden on the user by enabling the display device to autonomously select and display objects based on preference matching, allowing the user to easily identify preferred items without frequent external communication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007690976000001
    Figure 0007690976000001
  • Figure 0007690976000002
    Figure 0007690976000002
  • Figure 0007690976000003
    Figure 0007690976000003
Patent Text Reader

Abstract

To provide a display device, a display method and a display program which can reduce a burden on a user.SOLUTION: A display device comprises: a body part which has a display unit; a video acquisition unit which acquires a video to be displayed on the display unit; a video analysis unit which extracts a prescribed object from the acquired video; a taste storage unit which stores taste data indicating a preference to the prescribed object; a calculation unit which obtains the taste matching degree indicating the matching degree between the taste data stored in the taste storage unit and the object extracted by the video analysis unit; and a display control unit which displays the prescribed object on the display unit by a prescribed display mode on the basis of the taste matching degree.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a display device, a display method, and a display program.

Background Art

[0002] By making it possible to communicate between a distribution device on the distributor side and a receiving device on the receiver side, there is known an information distribution system that distributes video so that a receiver in a remote location can feel a sense of presence (see, for example, Patent Document 1). In such an information distribution system, a distributor can, for example, act as a distribution device and, while wearing or holding a display device having a display unit such as a head-mounted display (hereinafter referred to as an HMD), a smartphone, etc., substitute for shopping for a receiver in a remote location.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above technology, the user (distributor) of the display device who is a substitute for shopping is required to act in accordance with the intention of the requester (receiver), such as providing the receiver with a video of a product according to the receiver's preference. Therefore, the user needs to frequently communicate with the requester and may bear a heavy burden.

[0005] The present invention has been made in view of the above, and it is possible to reduce the burden on the user. The present invention aims to provide a display device, a display method, and a display program. [Means for solving the problem]

[0006] The display device according to the present invention includes a main body having a display unit, and a display unit for acquiring an image to be displayed on the display unit. a video acquisition unit that acquires a video image and a video analysis unit that extracts a predetermined object from the acquired video image; a preference storage unit for storing preference data about the object; Based on the obtained preference data, a preference list of the object extracted by the video analysis unit is generated. a calculation unit for calculating a degree of matching; and a calculation unit for calculating a degree of matching between the tastes of the object and the image of the object based on the degree of matching between the tastes of the object. and a display control unit for displaying the image on the display unit in the display mode.

[0007] A display method according to the present invention includes acquiring an image to be displayed on a display unit provided on a main body unit, Extracting a predetermined object from the acquired image; and determining a degree of preference matching of the extracted object based on the previously stored preference data. and displaying the image of the object in a predetermined display mode based on the degree of preference match. and displaying the same on the display unit by

[0008] The display program according to the present invention acquires an image to be displayed on a display unit provided on the main body. a process of extracting a predetermined object from the acquired image; The degree of match between the preference data indicating the preference for the object and the extracted object is calculated. and determining a preference matching degree indicating the predetermined object based on the preference matching degree. The computer executes a process of displaying the information on the display unit in a predetermined display format. Effect of the Invention

[0009] According to the present invention, it becomes possible to reduce the burden on the distributor.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments of a display device, a display method, and a display program according to the present invention will be described with reference to the drawings. Note that the present invention is not limited by this embodiment. Also, the components in the following described embodiments include those that can be replaced and are easy for those skilled in the art, or those that are substantially the same.

[0012] FIG. 1 is a diagram showing an example of a display device 100 according to the present embodiment. As shown in FIG. 1, the display device 100 includes a main body unit 10, a photographing unit 20, and a control device 30. The main body unit 10 has a mounting mechanism that can be mounted on the user's head. The main body unit 10 has a display unit 11. The display unit 11 can display information such as images. In this embodiment, an example of the display device 100 ​As a configuration in which a head-mounted display (HMD) device is used, an explanation will be given. This In this case, the display unit 11 is a head-mounted display such as a so-called VR (Virtual Reality) device or AR (Augmented Reality) glasses, etc., and is arranged at a position covering both eyes of the user while the user is wearing it on the head.

[0013] The imaging unit 20 is attached to the main body unit 10. As the imaging unit 20, for example, a camera or the like is used. The imaging unit 20 can capture an image along the line of sight of the user when the user wears the main body unit 10 on the head. The imaging unit 20 transmits the captured image to the control device 30.

[0014] The control device 30 has a processing device such as a CPU (Central Processing Unit) and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The control device 30 includes an image acquisition unit 31, an image analysis unit 32, an arithmetic unit 33, an environmental information detection unit 34, a display control unit 35, a storage unit 36, and a communication unit 37.

[0015] The image acquisition unit 31 acquires the image captured by the imaging unit 20. The image analysis unit 32 extracts a predetermined object from the acquired image. Examples of the predetermined object include products sold in a predetermined store. The image analysis unit 32 performs image processing and the like on the acquired image, and can extract the object if the object is shown in the image. Note that in the storage unit 36 described later, data and the like for the image analysis unit 32 to perform various determinations in image processing are stored.

[0016] An object includes one or more elements. For example, when the object is clothing it will be described by way of example. Clothing has various elements such as genre (polo shirt, T-shirt, Y-shirt, trousers, etc.), shape (overall contour, each part: shape of collar, sleeves, buttons, pockets, etc.), dimensions (overall dimensions, each part: dimensions of collar, sleeves, etc.), color or pattern, material, etc.

[0017] When purchasing clothing, depending on the person or the time of purchase, etc., the preferences for the elements of the object differ. For example, regarding the type of clothing, there are people who prefer polo shirts and people who prefer T-shirts. Also, in summer, summer clothing is more likely to be preferred, and in winter, winter clothing is more likely to be preferred. In this embodiment, element data indicating the preferences (likes) of the purchaser (for example, the recipient) for the elements of such an object is stored as preference data in the preference storage section 36a of the storage unit 36. Also, the preference data may be set separately from the elements of the object. For example, the preference data may be set based on the purchaser's previous purchase history. Also, by obtaining information from the purchaser's smartphone, etc., the preference data can be set based on, for example, the Internet browsing history or search history, etc.

[0018] The arithmetic unit 33 obtains the preference matching degree of the object extracted by the video analysis unit 32 based on the preference data stored in the preference storage unit 36a. The preference matching degree is a value indicating the preference matching degree between the extracted object and the preference indicated by the preference data. When the arithmetic unit 33 obtains the preference matching degree, it calculates a score based on the similarity between the elements of the extracted object and the element data for the elements of the object stored in the preference storage unit 36a of the storage unit 36. Output and determine the degree of preference matching based on the total score. For example, the higher the score, the higher the degree of preference matching. Also, the lower the score, the lower the degree of preference matching. Further, for example, when the object is clothing, elements such as shape or color are important elements in selecting the object and have a great influence. Therefore, regarding the similarity of elements such as shape or color, weights can be assigned compared to other elements to calculate the score. Also, the arithmetic unit 33 may calculate the degree of preference matching in two levels of whether the score is higher or lower than a predetermined threshold value. The environmental information detection unit 34 detects environmental information about the environment around the main body unit 10. The environmental information detection unit 34 stores the detected environmental information in the environmental information storage unit 36b of the storage unit 36. Examples of environmental information include the state of the user wearing the main body unit 10 (during movement, stopped, in conversation, etc.), the state of the imaging unit 20 attached to the main body unit 10 (the angle of view of the camera, etc.), the location where the main body unit 10 is located (indoors, outdoors, inside the store, outside the store, etc.), the situation inside the store when the main body unit 10 is located inside the store (distance from the product, price of the product, inventory of the product, etc.), weather (weather, temperature, humidity, etc.), and so on. Note that the specific configuration of the environmental information detection unit 34 will be described. The environmental information detection unit 34 includes a GPS sensor and detects environmental information indicating the state of the user (during movement, stopped, etc.) by detecting position information. Also, the environmental information detection unit 34 detects environmental information indicating the state of the imaging unit 20 (the angle of view of the camera, etc.) by reading the settings such as the angle of view of the camera stored in the storage unit 36. Also, the environmental information detection unit 34 reads the map information stored in the storage unit 36 and compares the position information with the map information to determine the location where the main body unit 10 is located (indoors, outdoors, etc.).

[0019] ​​​​​​​​​​​​​​​​It detects (indoors, outdoors, inside the store, outside the store, etc.). Alternatively, the environmental information detection unit 34 includes an antenna module capable of receiving radio waves by Wi-Fi ( registered trademark) or Bluetooth (registered trademark), and when it receives radio waves from a wireless transmitter installed in a store or the like, it detects the location (indoors, inside the store, etc.) where the main body 10 is located. Alternatively, the environmental information detection unit 34 acquires the video captured by the video acquisition unit 31, and when a QR code (registered trademark) indicating the store is analyzed from the video, it detects the location (indoors, inside the store, etc.) where the main body 10 is located. Further, the environmental information detection unit 34 includes an antenna module connectable to the Internet, and detects environmental information indicating the situation inside the store (distance from products, prices of products, inventory of products, etc.), weather (weather, temperature, humidity, etc.), etc. from a specific server via the Internet. The environmental information detection unit 34 may include all of the above configurations or only a part of them. The display control unit 35 controls the display operation of the display unit 11. The display control unit 35 causes the display unit 11 to display the video acquired by the video acquisition unit 31. Further, the display control unit 35 causes the display unit 11 to display the video of the object in a predetermined display mode based on the preference matching degree calculated by the arithmetic unit 33. Examples of the predetermined display mode include highlighting display that highlights and displays it with respect to other areas. For example, a display mode that highlights the outline of the object, a display mode that displays a bounding box for the object, a display mode that enlarges and displays the object, a display mode that displays an effect (sparkling, aura, etc.) for the object, a display mode that reduces the visibility of areas other than the object, and the like. The environmental information detection unit 34 may include all of the above configurations or only a part of them.

[0020] The display control unit 35 controls the display operation of the display unit 11. The display control unit 35 causes the display unit 11 to display the video acquired by the video acquisition unit 31. Also, the display control unit 35 causes the display unit 11 to display the video of the object in a predetermined display mode based on the preference matching degree calculated by the arithmetic unit 33. Examples of the predetermined display mode include highlighting display that highlights and displays it with respect to other areas. For example, a display mode that highlights the outline of the object, a display mode that displays a bounding box for the object, a display mode that enlarges and displays the object, a display mode that displays an effect (sparkling, aura, etc.) for the object, a display mode that reduces the visibility of areas other than the object, and the like. For example, a display mode that emphasizes the outline of the object, a display mode that displays a bounding box for the object, a display mode that enlarges and displays the object, a display mode that displays an effect (sparkling, aura, etc.) for the object, a display mode that reduces the visibility of areas other than the object, etc. are mentioned. For example, a display mode that emphasizes the outline of the object, a display mode that displays a bounding box for the object, a display mode that enlarges and displays the object, a display mode that displays an effect (sparkling, aura, etc.) for the object, a display mode that reduces the visibility of areas other than the object, etc. For example, a display mode that emphasizes the outline of the object, a display mode that displays a bounding box for the object, a display mode that enlarges and displays the object, a display mode that displays an effect (sparkling, aura, etc.) for the object, a display mode that reduces the visibility of areas other than the object, etc. For example, a display mode that emphasizes the outline of the object, a display mode that displays a bounding box for the object, a display mode that enlarges and displays the object, a display mode that displays an effect (sparkling, aura, etc.) for the object, a display mode that reduces the visibility of areas other than the object, etc.

[0021] The storage unit 36 ​​stores various information. The storage unit 36 ​​may be, for example, a hard disk drive, The storage unit 36 ​​includes a solid state drive. Alternatively, an external storage medium such as a portable disk may be used. The storage unit 36 ​​may be provided independently of the preference storage unit 36a and the environmental information storage unit 36b. The information storage unit 36b.

[0022] The preference storage unit 36a stores preference data for the elements of the object. 2 is a diagram showing an example of preference data stored in a preference storage unit 36a. The preferred storage unit 36a stores the elements of the object (genre, shape, color, etc.) and the specific information of iodine. The type and the coefficient for the specific type are stored in association with each other. The coefficient is calculated based on the preference matching degree. The coefficient is a weighting factor for calculating the score when determining whether a user has a preference for a particular item. Values ​​are set for each subject accordingly.

[0023] The environmental information storage unit 36b stores the environmental information detected by the environmental information detection unit 34. FIG. 3 is a diagram showing an example of the environmental information stored in the environmental information storage unit 36b. As shown in FIG. 1, the environmental information storage unit 36b stores the specific type of detected environmental information and the The environmental information is stored in association with the location.

[0024] The storage unit 36 ​​also stores a process for acquiring an image to be displayed on the display unit 11 provided in the main body unit 10. The process involves extracting a given object from the captured image, and processing the object in relation to the given object. A preference match indicating the degree of match between the preference data indicating the preference to use and the extracted object and displaying a predetermined object in a predetermined display mode based on the degree of preference match. A display program that causes a computer to execute a process to be displayed on the display unit 11 is stored.

[0025] The communication unit 37 can communicate information via a network (not shown). The communication unit 37 may perform either wired or wireless communication. The communication unit 37, for example, as information and transmits images acquired by the image acquisition unit 31, images of objects displayed in a predetermined display mode by the display control unit 35, etc. can be transmitted.

[0026] In the present embodiment, as an example, a case will be described where, at the request of a recipient (requestor) located at a remote location, a user substitutes for shopping for clothes (objects) at an actual store. The recipient side is provided with a receiving device 200 capable of receiving information transmitted from the communication unit 37 of the display device 100. The receiving device 200 has a display unit (not shown). The receiving device 200 is configured such that the image transmitted from the communication unit 37 is displayed on the display unit 201. The recipient can view the image displayed on the display unit 11 of the display device 100, that is, the image acquired by the photographing unit 20 and the image of the object displayed in a predetermined display mode, in the same manner as the user, by looking at the display unit 201 of the receiving device 200. has a display unit (not shown). The receiving device 200 is configured such that the image transmitted from the communication unit 37 is displayed on the display unit 201. The recipient can view the image displayed on the display unit 11 of the display device 100, that is, the image acquired by the photographing unit 20 and the image of the object displayed in a predetermined display mode, in the same manner as the user, by looking at the display unit 201 of the receiving device 200. has a display unit (not shown). The receiving device 200 is configured such that the image transmitted from the communication unit 37 is displayed on the display unit 201. The recipient can view the image displayed on the display unit 11 of the display device 100, that is, the image acquired by the photographing unit 20 and the image of the object displayed in a predetermined display mode, in the same manner as the user, by looking at the display unit 201 of the receiving device 200. is configured such that the image transmitted from the communication unit 37 is displayed on the display unit 201. The recipient can view the image displayed on the display unit 11 of the display device 100, that is, the image acquired by the photographing unit 20 and the image of the object displayed in a predetermined display mode, in the same manner as the user, by looking at the display unit 201 of the receiving device 200.

[0027] Next, the operation of the display device 100 configured as described above will be described. The user wears the main body 10 of the display device 100 on the head and goes to a store that sells the object to be purchased. The photographing unit 20 photographs the image in the line of sight of the user. The display control unit 35 causes the image acquired by the image acquisition unit 31 to be displayed on the display unit 11. The environmental information detection unit 34 acquires environmental information around the main body 10 and stores the environmental information in the environmental information storage unit 36b of the storage unit 36. Note that the object information around the main body 10 and stores the environmental information in the environmental information storage unit 36b of the storage unit 36. Note that the object information around the main body 10 and stores the environmental information in the environmental information storage unit 36b of the storage unit 36. Note that the object The preference data of the recipient for the object is stored in advance in the preference storage unit 36a of the storage unit 36. Keep it.

[0028] FIG. 4 is a diagram showing an example of the display content on the display unit 11 of the display device 100. When the user is detected by the environment information detection unit 34 as moving outdoors or indoors, the display control unit 35 can display an image of an object having an element preferred by the recipient among the objects for purchase on the display unit 11. As shown in FIG. 4, the display control unit 35 can, for example, show an image of the object in a predetermined display area 12 of the display unit 11. Note that in FIG. 4, videos other than the image of the object are omitted. Incidentally, in FIG. 4, videos other than the image of the object are omitted.

[0029] At this time, the display control unit 35 can adjust the number of objects to be displayed on the display unit 11 according to the environment information. For example, the display control unit 35 increases the number of displays when the angle of view of the photographing unit 20 is large, and decreases the number of displays when the angle of view is small. The number of displays of the object can be adjusted according to the setting of the angle of view of the photographing unit 20. Further, for example, the display control unit 35 decreases the number of displays of the object when the main body 10 is located outdoors, increases the number of displays of the object when it is located indoors, and can further increase the number of displays of the object when it is located inside the store selling the target object. In addition, the display control unit 35 can decrease the number of displays of the object when the weather is bad (rain, snow, strong wind, etc.) compared to when the weather is good (sunny, cloudy, etc.). In addition, the display control unit 35 can decrease the number of displays of the object when the weather is bad (rain, snow, strong wind, etc.) compared to when the weather is good (sunny, cloudy, etc.). 35 decreases the number of displays of the object when the main body 10 is located outdoors, increases the number of displays of the object when it is located indoors, and can further increase the number of displays of the object when it is located inside the store selling the target object. In addition, the display control unit 35 can decrease the number of displays of the object when the weather is bad (rain, snow, strong wind, etc.) compared to when the weather is good (sunny, cloudy, etc.). When the user enters the target store, the environment information detection unit 34 detects the environment around the main body 10. In addition, the display control unit 35 can decrease the number of displays of the object when the weather is bad (rain, snow, strong wind, etc.) compared to when the weather is good (sunny, cloudy, etc.). In addition, the display control unit 35 can decrease the number of displays of the object when the weather is bad (rain, snow, strong wind, etc.) compared to when the weather is good (sunny, cloudy, etc.).

[0030] When the user enters the target store, the environment information detection unit 34 detects the environment around the main body 10. Change the information from outside the store to inside the store. When the environmental information is changed to inside the store, the display control unit 35 , changes the display mode of the object. FIG. 5 is a diagram showing another example of the display content of the display unit 11 . In a state where the user is inside the store, as shown in FIG. 5, the display control unit 35 enlarges the display area 12 of the object preferred by the subscriber.

[0031] Also, the video acquisition unit 31 acquires the video captured by the imaging unit 20. The video analysis unit 32 extracts the object of the clothes from the acquired video. The calculation unit 33 obtains the preference matching degree of the object extracted by the video analysis unit 32 based on the preference data stored in the preference storage unit 36a . The calculation unit 33 calculates, for example, the score of the extracted object, and determines that the preference matching degree is high when it is higher than a predetermined threshold , and determines that the preference matching degree is low when it is lower than the predetermined threshold . Also, the environmental information detection unit 34 detects environmental information about the environment around the main body unit 10 and stores the detected environmental information in the environmental information storage unit 36b of the storage unit 36 . .

[0032] The display control unit 35 displays the video of the object on the display unit 11 in a predetermined display mode based on the preference matching degree calculated by the calculation unit 33 and the environmental information detected by the environmental information detection unit 34 . FIG. 5 is a diagram showing another example of the display content on the display unit 11 of the display device 100. As shown in FIG. 5, the display control unit 35 can display the objects P1, P2 , P3 extracted by the video analysis unit 32 on the display unit 11 respectively. Among these, for example, for the object P1 determined to have a high matching degree , it may be displayed enlarged compared to the other objects P2, P3 . Also, the display control unit 35, for example, represents the object P1 with the highest matching degree . Also, the display control unit 35, for example, represents the object P1 with the highest matching degree It may be displayed at the center of the display area 13. Further, the display control unit 35 determines that the degree of match is low For the object P3, for example, a hatching display may be performed on the whole to reduce visibility as a display mode. The predetermined display form of the object is not limited to the above and other display forms may be used.

[0033] In addition, for example, in the store, for the objects P1 and P2 determined to have a high degree of match, the display control unit 35 for the objects P1 and P2, when the distance between the product corresponding to the objects P1 and P2 and the main body 10 approaches, a display mode such as increasing the emphasis of the display as the distance approaches may be used as well. For example, the display control unit 35 analyzes the video in which the products corresponding to the objects P1 and P2 are photographed and determines whether the distance between the product and the main body 10 is approaching based on the change in the size of the photographed product within several tens of seconds.

[0034] In addition, the environmental information detection unit 34 may acquire product information about at least one of the price and inventory of the products corresponding to the objects P1 and P2 from the store, for example. In this case, the display control unit 35 can highlight the objects P1 and P2 according to the product information. The display control unit 35, for example, when the price of the product corresponding to the objects P1 and P2 is a discounted price may highlight the objects P1 and P2. Also, when the inventory of the products corresponding to the objects P1 and P2 is low, an emphasis display such as blinking the objects P1 and P2 may be performed so that it is possible to determine that the inventory is low. Note that the mode of the emphasis display is not limited to the above mode, and other modes are possible.

[0035] ​​​​​Also, when the display control unit 35 displays an object on the display unit 11, for example, when the main body unit 1 0 is located indoors, compared to the case where the main body unit 10 is not located indoors, the number of objects to be displayed can be increased. In this way, the display control unit 35 can adjust the number of objects to be displayed according to the environmental information.

[0036] FIG. 6 is a flowchart showing an example of the display method according to the present embodiment. As shown in FIG. 6 the video acquisition unit 31 acquires the video captured by the imaging unit 20 (step S10). The display control unit 35 displays the acquired video on the display unit 11. Also, the video analysis unit 32 extracts a predetermined object from the acquired video (step S20). In step S20 the video analysis unit 32 can extract a predetermined object by performing image processing such as pattern matching using a template prepared for each predetermined object. Note that the method for extracting a predetermined object by the video analysis unit 32 is not limited to this, and various image processing methods can be used.

[0037] The calculation unit 33 obtains the preference matching degree of the above-extracted object based on the preference data stored in advance in the preference storage unit 36a of the storage unit 36 for the object (step S30). In step S30, the calculation unit 33 calculates a score according to the similarity with the element data for each element of the object, and obtains the preference matching degree based on the total score.

[0038] The display control unit 35 displays the video of the object on the display unit 11 in a predetermined display state based on the obtained preference matching degree (step S40). In step S40, the display control ​​​​​​In addition to the preference matching degree, the unit 35 may set the display mode of the video of the object based on the environmental information acquired by the environmental information detection unit 34.

[0039] As described above, the display device 100 according to the present embodiment includes a main body unit 10 having a display unit 11, a video acquisition unit 31 that acquires a video to be displayed on the display unit 11, a video analysis unit 32 that extracts a predetermined object from the acquired video, a preference storage unit 36a that stores preference data indicating a preference for a predetermined object, the preference data stored in the preference storage unit 36a, and an arithmetic unit 33 that obtains a preference matching degree indicating the degree of matching between the object extracted by the video analysis unit 32, and a display control unit 35 that displays a predetermined object on the display unit 11 in a predetermined display mode based on the preference matching degree.

[0040] Further, the display method according to the present embodiment includes acquiring an image to be displayed on the display unit 11 provided in the main body unit 10, extracting a predetermined object from the acquired video, obtaining a preference matching degree indicating the degree of matching between preference data indicating a preference for the predetermined object and the extracted object, and displaying a predetermined object on the display unit 11 in a predetermined display mode based on the preference matching degree.

[0041] Further, the display program according to the present embodiment includes a process of acquiring a video to be displayed on the display unit 11 provided in the main body unit 10, a process of extracting a predetermined object from the acquired video, a process of obtaining a preference matching degree indicating the degree of matching between preference data indicating a preference for a predetermined object and the extracted object, and a process of displaying a predetermined object on the display unit 11 in a predetermined display mode based on the preference matching degree. ​​​​​​The computer is caused to execute a process of displaying on the display unit 11 in a predetermined display mode.

[0042] According to this embodiment, based on the preference data stored in advance, the preference matching degree of the extracted object is obtained, and the video of the object is displayed on the display unit 11 in a predetermined display mode based on the obtained preference matching degree. As a result, even without frequent communication with the outside, the user can easily grasp the object to be selected, so the burden on the user can be reduced.

[0043] The display device 100 according to this embodiment further includes an environmental information detection unit 34 that detects environmental information about the environment around the main body unit 10, and the display control unit 35 sets the display mode based on the preference matching degree and the environmental information. Thereby, the display mode can be set flexibly according to the environment around the main body unit 10.

[0044] In the display device 100 according to this embodiment, the environmental information includes information about whether the main body unit 10 is located indoors, and when the main body unit 10 is located indoors, the display control unit 35 increases the number of objects to be displayed compared to when the main body unit 10 is not located indoors. As a result, when not located indoors, that is, when located outdoors, the number of objects to be displayed decreases, so the user's field of view can be ensured.

[0045] In the display device 100 according to this embodiment, the object is a product sold in a predetermined store, and the environmental information includes information about whether the main body unit 10 is located inside the store. Thereby, the display mode is different when the main body unit 10 is located inside the store and when it is not located inside the store. can be set differently.

[0046] In the display device 100 according to the present embodiment, the environmental information includes the distance between the main body 10 and the product corresponding to the object, and the display control unit 35 enlarges and displays the object as the distance approaches. This allows the user to intuitively recognize that they are approaching the product corresponding to the object.

[0047] In the display device 100 according to the present embodiment, the environmental information includes product information regarding at least one of the price of the object and the inventory quantity of the object, and the display control unit 35 sets a display mode according to the product information. This enables the user to also recognize the product information.

[0048] In the display device 100 according to the present embodiment, the preference data includes element data that can be set for each element of the object, and the arithmetic unit 33 calculates a score based on the similarity between the elements of the object extracted by the video analysis unit 32 and the element data stored in the preference storage unit 36a, and obtains a preference matching degree based on the total score. This enables the preference matching degree to be obtained with high accuracy.

[0049] The technical scope of the present invention is not limited to the above embodiments, and appropriate changes can be made without departing from the spirit of the present invention. For example, in the above embodiments, clothes are exemplified as the object, but it is not limited thereto, and other types of products may be the object. Also, the display device 100 is not limited to the HMD device of the above embodiment, and may be, for example, a terminal device having a display unit such as a smartphone.

Description of Symbols

[0050] P1, P2, P3… Objects, 10… Main body, 11, 201… Display units, 12, 13 … Display area, 20… Photographing unit, 30… Control device, 31… Video acquisition unit, 32… Video analysis unit, 3 3… Arithmetic unit, 34… Environmental information detection unit, 35… Display control unit, 36… Memory unit, 36a… Preference record Memory unit, 36b… Environmental information memory unit, 37… Communication unit, 100… Display device, 200… Receiving device

Claims

1. An environment information detection unit that detects environment information regarding whether a main body unit having a display unit is located indoors or not; A display control unit that, when the main body unit is not located indoors, displays with a reduced number of objects provided with elements preferred by the user arranged and displayed as compared to when the main body unit is located indoors; A control device comprising the above.

2. An environment information detection step of detecting environment information regarding whether a main body unit having a display unit is located indoors or not; A display control step of, when the main body unit is not located indoors, displaying with a reduced number of objects provided with elements preferred by the user arranged and displayed as compared to when the main body unit is located indoors; A control method including the above.

3. An environment information detection step of detecting environment information regarding whether a main body unit having a display unit is located indoors or not; A display control step of, when the main body unit is not located indoors, displaying with a reduced number of objects provided with elements preferred by the user arranged and displayed as compared to when the main body unit is located indoors; A control program for causing a computer to execute the above.

Citation Information

Patent Citations

  • Network type real-time communication system

    JP2009259135A

  • Information provision system, information provision device, program for shopping and information provision method

    JP2014157498A

  • Loading device, and consumable supply residual quantity notification method

    JP2015162164A

  • Display control method, display control program, and information processing apparatus

    JP2016184294A

  • Apparatus, method and program

    JP2017191499A