Device control method, device control apparatus, electronic device, program, and image posting system

Abstract

To suppress posting of an image which does not satisfy posting conditions.SOLUTION: Acquiring a candidate image of a candidate to be posted to the image posting service, executing a determination process of determining whether or not an owned item owned by a user of the electronic device and registered in a predetermined database is included in the candidate image, and executing permission control of switching a state of the electronic device to a state in which posting of the candidate image to the image posting service is possible in a case where it is determined in the determination process that the owned item is included in the candidate image.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a device control method, a device control device, an electronic device, a program, and an image posting system. [Background technology]

[0002] Conventionally, there have been image posting services that allow users to take and post images that include predetermined items, such as coordinated images that include clothing items (for example, Patent Document 1). Such image posting services also allow other users to view the posted images. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-181385 Summary of the Invention [Problem to be solved by the invention]

[0004] However, many image posting services allow users to post images that do not contain certain items and do not meet the posting conditions. This causes inconvenience to users who want to view images that meet the posting conditions, and also requires operators of image posting services to manually search for and delete images that do not meet the posting conditions, which is time-consuming.

[0005] The present invention aims to suppress the posting of images that do not satisfy posting conditions. [Means for solving the problem]

[0006] In order to solve the above problems, a device control method according to the present invention includes: A device control method for controlling an electronic device, comprising: Obtain candidate images to be posted to the image posting service; executes a determination process to determine whether or not the candidate image includes a personal item owned by the user of the electronic device and registered in a predetermined database; If it is determined in the discrimination process that the candidate image includes the owned item, permission control is executed to switch the state of the electronic device to a state in which the candidate image can be posted to the image posting service. [Effects of the Invention]

[0007] According to the present invention, it is possible to prevent images that do not satisfy posting conditions from being posted. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a configuration of an image posting system. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of a server. [Figure 3] FIG. 10 is a diagram showing the contents of a user information DB. [Figure 4] FIG. 10 is a diagram showing the contents of a posted image DB. [Figure 5] FIG. 2 is a block diagram showing the functional configuration of the smartphone. [Figure 6] FIG. 2 is a block diagram showing the functional configuration of the electronic timepiece. [Figure 7] 10 is a flowchart showing a control procedure of a posting control process. [Figure 8] 10 is a flowchart showing a control procedure of a posting control process. [Figure 9] FIG. [Figure 10] FIG. 10 is a diagram showing a model selection screen. [Figure 11] FIG. 10 is a diagram showing a posting screen. [Figure 12] FIG. 10 is a diagram showing a confirmation screen. [Figure 13] 10 is a flowchart showing a control procedure for posted image display processing. [Figure 14] FIG. 10 is a diagram showing a posted image display screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] An embodiment of the present invention will now be described with reference to the drawings. FIG. 1 is a diagram illustrating the configuration of an image posting system 1. The image posting system 1 includes a server 10 (device control device), a smartphone 20 (electronic device), and an electronic watch 30 (target item, owned item). The smartphone 20 is connected to the server 10 via a network N to enable data communication. The network N may include, but is not limited to, a mobile communication network provided by a mobile communications carrier and / or the Internet. The electronic watch 30 is a wristwatch (wearable device) worn on the user's wrist. The smartphone 20 and the electronic watch 30 are carried and used by the same user. There are many models of electronic watches 30, some of which are capable of communicating and connecting with the smartphone 20 via short-range wireless communication to exchange data. The image posting system 1 of this embodiment uses Bluetooth (registered trademark) Low Energy (BLE) as short-range wireless communication. However, other types of short-range wireless communication may also be used. The electronic watch 30 and smartphone 20 capable of BLE communication operate in conjunction with each other by communicating and transmitting and receiving data via BLE. For example, the electronic clock 30 receives time information from the smartphone 20 at predetermined times throughout the day (for example, four times every six hours) and adjusts the internal time. In addition, by configuring the electronic clock 30 (such as setting the alarm time or world time) on a linking application program (hereinafter referred to as a "linking app") installed on the smartphone 20, the settings can be reflected in the electronic clock 30 that is connected to the smartphone 20. The image posting system 1 may include multiple smartphones 20 and multiple electronic clocks 30 used by multiple users.

[0010] The image posting system 1 provides an image posting service to users. Using an application program for the image posting service (hereinafter referred to as the "posting app") installed on a smartphone 20, users can take images and post them to the server 10, and view posted images posted by themselves and other users. The image posting service allows users to post images related to fashion coordination including predetermined types of target items. In the image posting service, a condition for images that can be posted (hereinafter referred to as the "posting condition") is that the image must include the target item and at least one coordinating item (combination item, fashion item) of a different type from the target item. In this embodiment, the type of the target item is a wristwatch, i.e., an electronic watch 30. Therefore, users can post images that include the electronic watch 30 and coordinating items other than the electronic watch 30. The image posting system 1 also allows users to register and manage the models of electronic watches 30 (owned items) owned by users in the server 10. A single user can also register multiple different models of electronic watches 30 in the server 10.

[0011] The server 10 executes various processes related to the image posting service and controls the operation of the smartphone 20 related to posting and viewing of images through a posting app. As shown in FIG. 2, the server 10 includes a central processing unit (CPU) 11 (control unit, second control unit), a random access memory (RAM) 12, a storage unit 13, and a communication unit 14. The components of the server 10 are connected via a data transmission path such as a bus. The CPU 11 is a processor that reads and executes a program 131 stored in the storage unit 13 and controls the operation of the components of the server 10 by performing various arithmetic operations. The server 10 may have multiple processors (e.g., multiple CPUs), and the multiple processes executed by the CPU 11 in this embodiment may be executed by the multiple processors. In this case, the multiple processors correspond to the control unit. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel. The RAM 12 provides a working memory space for the CPU 11 and stores temporary data.

[0012] The storage unit 13 is a non-transitory recording medium readable by the CPU 11 as a computer, and stores a program 131 and various data. The storage unit 13 includes a non-volatile memory such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). Data stored in the storage unit 13 includes a user information DB 132 (a predetermined database), a posted image DB 133, a machine learning model 134, and the like.

[0013] As shown in FIG. 3, the user information DB 132 stores user IDs and information related to registered watches registered in the image posting system 1 by users with the corresponding user IDs, in association with each other. The user ID is a unique code assigned to each user. The registered watch information includes the model number of the electronic watch 30 and information on whether the electronic watch 30 has a BLE connection function. The information on whether the electronic watch 30 has a BLE connection function is one of “automatic,” “manual,” and “non-compatible.” “Automatic” indicates that the electronic watch 30 is a model that automatically establishes a BLE communication connection with the smartphone 20. “Manual” indicates that the electronic watch 30 establishes a BLE communication connection with the smartphone 20 in response to a predetermined operation performed by the user on the electronic watch 30. “Non-compatible” indicates that the electronic watch 30 does not have the function to establish a BLE connection with the smartphone 20. As shown in FIG. 3, in this embodiment, a user with a user ID of “U001” owns three electronic watches 30 with model numbers “M003,” “M005,” and “M012,” and these electronic watches 30 are registered in the server 10.

[0014] One row of data in the posted image DB 133 shown in FIG. 4 corresponds to a record of one posted image posted by a certain user and registered on the server 10. Each record includes the data items of "posted image ID," "posting user ID," "posting date," "photography location," "watch model," "coordination items," and "number of likes." "Posted image ID" is a unique code assigned to a posted image. "Posting user ID" is the user ID of the user who posted the posted image. "Posting date" is the date the posted image was posted. "Photo location" is the location where the posted image was photographed. "Watch model" is the model number of the watch (electronic watch 30) included in the posted image. "Coordination items" are fashion items other than the electronic watch 30 included in the posted image. "Number of likes" is the cumulative number of times the like button 58 (see FIG. 14) for a posted image has been pressed by users who viewed the posted image.

[0015] The machine learning model 134 shown in FIG. 2 is used in an extraction process to extract specific items contained in an image. The machine learning model 134 has been trained in advance so that when an image is input, it recognizes (identifies) and outputs the items contained in the image. In this embodiment, the items to be recognized are wristwatches and various coordinating items (fashion items). Specifically, the machine learning model 134 has been trained in advance using training images of multiple models of wristwatches. When an image to be analyzed is input, it recognizes the wristwatch contained in the image and identifies and outputs at least one candidate model of the wristwatch. Furthermore, the machine learning model 134 has been trained in advance using training images of multiple coordinating items. When an image to be analyzed is input, it recognizes the coordinating items contained in the image and outputs the item names. Coordinating items may be, for example, but are not limited to, shirts, jackets, pants, skirts, shoes, hats, etc.

[0016] The communication unit 14 performs a communication operation in accordance with a predetermined communication standard. The communication unit 14 transmits and receives data to and from the smartphone 20 via the network N through this communication operation.

[0017] As shown in FIG. 5 , the smartphone 20 includes a CPU 21 (first control unit), a RAM 22, a storage unit 23, a display unit 24, an operation unit 25, a camera 26, a short-range wireless communication unit 27, a mobile data communication unit 28, and a location information acquisition unit 29. The CPU 21, RAM 22, and storage unit 23 constitute a control device 200 that controls the operation of the smartphone 20. The components of the smartphone 20 are connected via a data transmission path such as a bus. The CPU 21 is a processor that reads and executes a program 231 stored in the storage unit 23 and performs various arithmetic operations to control the operation of the components of the smartphone 20. The smartphone 20 may include multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 21 of this embodiment may be executed by the multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel. The RAM 22 provides a working memory space for the CPU 21 and stores temporary data. The storage unit 23 is a non-transitory recording medium readable by the CPU 21 as a computer, and stores the program 231 and various data. The storage unit 23 includes a non-volatile memory such as a flash memory. The program 231 is stored in the storage unit 23 in the form of computer-readable program code. The program 231 includes the above-mentioned linked app and posting app.

[0018] The display unit 24 displays various screens of the linked app and the posting app in accordance with control signals transmitted from the CPU 21. The display unit 24 may be, for example, a liquid crystal display device that displays using a dot matrix method. The operation unit 25 accepts input operations from the user and outputs an input signal corresponding to the input operation to the CPU 21. The operation unit 25 includes a touch panel overlaid on the display screen of the display unit 24, and detects contact with the user's finger or the like as an input operation using the touch panel. The operation unit 25 may also include hardware buttons in addition to or instead of the touch panel, and may be able to accept input operations via the hardware buttons. The camera 26 is an imaging device including an imaging element such as a CCD (Charge-Coupled Device) and an optical system such as a lens. The camera 26 captures an image within a range determined by the imaging element and the optical system, generates data of the captured image, and outputs the data to the CPU 21.

[0019] The short-range wireless communication unit 27 is a communication module having an antenna, a modulation / demodulation circuit, a signal processing circuit, etc., and performs short-range wireless communication with the electronic watch 30 via BLE. The mobile data communication unit 28 is a communication module having an antenna, a modulation / demodulation circuit, a signal processing circuit, etc., and communicates with mobile phone base stations and the like, sending and receiving voice data for telephone communications and packet data related to Internet connections. The location information acquisition unit 29 receives and decodes radio waves transmitted from positioning satellites of a Global Navigation Satellite System (GNSS) such as the Global Positioning System (GPS) to calculate the current location. The location information acquisition unit 29 calculates the current location under control of the CPU 21 and outputs the result to the CPU 21.

[0020] As shown in FIG. 6 , the electronic watch 30 includes a CPU 31, RAM 32, a storage unit 33, a display unit 34, an operation unit 35, a timekeeping unit 36, a near-field wireless communication unit 37, and a location information acquisition unit 38. The various components of the electronic watch 30 are connected via a data transmission path such as a bus. The CPU 31 controls the operation of the various components of the electronic watch 30 by reading and executing a program 331 stored in the storage unit 33 and performing various arithmetic operations. The electronic watch 30 may include multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 31 of this embodiment may be executed by these multiple processors. In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel. The RAM 32 provides working memory space for the CPU 31 and stores temporary data. The storage unit 33 is a non-transitory recording medium readable by the CPU 31 as a computer, and stores the program 331 and various data. The storage unit 33 may include a non-volatile memory such as a flash memory. The program 331 is stored in the storage unit 33 in the form of computer-readable program code.

[0021] The display unit 34 displays information such as the time, date, and day of the week in analog or digital format in accordance with control signals sent from the CPU 31. When an analog format is used, the display unit 34 includes rotating hands such as hour, minute, and second hands, as well as a mechanism and drive circuit for rotating the hands. When a digital format is used, the display unit 34 includes a display panel such as an LCD panel capable of displaying in a segment format or a dot matrix format, and a drive circuit for the display panel. Analog and digital displays may be used in combination. The operation unit 35 has operation means such as operation buttons and a crown, and outputs operation signals corresponding to operations on the operation means to the CPU 31. The operation unit 35 may also include other operation means such as a touch panel superimposed on the display screen of the display unit 34. The timing unit 36 ​​includes an oscillator circuit, a frequency divider circuit, a timing circuit, and the like. The clock unit 36 ​​calculates and holds the current date and time by dividing the frequency of a clock signal generated by an oscillation circuit with a frequency divider circuit and counting the divided signal with a timing circuit.

[0022] The short-range wireless communication unit 37 is a communication module having an antenna, a modulation / demodulation circuit, a signal processing circuit, etc., and performs short-range wireless communication with the smartphone 20 using BLE. The location information acquisition unit 38 receives and decodes radio waves transmitted from positioning satellites of a global positioning satellite system such as GPS to calculate the current location. The location information acquisition unit 38 calculates the current location under the control of the CPU 31 and outputs the result to the CPU 31.

[0023] Next, the operation of each device in the image posting system 1 when posting an image will be described. As described above, in the image posting service of this embodiment, the posting condition for an image is that the image contains a wristwatch as a target item and at least one other coordinating item. For example, if a person in the image is wearing a watch and at least one other coordinating item, the image satisfies the posting condition. However, the person does not necessarily have to be wearing the items; the posting condition is met as long as the watch and at least one other coordinating item are included in the image. The server 10 and smartphone 20 of the image posting system 1 operate so that only images that satisfy this posting condition are posted. Below, with reference to FIGS. 7 and 8, a posting control process executed by the CPU 11 of the server 10 to realize such operation will be described. Additionally, with reference to FIGS. 9 to 12, the display contents of the display unit 24 of the smartphone 20 during the posting control process will be described. In the following description, it is assumed that the user operating the smartphone 20 is the user with the user ID "U001" in FIG. 3.

[0024] When the posting app is launched on the smartphone 20, a predetermined user authentication process is performed between the smartphone 20 and the server 10. If the user authentication is successful, the CPU 11 of the server 10 starts the posting control process shown in FIG. 7. Meanwhile, the CPU 21 of the smartphone 20 transmits candidate images to be posted to the image posting service on the posting app to the server 10 in the following procedure. In response to a user's operation to instruct the image capture, the CPU 21 displays a shooting screen 241 shown in FIG. 9 on the display unit 24. The shooting screen 241 displays a real-time captured image (live view image) by the camera 26 and a shooting button 51. Here, it is assumed that an acquaintance of the user is taking a photo of the user, and the user is shown on the shooting screen 241. It is also assumed that the user is wearing an electronic watch 30 with a model number "M003" and a T-shirt as a coordination item. When the shooting button 51 is selected (tapped), the CPU 21 stores the captured image at that time in the storage unit 23 as a candidate image 41 to be posted to the image posting service. Furthermore, the CPU 21 transmits the captured candidate image 41 to the server 10 via the mobile data communication unit 28. Alternatively, the candidate image 41 may be captured in advance and stored in the storage unit 23 and transmitted to the server 10 without going through the photographing screen 241.

[0025] Returning to FIG. 7, when the posting control process is started, the CPU 11 of the server 10 repeatedly determines whether or not a candidate image 41 has been received from the smartphone 20 (step S101). When the candidate image 41 is received ("YES" in step S101), the CPU 11 executes extraction processing to extract a wristwatch (electronic watch 30) and coordinating items from the candidate image 41 (step S102). Here, the CPU 11 inputs the received candidate image 41 into the machine learning model 134. If the candidate image 41 includes a wristwatch, the machine learning model 134 identifies and outputs at least one candidate model of the wristwatch estimated from its appearance. Furthermore, if the candidate image 41 includes a coordinating item, the machine learning model 134 outputs the item name of the included coordinating item. The CPU 11 identifies the wristwatch and / or coordinating items included in the candidate image 41 based on the output of the machine learning model 134.

[0026] The CPU 11 determines whether both a wristwatch and a coordinating item have been extracted from the candidate image 41 (step S103). If both a wristwatch and a coordinating item have been extracted ("YES" in step S103), the CPU 11 causes the display unit 24 of the smartphone 20 to display a candidate list including candidate wristwatch models output by the machine learning model 134 (step S104). Here, the CPU 11 transmits control data for displaying a model selection screen 242 shown in FIG. 10 to the smartphone 20, and causes the display unit 24 of the smartphone 20 to display this model selection screen 242. The model selection screen 242 displays three candidate models output by the machine learning model 134, radio buttons 52 for selecting one of the models, and an OK button 53. If the machine learning model 134 lists the candidate models in order of highest match rate with the wristwatch included in the candidate image 41, the candidate models may be listed in order of highest match rate on the model selection screen 242. The user can declare the model of the wristwatch shown in the candidate image 41, i.e., the model of the electronic watch 30, by selecting one model using the radio buttons 52 and tapping the decision button 53. When the decision button 53 is tapped, the CPU 21 of the smartphone 20 notifies the server 10 of information about the model selected by the user. Note that if the accuracy of the machine learning model 134 in identifying the model of the wristwatch is sufficiently high and the model of the wristwatch shown in the candidate image 41 can be accurately identified, step S104 may be omitted.

[0027] The CPU 11 of the server 10 determines whether the model of the selected electronic watch 30 is associated with the user and registered in the user information DB 132, i.e., whether the wristwatch extracted in the extraction process matches an electronic watch 30 that is registered in the user information DB 132 and is an owned item of the user (step S105). If it is determined that the model of the selected electronic watch 30 is not registered in the user information DB 132 (“NO” in step S105), the CPU 11 displays a registration screen (not shown) on the display unit 24 of the smartphone 20 (step S106). This registration screen prompts the user to register the model of the electronic watch 30 that the user selected in step S104. The registration screen displays, for example, an allow button to allow registration of the model and a cancel button to reject registration. If the allow button is selected, the model is associated with the user and registered in the user information DB 132. If the model of the selected electronic watch 30 is registered on the registration screen ("YES" in step S107), or if it is determined in step S105 that the model has already been registered ("YES" in step S105), the CPU 11 determines that the electronic watch 30, which is an item owned by the user, is included (shown) in the candidate image 41 (step S108). Steps S103 to S108 correspond to a "determination process" that determines whether or not the electronic watch 30, which is an item owned by the user, is included in the candidate image 41.

[0028] Note that the contents of the determination process are not limited to steps S103 to S108 shown in Fig. 7, and various modifications are possible. For example, instead of step S104, CPU 11 may execute a step of displaying a list of wristwatch models that are associated with the user and registered in user information DB 132. In this case, steps S105 to S107 are omitted, and step S108 is executed when any model is selected from the list.

[0029] The CPU 11 determines whether the electronic watch 30 included in the candidate image 41 is a BLE-connected model (step S109). Here, the CPU 11 references the user information DB 132 in FIG. 3, and determines that the electronic watch 30 is a BLE-connected model if the "BLE connection" corresponding to the electronic watch 30 determined in step S108 is "automatic" or "manual." If the CPU 11 determines that the electronic watch 30 is a BLE-connected model ("YES" in step S109), the CPU 11 determines whether the electronic watch 30 and smartphone 20 are BLE-connected (step S110). Here, the CPU 11 requests information from the smartphone 20 regarding whether a BLE connection has been established. In response to the request, the CPU 21 of the smartphone 20 transmits information regarding whether the electronic watch 30 is BLE-connected to the server 10. If it is determined that the electronic timepiece 30 and smartphone 20 are not BLE connected ("NO" in step S110), the CPU 11 sends a control signal to the smartphone 20, causing the display unit 24 of the smartphone 20 to display a message urging the user to manually establish a BLE connection (step S111).The CPU 11 then determines again whether the electronic timepiece 30 and smartphone 20 are BLE connected (step S112).

[0030] If it is determined in step S110 or S112 that the electronic watch 30 and smartphone 20 are BLE-connected (YES in step S110 or S112), or if it is determined in step S109 that the electronic watch 30 is not a BLE-connected model (NO in step S109), the CPU 11 determines that the candidate image 41 satisfies the posting conditions. Furthermore, by sending predetermined permission control information to the smartphone 20, the CPU 11 causes a posting screen 243 including the candidate image 41 to be displayed on the display unit 24 of the smartphone 20, as shown in FIG. 11 , and activates a posting button 54 on the posting screen 243 (step S113). The posting button 54 is a button selected by the user to post the candidate image 41 to the image posting service. Activating the post button 54 may be an operation of switching from a state in which the post button 54 is hidden, as shown on the left side of FIG. 11, to a state in which the post button 54 is displayed, as shown on the right side of FIG. 11, or an operation of switching the post button 54 from a display state in which it is not selectable (e.g., a grayed-out state) to a display state in which it is selectable. The control executed by the CPU 11 in step S113 corresponds to "permission control" that switches the state of the smartphone 20 to a state in which the candidate image 41 can be posted to the image posting service. The state in which the post button 54 is displayed on the display unit 24 of the smartphone 20 corresponds to a "state in which the candidate image 41 can be posted to the image posting service." The CPU 21 of the smartphone 20, upon receiving the permission control information, causes the display unit 24 to display the posting screen 243 including the post button 54, in a manner that allows the user to recognize that the candidate image can be posted to the image posting service. As can be seen from the flow leading to step S113, the permission control of this embodiment is executed when all of the following conditions (i) to (iii) are satisfied. Condition (i) is that both a watch and a coordinate item are extracted in the extraction process of step S102 ("YES" in step S103). Condition (ii) is that the electronic watch 30, which is an item owned by the user, is determined to be included in the candidate image 41 (step S108).Condition (iii) is whether the electronic watch 30 does not support BLE connection ("NO" in step S109), or if the electronic watch 30 is a BLE connection model ("YES" in step S109), whether it is BLE connected ("YES" in step S110 or S112).

[0031] On the other hand, if any of the above conditions (i) to (iii) is not met, the CPU 11 determines that the candidate image 41 does not meet the posting conditions and causes a not-shown posting disable screen, indicating that posting is not permitted, to be displayed on the display unit 24 of the smartphone 20 (step S114). More specifically, if, in step S103, one or both of a wristwatch and a coordinate item are not extracted from the candidate image 41 ("NO" in step S103), the CPU 11 determines that condition (i) is not met and executes the process of step S114. Also, if, in step S107, the cancel button on the registration screen is selected and the model of the electronic watch 30 is not registered in the user information DB 132 ("NO" in step S107), the CPU 11 determines that condition (ii) is not met and executes the process of step S114. Furthermore, if the electronic watch 30 is a BLE connection model and it is determined in step S112 that the BLE connection is not established ("NO" in step S112), the CPU 11 determines that condition (iii) is not met and executes the process of step S114. The CPU 11 may also display the reason for the posting being prohibited on the posting prohibited screen. For example, if the above condition (i) is not met, the CPU 11 may display text such as "A watch was not extracted from the image" or "A coordination item was not extracted from the image" on the posting prohibited screen, depending on the item that was not extracted. Furthermore, if condition (ii) is not met, the CPU 11 may display text such as "A registered wristwatch is not included in the image" on the posting prohibited screen. Furthermore, if condition (iii) is not met, the CPU 11 may display text such as "BLE communication with the watch extracted from the image cannot be detected. Please try connecting with BLE again" on the posting prohibited screen.

[0032] When the post button 54 is activated in step S113, the CPU 11 repeatedly determines whether the post button 54 has been selected by the user (step S115). If it is determined that the post button 54 has been selected (“YES” in step S115), the CPU 11 causes the display unit 24 of the smartphone 20 to display a confirmation screen 244 shown in FIG. 12 (step S116). The confirmation screen 244 is a screen on which the user can confirm the candidate image 41 to be posted and the information to be posted along with the candidate image 41. The confirmation screen 244 displays the candidate image 41, image information 55, an information input button 56, and a post execution button 57. The CPU 11 acquires information such as the user ID of the user who posts the candidate image 41, the shooting date of the candidate image 41, the shooting location of the candidate image 41, the model number of the watch included in the candidate image 41, and coordinating items, and displays the information as image information 55. The location information may be obtained by the location information obtaining unit 29 of the smartphone 20 or the location information obtaining unit 38 of the electronic watch 30.

[0033] The CPU 11 repeatedly determines whether or not the information input button 56 has been selected (step S117). If it determines that the information input button 56 has been selected ("YES" in step S117), the CPU 11 displays an information input window (not shown) on the display unit 24 to accept input of additional information by the user. The user can add information to the image information 55 in this information input window. The added information may be, for example, the brand name, product name, and purchase store of the coordinated item.

[0034] When step S118 is completed, or when it is determined that the information input button 56 has not been selected (step S117: NO), the CPU 11 determines whether or not the post execute button 57 has been selected (step S119). When it is determined that the post execute button 57 has not been selected (step S119: NO), the CPU 11 returns the process to step S117. When it is determined that the post execute button 57 has been selected (step S119: YES), the CPU 11 assigns a posted image ID to the candidate image 41 in the posted image DB 133 and registers it as a posted image, and also associates image information 55 with the posted image and registers it (step S120).

[0035] When step S120 is completed, or when the posting disabled screen is displayed in step S114, CPU 11 determines whether or not the posting application has been completed on smartphone 20 (step S121). When CPU 11 determines that the posting application has not been completed ("NO" in step S121), CPU 11 returns the process to step S101, and when CPU 11 determines that the posting application has been completed ("YES" in step S121), CPU 11 terminates the posting control process.

[0036] Next, the operation of each device of the image posting system 1 when displaying posted images will be described. A user of the smartphone 20 can view posted images 42 (see FIG. 14) posted by the user and other users to the image posting service by performing a predetermined operation while a posting app is running. Below, with reference to FIG. 13, a posted image display process executed by the CPU 11 of the server 10 to realize the display operation of such posted images 42 will be described. The posted image display process is started when the posting app is launched on the smartphone 20 and user authentication is successful. The posted image display process may be executed in parallel with the above-mentioned posting control process.

[0037] When the posted image display process starts, the CPU 11 of the server 10 determines whether a display request for a posted image 42 has been received from the smartphone 20 (step S201). If it is determined that a display request for a posted image 42 has been received (“YES” in step S201), the CPU 11 determines whether the smartphone 20 is currently connected to the electronic watch 30 via BLE (step S202). If it is determined that the smartphone 20 is currently connected to the electronic watch 30 via BLE (“YES” in step S202), the CPU 11 extracts posted images 42 that include a wristwatch of the same model as the currently connected electronic watch 30 via BLE, and displays the images on the display unit 24 of the smartphone 20 (step S203). First, the CPU 11 identifies the model number of the electronic watch 30 to which the smartphone 20 is connected via BLE. The CPU 11 also references the posted image DB 133 of FIG. 4 and extracts all records whose “watch model” field matches the model number of the identified model. The CPU 11 then transmits image data of the posted images 42 of the extracted records to the smartphone 20, and causes the display unit 24 to display a posted image display screen 245 shown in FIG. 14. The posted image display screen 245 displays a list of posted images 42 that include within the image a wristwatch of the same model as the electronic watch 30 currently connected via BLE (the electronic watch 30 worn by the user of the smartphone 20). A like button 58 is also displayed on each posted image 42 on the posted image display screen 245. When the user selects the like button 58 for a certain posted image 42, that information is transmitted to the server 10, and the "number of likes" for the record of that posted image 42 in the posted image DB 133 is counted up.

[0038] 13, if it is determined that the smartphone 20 is not connected to the electronic watch 30 via BLE ("NO" in step S202), the CPU 11 extracts posted images 42 according to the specified extraction conditions and displays them on the display unit 24 (step S204). Here, the extraction conditions may specify, for example, at least one of the posting user ID, posting date, shooting location, watch model number, coordinated item category, and number of likes. The extraction conditions may be determined in advance. Alternatively, the extraction conditions may be specified by the user of the smartphone 20 on the posting app, or may be included in the display request sent in step S201.

[0039] When step S203 or S204 is completed, or when it is determined in step S201 that a request to display the posted image 42 has not been received ("NO" in step S201), the CPU 11 determines whether or not the posting app has been terminated on the smartphone 20 (step S205). When it is determined that the posting app has not been terminated ("NO" in step S205), the CPU 11 returns the process to step S201, and when it is determined that the posting app has been terminated ("YES" in step S205), the CPU 11 terminates the posted image display process.

[0040] In the posted image display process, the CPU 11 may execute various display processes not shown in FIG. 13 . For example, in step S203, the CPU 11 may identify coordinating items that match the BLE-connected electronic watch 30 (the electronic watch 30 worn by the user), extract posted images 42 that include the identified coordinating items and the BLE-connected electronic watch 30, and display them on the posted image display screen 245. In this case, the machine learning model 134 may be trained to output coordinating items that match the electronic watch 30, and the machine learning model 134 may be used to identify coordinating items that match the electronic watch 30. Furthermore, posted images 42 that include the BLE-connected electronic watch 30 and have received the most likes may be extracted and displayed. Furthermore, the posting app may allow the user to input coordinating items worn by the user, and posted images 42 that include the input coordinating items and a wristwatch that matches the input coordinating items may be extracted and displayed on the posted image display screen 245. In this case, machine learning model 134 may be trained to output a watch model that matches a certain coordination item, and the machine learning model 134 may be used to identify the watch model that matches the coordination item. CPU 11 may also recommend a watch model that matches the coordination item entered by the user in the posting app (for example, display the model number of the model). In addition, in response to a user operation to select a recommended watch model, an e-commerce site where the model can be purchased may be displayed on the browser.

[0041] As described above, in the device control method according to this embodiment, the CPU 11 of the server 10 acquires candidate images 41 to be posted to an image posting service. The CPU 11 then executes a determination process to determine whether the candidate images 41 include an electronic watch 30 registered in the user information DB 132 and owned by the user of the smartphone 20. If the determination process determines that the candidate images 41 include an electronic watch 30, the CPU 11 executes permission control (control to display the posting button 54 on the display unit 24) to switch the state of the smartphone 20 to a state in which the candidate images 41 can be posted to the image posting service. This allows the smartphone 20 to be controlled so that only candidate images 41 that include a registered electronic watch 30 and satisfy the posting conditions can be posted as posted images 42. This prevents the posting of images that do not satisfy the posting conditions, thereby preventing various problems caused by the posting of such images. For example, it is possible to prevent the inconvenience of a user who wants to view images that satisfy the posting conditions from being unable to view the desired images. Furthermore, it is possible to reduce the load and cost on the server 10 for storing inappropriate images that do not satisfy the posting conditions. It also reduces the human burden and costs that would otherwise be incurred by operators of image posting services who visually search for and delete inappropriate images that do not meet the posting conditions. Furthermore, by posting images that meet the posting conditions, it is possible to transmit content with high appeal.

[0042] Furthermore, the CPU 11 executes an extraction process to extract, from the candidate images 41, wristwatches that are target items of a type predetermined as extraction targets, and in a determination process, if the wristwatch extracted in the extraction process matches a certain electronic watch 30 registered in the user information DB 132, it determines that the candidate image 41 includes the electronic watch 30 as a owned item. By comparing the wristwatch extracted from the candidate images 41 with the electronic watches 30 registered in the user information DB 132 in this way, the smartphone 20 can be controlled to more reliably post only candidate images 41 that include registered electronic watches 30 as posted images 42.

[0043] Furthermore, in the extraction process, the CPU 11 further extracts coordinating items that are a different type of item from a wristwatch, and executes permission control if a wristwatch and coordinating items are extracted in the extraction process and the wristwatch matches the user's electronic watch 30 in the discrimination process. This makes it possible for posted images 42 to satisfy the posting conditions only if they include the electronic watch 30 and coordinating items. Therefore, only coordinated images that include the electronic watch 30 and coordinating items can be collected and turned into content, making it possible to transmit appealing content.

[0044] Furthermore, the CPU 11 executes permission control when it determines that the candidate images 41 include the electronic watch 30 and that the smartphone 20 is performing BLE communication with the electronic watch 30. This makes it possible to more reliably control the smartphone 20 so that only posted images 42 that include the electronic watch 30 owned by the user are posted as candidate images 41.

[0045] Furthermore, when displaying posted images 42 posted to an image posting service on the display unit 24 of a smartphone 20 that is BLE connected to a certain electronic watch 30, the CPU 11 extracts posted images 42 that include the certain electronic watch 30 and displays them on the display unit 24. This allows the user to view coordination images that include the electronic watch 30 that they are currently wearing, without having to perform any special operation to select the electronic watch 30 that they are wearing. This allows the user to easily view the images they want.

[0046] Furthermore, by setting a wristwatch as an owned item, it is possible to collect coordinated images relating to wristwatches and transmit the content.

[0047] The server 10 according to this embodiment includes a CPU 11 that performs the above-described processing. The program 131 according to this embodiment causes the CPU 11 to perform the above-described processing. These features make it possible to prevent images that do not satisfy the posting conditions from being posted, thereby preventing various problems from occurring due to the posting of such images.

[0048] The image posting system 1 according to this embodiment also includes a server 10 and a smartphone 20. The smartphone 20 includes a display unit 24 and a CPU 21. The server 10 includes a CPU 11 that controls the smartphone 20. The smartphone 20 transmits candidate images 41 to the server 10 as candidates to be posted to the image posting service. The CPU 11 of the server 10 executes a determination process to determine whether the candidate images 41 include an electronic watch 30 that is a personal item owned by the user of the smartphone 20 and is registered in the user information DB 132. If the determination process determines that the candidate images 41 include an electronic watch 30, the CPU 11 transmits permission control information to the smartphone 20 to change the state of the smartphone 20 to a state in which the candidate image 41 can be posted to the image posting service. When the CPU 21 of the smartphone 20 receives the permission control information from the server 10, it causes the display unit 24 to display a posting screen 243 in a manner that allows the user to recognize that the candidate image 41 can be posted to the image posting service. This makes it possible to prevent the posting of images that do not satisfy the posting conditions, and to prevent various problems from occurring due to the posting of such images.

[0049] The present invention is not limited to the above-described embodiment, and various modifications are possible. For example, in the above-described embodiment, an example has been described in which the CPU 11 of the server 10 executes each step of the posting control process and the image display control process. However, the present invention is not limited to this example, and at least some steps of the posting control process and / or the image display control process may be executed by the CPU 21 of the smartphone 20. When the CPU 21 of the smartphone 20 executes at least steps S103 to S108 (determination process) and steps S109 to S114 of the posting control process in FIG. 7, the CPU 21 corresponds to the "control unit," and the control device 200 of the smartphone 20 corresponds to the "device control device." By providing the smartphone 20, which serves as an electronic device, with the CPU 21 that executes such processes, it is possible to prevent the posting of images that do not satisfy the posting conditions, and to prevent various problems from occurring due to the posting of such images.

[0050] Although the smartphone 20 is exemplified as an electronic device, the electronic device is not limited to this. The electronic device may be any device that can be used to post an image in the image posting service (i.e., to transmit the candidate image 41 to be the posted image 42 to the server 10), and may be, for example, a tablet terminal or a laptop computer.

[0051] Furthermore, although the electronic watch 30 is given as an example of the target item and the owned item, the target item and the owned item are not limited to this. The target item and the owned item may be any item that is specified as being included in the posted image 42 in the image posting service.

[0052] In the above embodiment, permission control is executed on the condition that the candidate image 41 includes both the electronic watch 30 as the target item and a coordinating item as the combination item, but this is not limiting. For example, permission control may be executed if the candidate image 41 includes the electronic watch 30 even if the candidate image 41 does not include a coordinating item.

[0053] In the above embodiment, when the electronic watch 30 is a BLE communication model, permission control is performed only when the smartphone 20 and the electronic watch 30 are connected via BLE, but this is not limited to this. In other words, permission control may be performed regardless of whether or not a BLE connection is established.

[0054] In the above description, an example has been disclosed in which an HDD or SSD of the storage unit 13 or a flash memory of the storage unit 23 is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. Other computer-readable media may also be used, such as information recording media such as CD-ROMs. Furthermore, a carrier wave may also be used as a medium for providing data for the program according to the present invention via a communication line.

[0055] Furthermore, it goes without saying that the detailed configuration and detailed operation of each component of the image posting system 1 in the above embodiment can be modified as appropriate without departing from the spirit of the present invention.

[0056] Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and its equivalents. [Explanation of symbols]

[0057] 1...Image posting system, 10...Server (device control device), 11...CPU (control unit), 20...Smartphone (electronic device), 30...Electronic watch (target item, owned item), 41...Candidate image, 42...Posted image, 132...User information DB (database)

Claims

1. A device control method for controlling an electronic device, comprising: Obtain candidate images to be posted to the image posting service; executes a determination process to determine whether or not the candidate image includes a personal item owned by the user of the electronic device and registered in a predetermined database; When it is determined in the determination process that the candidate image includes the owned item, permission control is executed to switch the state of the electronic device to a state in which the candidate image can be posted to the image posting service. Equipment control methods.

2. execute an extraction process to extract target items of a type predetermined as extraction targets from the candidate images; In the determination process, if the target item extracted in the extraction process matches a certain owned item registered in the database, it is determined that the candidate image includes the owned item. The device control method according to claim 1 .

3. In the extraction process, a combination item different in type from the target item is further extracted, the target item and the combination item are extracted in the extraction process, and the permission control is executed when the target item matches the certain owned item in the determination process. The device control method according to claim 2 .

4. executing the permission control when it is determined that the candidate image includes the owned item and that the electronic device is performing short-range wireless communication with the owned item; The device control method according to claim 1 .

5. When displaying posted images posted to the image posting service on a display unit of the electronic device that is performing short-range wireless communication with a certain item, extracting the posted images that include the certain item and displaying them on the display unit. The device control method according to claim 1 .

6. The owned item is a wristwatch. The device control method according to any one of claims 1 to 5.

7. An equipment control device including a control unit that controls the operation of an electronic device, The control unit Obtain candidate images to be posted to the image posting service; executes a determination process to determine whether or not the candidate image includes a personal item owned by the user of the electronic device and registered in a predetermined database; When it is determined in the determination process that the candidate image includes the owned item, permission control is executed to switch the state of the electronic device to a state in which the candidate image can be posted to the image posting service. Equipment control device.

8. An electronic device including a control unit, The control unit Obtain candidate images to be posted to the image posting service; executes a determination process to determine whether or not the candidate image includes a personal item owned by the user of the electronic device and registered in a predetermined database; When it is determined in the determination process that the candidate image includes the owned item, permission control is executed to switch the state of the electronic device to a state in which the candidate image can be posted to the image posting service. electronic equipment.

9. The computer of the device control device that controls the electronic device functions as a control means, The control means Obtain candidate images to be posted to the image posting service; executes a determination process to determine whether or not the candidate image includes a personal item owned by the user of the electronic device and registered in a predetermined database; When it is determined in the determination process that the candidate image includes the owned item, permission control is executed to switch the state of the electronic device to a state in which the candidate image can be posted to the image posting service. program.

10. an electronic device having a display unit and a first control unit; a device control device having a second control unit that controls the electronic device, the electronic device transmits candidate images to be posted to the image posting service to the device control device; The second control unit of the device control device executes a determination process to determine whether or not the candidate image includes a personal item owned by the user of the electronic device and registered in a predetermined database; When it is determined in the determination process that the candidate image includes the owned item, permission control information is transmitted to the electronic device to switch the state of the electronic device to a state in which the candidate image can be posted to the image posting service; When the permission control information is received from the device control device, the first control unit of the electronic device causes the display unit to display a screen in a manner that allows the user to recognize that the candidate image is available for posting to the image posting service. Image posting system.

Images