Object collecting and storing apparatus, object collecting and storing method, and program

Abstract

To provide an object recovery and storage device, an object recovery and storage method, and a program capable of appropriately recovering and storing an object.SOLUTION: A target object collection and storage apparatus according to the present disclosure includes a collection mechanism having a mechanism that moves a target object placed in a predetermined place and collects the target object in a storage, the storage that stores and keeps the target object, an imaging unit that captures an image including a state of the predetermined place, and a target object detection unit that determines whether or not the target object is present in the collection mechanism based on image data, in which the collection mechanism moves the target object and puts the target object in a storage when the target object detection unit detects the target object.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an object recovery and storage device, an object recovery and storage method, and a program. [Background technology]

[0002] If a user leaves something behind when getting off an autonomous taxi, in a manned taxi the driver will notice and be able to retrieve and store the item.However, since autonomous cars do not have drivers, even if they detect a lost item using an onboard camera, they will not be able to retrieve and store the item.

[0003] For example, Patent Document 1 listed below discloses a vehicle floor structure comprising a floor member that forms the floor surface of the vehicle compartment, a collection section that has an opening and a storage section, and a support member that supports the floor member in a tiltable manner, wherein the support member is configured to tilt the floor member so that the end portion located below the floor member is continuous with the opening of the collection section or is located above the opening. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2019-197570 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the vehicle floor structure described in Patent Document 1 above is based on the premise that ride-sharing is used by an unspecified number of people, and is designed to make it easier to clean the interior of the vehicle by sloping the interior floor and collecting trash and other debris in one place, but is not designed to collect left-behind items when the vehicle is unmanned.

[0006] In view of the above-mentioned problems, the present disclosure aims to provide an object recovery and storage device, an object recovery and storage method, and a program that can appropriately recover and store objects. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems and achieve the objectives, the object collection and storage device of the present disclosure comprises a collection mechanism that moves an object placed on a seat and collects the object in a storage cabinet, a storage cabinet that stores and keeps the object, an imaging unit that captures an image including the appearance of the seat, and an object detection unit that determines whether an object is present on the seat based on the image data, and when the object detection unit determines that an object is present on the seat, the collection mechanism moves the object and places it in the storage cabinet.

[0008] In order to solve the above-mentioned problems and achieve the objective, the object collection and storage method disclosed herein is a method for collecting and storing objects using an object collection and storage device that includes a collection mechanism that moves an object placed on a seat and collects the object in a storage cabinet, a storage cabinet that stores and keeps the object, and an imaging unit that captures an image including the appearance of the seat, and includes the steps of determining whether or not an object is present on the seat based on the image data, and, if it is determined that an object is present on the seat, moving the object and placing it in the storage cabinet.

[0009] In order to solve the above-mentioned problems and achieve the objectives, the program disclosed herein is a program that causes a computer of an object recovery and storage device to execute processing, the object recovery and storage device comprising: a recovery mechanism that moves an object placed on a seat and recovers the object in a storage cabinet; a storage cabinet that stores and keeps the object; and an imaging unit that captures an image including the appearance of the seat, and includes a step of determining whether or not an object is present on the seat based on the image data; and a step of moving the object and placing it in the storage cabinet when it is determined that an object is present on the seat. [Effects of the Invention]

[0010] According to the present disclosure, an object recovery and storage device, an object recovery and storage method, and a program are provided that can properly recover and store objects. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an overview of an object recovery and storage system according to the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an object recovery and storage system according to the present disclosure. [Figure 3] FIG. 3 is a schematic diagram illustrating a first state of a first embodiment of an object recovery and storage device according to the present disclosure. [Figure 4] FIG. 4 is a schematic diagram showing a second state of the first embodiment of the object recovery and storage device according to the present disclosure. [Figure 5] FIG. 5 is a schematic diagram illustrating a third state of the first embodiment of the object recovery and storage device according to the present disclosure. [Figure 6] FIG. 6 is a schematic diagram illustrating a fourth state of the first embodiment of the object recovery and storage device according to the present disclosure. [Figure 7] FIG. 7 is a schematic diagram illustrating a first state of a second embodiment of an object recovery and storage device according to the present disclosure. [Figure 8] FIG. 8 is a schematic diagram showing a second state of the second embodiment of the object recovery and storage device according to the present disclosure. [Figure 9] FIG. 9 is a schematic diagram showing a third state of the second embodiment of the object recovery and storage device according to the present disclosure. [Figure 10] FIG. 10 is a schematic diagram illustrating a fourth state of the second embodiment of the object recovery and storage device according to the present disclosure. [Figure 11] FIG. 11 is a diagram illustrating a configuration example of a control device of an object recovery and storage device according to the present disclosure. [Figure 12] FIG. 12 is a diagram illustrating an example of information stored in an object detection information storage unit according to the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of information stored in an image recognition model storage unit according to the present disclosure. [Figure 14] FIG. 14 is a diagram illustrating an example configuration of a user terminal according to the present disclosure. [Figure 15]FIG. 15 is a diagram illustrating an example of the configuration of a server device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. However, the present disclosure is not limited to the embodiments described below.

[0013] (Overview of the Object Recovery and Storage System) First, an overview of an object recovery and storage system 1 according to the present disclosure will be described with reference to Fig. 1. Fig. 1 is a diagram illustrating an overview of an object recovery and storage system according to the present disclosure.

[0014] As shown in FIG. 1, an object collection and storage system 1 according to the present disclosure is installed in, for example, an autonomous vehicle. In response to a user request, the autonomous vehicle calculates a driving route from the current location to the destination and travels from the current location to the destination along the driving route. Then, when the autonomous vehicle arrives at the destination, the user gets off the autonomous vehicle. However, there are cases where the user inadvertently leaves an object (for example, a forgotten item such as a wallet) in the autonomous vehicle.

[0015] In such a case, the object collection and storage system 1 detects the object that the user left behind in the autonomous vehicle, collects the object, and stores the object in a safe place. With this system, even if a user leaves an object in an unmanned autonomous vehicle, the object can be automatically detected, collected, and stored in a safe place before another user gets in the vehicle.

[0016] (Configuration of the object recovery and storage system) Next, the configuration of the object recovery and storage system 1 according to the present disclosure will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example configuration of the object recovery and storage system according to the present disclosure. As shown in Fig. 2, the object recovery and storage system 1 according to the present disclosure includes an object recovery and storage device 10, a user terminal 500, and a server device 600.

[0017] The object collection and storage device 10 is a device that collects and stores objects. The configuration of the object collection and storage device 10 will be described later. The object collection and storage device 10 may be installed in, for example, an autonomous vehicle or as a seat in a movie theater.

[0018] The user terminal 500 is an information processing device used by a user. The user terminal 500 may be, for example, an information processing device such as a smartphone, a tablet terminal, a wearable terminal, a mobile phone, or a PDA (Personal Digital Assistant). As shown in FIG. 1, the object collection and storage system 1 may include multiple user terminals 500.

[0019] The server device 600 is an information processing device that executes various types of information processing and may be realized by an information processing device such as a personal computer (PC), a workstation (WS), or a computer having server functions.

[0020] The network N connects the target object recovery and storage device 10, the user terminal 500, and the server device 600 in a wired or wireless manner so that they can communicate with each other. If the network N is wired, it may be realized by Ethernet (registered trademark) defined in IEEE802.3 or the like. If the network N is wireless, it may be realized by a wireless LAN (Local Area Network) defined in IEEE802.11 or Bluetooth (registered trademark) or the like.

[0021] (First embodiment) (Configuration of object collection and storage device) Next, the configuration of a first embodiment of an object recovery and storage device 10 according to the present disclosure will be described. FIG. 3 is a schematic diagram showing a first state of the first embodiment of an object recovery and storage device according to the present disclosure. As shown in FIG. 3, the object recovery and storage device 10 according to the first embodiment includes a control device 100, a seat 200, a storage cabinet 300, and a recovery mechanism 400. Note that the control device 100 is common to the first and second embodiments, and will be described later.

[0022] The seat 200 is a seat on which a user sits. The seat 200 according to the first embodiment includes a seating portion 210 on which the user sits and a backrest portion 220 on which the user's back comes into contact. The seat 200 is formed, for example, from a frame that serves as a basic framework, urethane that serves as an internal cushioning material, and a trim cover that covers the cushioning material and is made of leather, fabric, or the like.

[0023] The storage cabinet 300 is a storage container for storing objects. The storage cabinet 300 according to the first embodiment includes a storage section for storing objects and an opening provided at the top of the storage section. The objects are stored in the storage section through this opening. The storage cabinet 300 according to the first embodiment is a long storage container having the same length as the length of the seat 200 in the front-to-rear direction. The storage cabinet 300 is disposed, for example, below the seating portion of the seat 200. Therefore, a user cannot reach into the storage cabinet 300 without obtaining authentication for access to the storage cabinet 300.

[0024] The recovery mechanism 400 is a mechanism that enables movement of the seat 200. The recovery mechanism 400 includes a fulcrum portion 410, a slider portion 420, and a movable portion (not shown).

[0025] The fulcrum portion 410 serves as a fulcrum for the rotational movement of the seating portion 210 of the seat 200. In other words, the fulcrum portion 410 supports the seating portion 210 of the seat 200 so that it can tilt. The fulcrum portion 410 supports the seating portion 210 of the seat 200 and can change the support angle. The fulcrum portion 410, for example, defines the rotational path of the seating portion 210 of the seat 200 so that the seating portion 210 of the seat 200 tilts by rotating around the fulcrum portion 410. Furthermore, the fulcrum portion 410 rotatably fixes the seating portion 210 of the seat 200 so that it serves as a fulcrum for the rotational movement when the seating portion 210 of the seat 200 is positioned at the forefront of the slider portion 420.

[0026] The slider section 420 restricts the sliding movement of the seating section 210 of the seat 200. The slider section 420 may be, for example, a guide rail. The slider section 420 slides the seating section 210 of the seat 200 along the guide rail, thereby moving the seating section 210 in the front-to-rear direction of the seat.

[0027] The movable portion is responsible for sliding movement of the seat 200 and rotation movement around the fulcrum portion 410. The movable portion may be realized by an actuator, which is an electrical, magnetic, or mechanical driving device that enables the seating portion 210 of the seat 200 to slide in the front-to-rear direction of the seat, and an actuator similar to the former that rotates the seating portion 210 of the seat 200 around the fulcrum portion 410.

[0028] (Operation of the object recovery and storage device) Next, the operation of the first embodiment of the object recovery and storage device 10 according to the present disclosure will be described with reference to Figures 3 to 6. First, as shown in Figure 3 described above, assume that the user leaves the seat, leaving the object B on the seating portion 210 of the seat 200. In this case, the object recovery and storage device 10 detects the object B and drives the recovery mechanism 400.

[0029] As a result, the object recovery and storage device 10 transitions to a second state as shown in Fig. 4. Fig. 4 is a schematic diagram showing the second state of the first embodiment of the object recovery and storage device according to the present disclosure. That is, the object recovery and storage device 10 moves the seating portion 210 of the seat 200 toward the front of the seat along the slider portion 420. Then, after moving the seating portion 210 of the seat 200 to the forefront of the slider portion 420, the object recovery and storage device 10 rotates the seating portion 210 of the seat 200 around the fulcrum portion 410.

[0030] As a result, the object recovery and storage device 10 transitions to a third state as shown in Fig. 5. Fig. 5 is a schematic diagram showing the third state of the first embodiment of the object recovery and storage device according to the present disclosure. That is, object B placed on seating portion 210 of seat 200 of object recovery and storage device 10 slides off seating portion 210 of seat 200 as seating portion 210 of seat 200 rotates, and is recovered in storage cabinet 300.

[0031] Next, the object recovery and storage device 10 transitions to a fourth state as shown in Fig. 6. Fig. 6 is a schematic diagram showing the fourth state of the first embodiment of the object recovery and storage device according to the present disclosure. That is, when the object recovery and storage device 10 confirms that the object B has entered the storage cabinet 300, it rotates the seating portion 210 of the seat 200 in the opposite direction to the previous rotation, and then slides the seating portion 210 of the seat 200 along the slider portion 420 to return the seating portion 210 of the seat 200 to its original position.

[0032] According to this, even if an object is left behind on the seat 200, the object can be automatically detected and the seating portion 210 of the seat 200 can be moved to retrieve the object and store it in a safe place.

[0033] Second Embodiment (Configuration of object collection and storage device) Next, the configuration of a second embodiment of the object recovery and storage device 10 according to the present disclosure will be described. FIG. 7 is a schematic diagram showing a first state of the second embodiment of the object recovery and storage device according to the present disclosure. As shown in FIG. 7, the object recovery and storage device 10 according to the second embodiment includes a control device 100, a seat 200, a storage cabinet 300, and a recovery mechanism 400. As mentioned above, the control device 100 is common to the first and second embodiments, and will be described later. Furthermore, the seat 200 according to the second embodiment has the same configuration as the seat 200 according to the second embodiment, although its shape is different, and therefore its description will be omitted.

[0034] The storage cabinet 300 according to the second embodiment is disposed below the backrest 220 of the seat 200. The storage cabinet 300 according to the second embodiment includes a storage section for storing an object and a lid section provided on top of the storage section. The lid section of the storage cabinet 300 according to the second embodiment opens when the presence of an object on the seating section 210 of the seat 200 is detected.

[0035] The collection mechanism 400 according to the second embodiment includes a cover 430 that covers the seating portion, a cylindrical roller 440 around which the cover 430 is wound, and a movable portion.

[0036] The cover 430 is formed of fabric and is provided to cover the seating portion. The cover 430 may have a size that allows it to cover the entire surface of the seating portion 210 of the seat 200.

[0037] The roller 440 winds and collects the cover 430. The roller 440 is formed with a shaft having bearings such as ball bearings at both ends and an outer edge around which the cover 430 is wound. Two rollers 440 may be arranged at the front and rear below the seating portion 210 of the seat 200, with one end and the other end of the cover 430 wound around each roller.

[0038] The movable portion according to the second embodiment includes an electric motor that rotates the roller 240. The movable portion rotates the electric motor based on a control signal transmitted from the control device 100.

[0039] (Operation of the object recovery and storage device) Next, the operation of a second embodiment of the object recovery and storage device 10 according to the present disclosure will be described with reference to Figures 7 to 10. First, as shown in Figure 7 described above, assume that the user leaves an object on the seating portion 210 of the seat 200 and leaves the seat. In this case, the object recovery and storage device 10 detects the object and drives the recovery mechanism 400.

[0040] Then, the second embodiment of the object recovery and storage device 10 transitions to a second state as shown in FIG. 8. FIG. 8 is a schematic diagram showing the second state of the second embodiment of the object recovery and storage device according to the present disclosure. That is, the object recovery and storage device 10 rotates the rollers 240 to move the cover 230 toward the seating portion of the seat 200 toward the rear of the seat. Accordingly, the object B placed on the cover 230 covering the seating portion of the seat 200 moves toward the rear of the seat 200. At the same time, the lid of the storage cabinet 300 is opened in response to the detection of the object B.

[0041] Then, the second embodiment of the object recovery and storage device 10 transitions to a third state as shown in Fig. 9. Fig. 9 is a schematic diagram showing the third state of the second embodiment of the object recovery and storage device according to the present disclosure. That is, object B placed on the seating portion of seat 200 is moved rearward of seat 200 as cover 230 moves, and as a result, slides off the seating portion of seat 200 and is placed into a storage container located below the backrest of seat 200.

[0042] Next, the third embodiment of the object recovery and storage device 10 transitions to a fourth state as shown in FIG. 10. FIG. 10 is a schematic diagram showing the fourth state of the second embodiment of the object recovery and storage device according to the present disclosure. That is, when it is detected that object B has been placed into the storage cabinet 300, the lid of the storage cabinet 300 is closed. As a result, the user cannot reach inside the storage cabinet 300 without obtaining access authentication.

[0043] With this, even if an object is left behind on the seat 200, the object can be automatically detected and the cover 230 of the seat 200 is moved, so that the object can be collected in the storage cabinet 300 and safely stored.

[0044] (Control device configuration) Next, the configuration of the control device according to the present disclosure will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example configuration of the control device of the object recovery and storage device according to the present disclosure. As shown in Fig. 11, the control device 100 includes a communication unit 110, a storage unit 120, a control unit 130, an imaging unit 140, and a control signal transmission unit 150. Below, these components will be described in order.

[0045] The communication unit 110 is a communication module that enables the control device 100 to communicate with external devices. The communication unit 110 is responsible for transmitting and receiving various types of data to and from external devices via wireless or wired communication. In the case of wireless communication, the communication unit 110 may be realized by a communication antenna, an RF (Radio Frequency) circuit, a wireless LAN (Local Area Network) card, etc. In the case of wired communication, the communication unit 110 may be realized by, for example, a NIC (Network Interface Card) equipped with a wired LAN terminal, a signal transmission circuit, other circuits for communication processing, etc.

[0046] The storage unit 120 is a storage device that stores various types of information. The storage unit 120 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as a random access memory (RAM), a read only memory (ROM), or a flash memory. The auxiliary storage device may be realized by a hard disk, a solid state drive (SSD), an optical disk, or the like.

[0047] 11, the storage unit 120 includes an image recognition model storage unit 121 and an object detection information storage unit 122. An example of information stored in these components will be described below in order.

[0048] The image recognition model storage unit 121 stores information related to the image recognition model. An example of the information stored in the image recognition model storage unit 121 will now be described with reference to Fig. 12. Fig. 12 is a diagram illustrating an example of information stored in the image recognition model storage unit of the control device according to the present disclosure.

[0049] In the example shown in FIG. 12, the image recognition model storage unit 121 stores information relating to the items "model ID" and "model data" in association with each other.

[0050] A "model ID" is an identifier that identifies an image recognition model and is represented by a string or number. "Model data" is data for the image recognition model identified by the "model ID." The image recognition model may be a convolutional neural network (CNN) or the like. "Model data" includes various information, such as connection information about how nodes included in each of the multiple layers that make up a deep neural network are connected to each other, and connection coefficients (parameters) that are multiplied by numerical values ​​input and output between connected nodes.

[0051] That is, FIG. 12 shows an example in which model data "MDT#1" of a deep learning model identified by a model ID "M#1" is stored.

[0052] The information stored in the image recognition model storage unit 121 is not limited to information relating to the items "model ID" and "model data", and may store information relating to any other image recognition model.

[0053] The object detection information storage unit 122 stores information related to the object detection information. An example of the information stored in the object detection information storage unit 122 will now be described with reference to Fig. 13. Fig. 13 is a diagram illustrating an example of the information stored in the object detection information storage unit of the control device according to the present disclosure.

[0054] In the example shown in FIG. 13, the object detection information storage unit 122 stores information relating to the items "object detection ID," "category," "detection date and time," "position information at the time of detection," and "driving route at the time of detection" in association with each other.

[0055] "Object detection ID" is an identifier that identifies an object detection, and is expressed as a character string, a number, etc. "Category" is information indicating the category of the object identified by "Object detection ID". "Detection date and time" is information indicating the date and time when the object identified by "Object detection ID" was detected. "Location information at time of detection" is information indicating the location where the object identified by "Object detection ID" was detected. "Driving route at time of detection" is information indicating the driving route when the object identified by "Object detection ID" was detected.

[0056] That is, Figure 13 shows an example in which the category of the object identified by the object detection ID "OBID#1" is stored as "CTG#1", the date and time of detection of the object is stored as "TM#1", the location information at the time of detection of the object is stored as "LC#1", and the driving route at the time of detection of the object is stored as "RT#1".

[0057] The information stored in the object detection information storage unit 122 is not limited to information relating to the items "object detection ID," "category," "detection date and time," "location information at the time of detection," and "driving route at the time of detection," and may include information relating to any other object detection information.

[0058] The control unit 130 is a controller that manages and controls the control device 100. The control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in the storage unit 120 using RAM as a work area. The control unit 130 may also be realized by an integrated circuit, such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0059] The image information acquisition unit 131 acquires image data captured by the imaging unit 140. That is, when the imaging unit 140 captures image data, the image information acquisition unit 131 acquires the captured image data and stores it in the storage unit 120.

[0060] The object detection unit 132 determines whether an object exists on the seat based on the image data. For example, the object detection unit 132 may use image recognition processing to detect objects placed on the seat 200 and perform processing to classify the objects, thereby recognizing the category of the object placed on the seat. For example, an object recognition technology using CNN or the like may be used.

[0061] The control signal generating unit 133 generates a control signal for operating the movable unit. Specifically, the control signal generating unit 133 determines a signal including a time-series change in the voltage value to be applied to the movable unit, and generates the signal as the control signal. After generating the control signal, the control signal generating unit 133 causes the control signal transmitting unit 150 to transmit the generated control signal to the movable unit.

[0062] The remote operation receiving unit 134 receives operation information from the user terminal 500. For example, the remote operation receiving unit 134 receives authentication information input by the user from the user terminal 500 as operation information.

[0063] The authentication unit 135 authenticates access by a user who has requested access to the storage unit 300. For example, the authentication unit 135 may display an authentication information input screen on the user terminal 500 and accept input of authentication information from the user. The authentication information may be, for example, information such as the user's account ID, time of getting off, and route traveled, and may be authenticated by comparing this information with the information stored in the object detection information storage unit 122. Then, when the comparison results match, the authentication unit 135 provides a control signal to the storage unit 300 to vacate the storage unit 300, thereby vacating the storage unit 300.

[0064] When the notification unit 136 detects that an object exists on the seat 200, it notifies the user terminal 500. Specifically, the notification unit 136 causes the user terminal 500 to display information on the category of the object detected by the object detection unit 132, the date and time of detection, location information at the time of detection, and the like.

[0065] The imaging unit 140 includes optical elements and an imaging element. The optical elements are elements that constitute an optical system, such as lenses, mirrors, prisms, and filters. The imaging element is an element that converts light incident through the optical elements into an image signal, which is an electrical signal. The imaging element may be, for example, a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor.

[0066] The control signal transmission unit 150 transmits the control signal generated by the control signal generation unit to the movable unit. The control signal transmission unit 150 may be realized by various types of electrical wiring, for example, a control signal cable formed by bundling multiple electric wires, each wire having a conductor such as copper covered with an insulator, and covering the bundled wires with an electrically insulating polyvinyl chloride (PVC) sheath. In other words, the signal transmission unit 160 is connected to the movable unit by electrical wiring.

[0067] (User terminal configuration) Next, the configuration of a user terminal 500 according to the present disclosure will be described with reference to Fig. 14. Fig. 14 is a diagram showing an example configuration of a user terminal according to the present disclosure. As shown in Fig. 14, the user terminal 500 according to the present disclosure includes a communication unit 510, a storage unit 520, a control unit 530, an input unit 540, and a display unit 550. Below, these components will be described in order.

[0068] The communication unit 510 is a communication module that enables the user terminal 500 to communicate with external devices. The communication unit 510 is responsible for sending and receiving data to and from external devices via wireless communication or wired communication. In the case of wireless communication, the communication unit 510 may be equipped with a communication antenna, an RF circuit, a wireless LAN card, or other communication processing circuits. In the case of wired communication, the communication unit 510 may be equipped with, for example, a NIC equipped with a wired LAN terminal, a transmission circuit, or other communication processing circuits.

[0069] The storage unit 520 is a storage device that stores various types of information. The storage unit 520 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as RAM, ROM, or flash memory. The auxiliary storage device may be realized by a hard disk, SSD, optical disk, or the like.

[0070] The control unit 530 is a controller that manages and controls the user terminal 500. The control unit 530 is realized by a CPU, an MPU, or the like executing various programs stored in the storage unit 520 using RAM as a work area. The control unit 530 may also be realized by an integrated circuit such as an ASIC or an FPGA.

[0071] As shown in Fig. 14, control unit 530 includes a receiving unit 531 and a notifying unit 532. Control unit 530 realizes these functions and executes these processes by reading and executing a program (software) from storage unit 520. Note that these functions of control unit 530 may be realized by electronic circuits. Control unit 530 may execute these processes using one CPU, or may include multiple CPUs that execute these processes in parallel. These components will be described below in order.

[0072] The reception unit 531 receives input of authentication information from a user. For example, the reception unit 531 may receive input of authentication information from a user by displaying an input screen on the display unit 550. Upon receiving authentication information input to the input unit 540 (described later), the reception unit 531 transmits the authentication information to the server device 600 via the communication unit 510.

[0073] The notification unit 532 notifies the user that an object has been detected. Specifically, the notification unit 532 causes the display unit 550, which will be described later, to display information on the category of the detected object, the date and time of detection, location information at the time of detection, and the like.

[0074] The input unit 540 accepts various types of operation information. For example, the input unit 540 may accept various types of operation information using various switches, a keyboard, a mouse, etc. The input unit 540 may also accept various types of operation information via a display surface of a touch panel.

[0075] The display unit 550 displays various types of information. For example, the display unit 550 may display a screen indicating that an object has been detected. The display unit 550 may be realized by a liquid crystal display, an organic EL display, a micro LED display, or the like.

[0076] (Server device configuration) Next, the configuration of server device 600 according to the present disclosure will be described with reference to Fig. 15. Fig. 15 is a diagram showing an example configuration of a server device according to the present disclosure. As shown in Fig. 15, server device 600 according to the present disclosure includes a communication unit 610, a storage unit 620, a control unit 630, an input unit 640, and a display unit 650. Below, these components will be described in order.

[0077] The communication unit 610 is a communication module that communicates with external devices. The communication unit 610 is responsible for sending and receiving data to and from external devices via wireless communication or wired communication. In the case of wireless communication, the communication unit 610 may be realized by a communication antenna, an RF circuit, a wireless LAN card, or the like. In the case of wired communication, the communication unit 610 may be realized by, for example, a NIC equipped with a wired LAN terminal.

[0078] The storage unit 620 is a storage device that stores various types of information. The storage unit 620 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as RAM, ROM, or flash memory. The auxiliary storage device may be realized by a hard disk, SSD, optical disk, or the like.

[0079] 15, storage unit 620 includes object detection information storage unit 621. The information items stored in object detection information storage unit 621 are the same as the information items stored in object detection information storage unit 122 of control device 100, and therefore description thereof will be omitted.

[0080] The control unit 630 is a controller that manages and controls the server device 600. The control unit 630 is realized by a CPU, an MPU, or the like executing various programs stored in the storage unit 620 using RAM as a work area. The control unit 630 may also be realized by an integrated circuit such as an ASIC or an FPGA.

[0081] As shown in Fig. 15, the control unit 630 includes a reception unit 631, an authentication unit 632, and a notification unit 633. The control unit 630 realizes these functions and executes these processes by reading and executing a program (software) from the storage unit 620. Note that these functions of the control unit 630 may be realized by an electronic circuit. Furthermore, the control unit 630 may execute these processes using one CPU, or may be provided with multiple CPUs that execute these processes in parallel. Below, these components will be described in order.

[0082] The receiving unit 631 receives authentication information input from a user. For example, the receiving unit 631 may receive the authentication information input by the user from the user terminal 500 via the communication unit 610.

[0083] The authentication unit 632 authenticates access by a user who has requested access to the storage unit 300. For example, the authentication unit 632 authenticates the user's access when the user terminal 500 cannot directly communicate with the target object recovery and storage device 10. Then, when the authentication information matches the information in the object detection information storage unit 621, the authentication unit 632 provides the storage unit 300 with a control signal to vacate the storage unit 300, thereby vacating the storage unit 300.

[0084] The notification unit 633 notifies the user terminal 500 when it detects that an object is present on the seat 200. Specifically, the notification unit 633 notifies the user terminal 500 when the object recovery and storage device 10 is unable to notify the user terminal 500 via the communication unit 110. The notification unit 633 causes the user terminal 500 to display information on the category of the object detected by the object detection unit 132, the date and time of detection, location information at the time of detection, etc.

[0085] The input unit 640 accepts various types of operation information. For example, the input unit 640 may accept various types of operation information using various switches, a keyboard, a mouse, etc. The input unit 640 may also accept various types of operation information via a display surface of a touch panel.

[0086] The display unit 650 displays various types of information. For example, the display unit 650 may display a GUI (Graphical User Interface) for processing by the server device 600. The display unit 650 may be realized by a liquid crystal display, an organic EL display, a micro LED display, or the like.

[0087] (Composition and Effects) The object recovery and storage device 10 according to the present disclosure comprises a recovery mechanism 400 that moves an object placed on a seat and recovers the object in a storage cabinet 300, the storage cabinet 300 that stores and keeps the object, an imaging unit 140 that captures an image including the state of the seat, and an object detection unit 132 that determines whether an object is present on the seat based on the image data, and when the object detection unit 132 determines that an object is present, the recovery mechanism 400 moves the object and places it in the storage cabinet.

[0088] According to this configuration, when an object is present on a seat, the object placed on the seat can be moved and placed in the storage. Therefore, the object can be automatically moved to a safe place and stored. Therefore, it is possible to provide an object recovery and storage device 10 that can properly recover and store objects.

[0089] The recovery mechanism 400 of the object recovery and storage device 10 according to the present disclosure comprises a slider portion 420 that restricts the sliding movement of the seat, and a fulcrum portion 410 that serves as a fulcrum for the rotational movement of the seat. After sliding the seat along the slider portion 420, the seat is rotated around the fulcrum portion 410, thereby recovering the object placed on the seat into the storage cabinet 300.

[0090] According to this configuration, by sliding the seat and then rotating it, the object placed on the seat can be collected into the storage cabinet 300. Therefore, it is possible to provide an object collection and storage device 10 that can appropriately collect and store the object.

[0091] The recovery mechanism 400 of the object recovery and storage device 10 according to the present disclosure comprises a cover 230 that covers the seat, and a cylindrical roller 240 around which the cover 230 is wrapped. By rotating the roller 240 and wrapping the seat fabric around the cover, the object placed on the seat fabric is moved and recovered in a storage facility.

[0092] According to this configuration, by rotating roller 240 and wrapping the seat fabric around it, the object placed on the seat fabric can be moved and collected in the storage. Therefore, it is possible to provide object collection and storage device 10 that can properly collect and store objects.

[0093] The object recovery and storage method of the present disclosure is a method for recovering and storing an object using an object recovery and storage device that includes a recovery mechanism 400 that moves an object placed on a seat and recovers the object in a storage cabinet 300, a storage cabinet 300 that stores and keeps the object, and an imaging unit 140 that captures an image including the appearance of the seat, and includes the steps of determining whether or not an object is present on the seat based on the image data, and, if it is determined that an object is present on the seat, moving the object and placing it in the storage cabinet.

[0094] According to this configuration, when an object is present on a seat, the object placed on the seat can be moved and placed in a storage cabinet. Therefore, the object can be automatically moved to a safe place and stored. Therefore, it is possible to provide an object collection and storage method that can properly collect and store objects.

[0095] The program of the present disclosure is a program that causes a computer of an object recovery and storage device 10 to execute processing, the computer being equipped with a recovery mechanism 400 that moves an object placed on a seat and recovers the object in a storage cabinet 300, the storage cabinet 300 that stores and keeps the object, and an imaging unit 140 that captures an image including the state of the seat, and includes a step of determining whether or not an object is present on the seat based on image data, and a step of moving the object and placing it in the storage cabinet when it is determined that an object is present on the seat.

[0096] According to this configuration, when an object is present on a seat, the object placed on the seat can be moved and placed in a storage cabinet. Therefore, the object can be automatically moved to a safe place and stored. Therefore, it is possible to provide a program that can appropriately collect and store the object.

[0097] Although the embodiments of the present invention have been described above, the embodiments are not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the scope of what is called equivalents. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0098] 1. Object collection and storage system 10. Object collection and storage device 100 control device 110 Communications Department 120 Storage section 121 Image recognition model memory unit 122 Object detection information storage unit 130 control section 131 Image information acquisition unit 132 Object detection unit 133 Control signal generation unit 134 Remote Control Reception 135 Authentication Department 136 Notification Department 140 Imaging unit 150 Control signal transmission unit 200 seats 210 Seating area 220 Backrest 300 Storage 400 Recovery Mechanism 410 Support part 420 Slider section 430 Cover 440 Roller 500 user terminals 510 Communications Department 520 Storage section 530 Control Unit 531 Reception Department 532 Notification Department 540 Input section 550 Display section 600 Server device 610 Communications Department 620 Storage section 630 Control Unit 631 Reception Department 632 Authentication Department 633 Notification Department 640 Input section 650 Display N Network

Claims

1. a recovery mechanism that moves an object placed on a seat and recovers the object into a storage cabinet; a storage facility for storing and storing objects; an imaging unit that captures an image including the state of the seat; an object detection unit that determines whether an object is present on the seat based on the image data; the recovery mechanism moves the object and places it in a storage cabinet when the object detection unit determines that an object is present on the seat; Object recovery and storage device.

2. The recovery mechanism includes: a slider portion that restricts the sliding movement of the seat; A fulcrum portion that serves as a fulcrum for the rotational movement of the seat; a movable portion that rotates the seat around the fulcrum portion after sliding the seat along the slider portion, After sliding the seat along the slider portion, the seat is rotated around the fulcrum portion, thereby recovering the object placed on the seat into a storage compartment. The object recovery and storage device according to claim 1 .

3. The recovery mechanism includes: A cover that covers the seat, a cylindrical roller around which the cover is wound, rotating the roller to wrap the seat cover around the seat, thereby moving the object placed on the seat cover and collecting it in a storage area; The object recovery and storage device according to claim 1 .

4. a recovery mechanism that moves an object placed on a seat and recovers the object into a storage cabinet; a storage facility for storing and storing objects; An object recovery and storage method using an object recovery and storage device including an imaging unit that captures an image including a state of a seat, determining whether an object is present on the seat based on the image data; and when it is determined that an object is present on the seat, moving the object and placing it in a storage cabinet. Method of collecting and storing the object.

5. a recovery mechanism that moves an object placed on a seat and recovers the object into a storage cabinet; a storage facility for storing and storing objects; An imaging unit that captures an image including a state of a seat, and a program that causes a computer of an object recovery and storage device to execute processing, determining whether an object is present on the seat based on the image data; and when it is determined that an object is present on the seat, moving the object and placing it in a storage cabinet. program.

Images