Contextual system
By designing the collaborative operation of external surfaces, sensors, and displays on vehicles, the privacy and environmental interference issues of lighting displays are solved, achieving effective hiding of object representation and enhanced environmental awareness.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- APPLE INC
- Filing Date
- 2024-09-27
- Publication Date
- 2026-06-02
AI Technical Summary
Existing vehicle lighting fixtures cannot effectively conceal the object representation on the internal display, leading to privacy breaches or environmental interference.
A mobility system is designed, including an outer surface, sensors, and a display. The sensors detect environmental signals to display an object representation, and the display is obscured by the outer surface to make it invisible from the inside. At the same time, the lighting source and the display work together to show the object's position and movement intention.
This approach effectively hides object representations without affecting environmental visibility, enhancing privacy protection and environmental awareness while strengthening the system's ability to display autonomous states and movement intentions.
Smart Images

Figure CN122126076A_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application filed on September 27, 2024, with application number 202480062775.3 and invention title "Context System". Cross-references to related applications
[0002] This application claims priority to U.S. Nonprovisional Patent Application Serial No. 18 / 897,108 entitled “CONTEXTUAL SYSTEMS”, filed September 26, 2024, and U.S. Provisional Patent Application Serial No. 63 / 51,814 entitled “CONTEXTUAL SYSTEMS”, filed September 30, 2023, both of which are incorporated herein by reference in their entirety for all purposes. Background Technology
[0003] Cars and other vehicles have lights such as headlights and taillights. These lights may have a light source, such as a light-emitting diode or a lamp. Summary of the Invention
[0004] In some embodiments, a mobility system is described. In some embodiments, the mobility system includes: an outer surface at least partially surrounding an interior; one or more sensors configured to detect signals corresponding to the environment outside the outer surface of the mobility system, wherein the signals correspond to the proximity of an object relative to the mobility system; and a display positioned on the outer surface of the mobility system, wherein the display is configured to display a representation of the object, and wherein the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior.
[0005] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with one or more sensors and a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the one or more sensors are configured to detect signals corresponding to the environment outside the outer surface of the mobile system. In some embodiments, the signal corresponds to the proximity of an object relative to the mobile system. In some embodiments, the display is positioned on the outer surface of the mobile system and configured to display a representation of the object. In some embodiments, the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior. In some embodiments, the one or more programs include instructions for: detecting the proximity of the object relative to the mobile system via the one or more sensors; and, in response to detecting the proximity of the object relative to the mobile system, displaying a representation of the object via the display such that the representation of the object is not visible from a first position within the interior at least partially surrounded by the outer surface.
[0006] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with one or more sensors and a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the one or more sensors are configured to detect signals corresponding to the environment outside the outer surface of the mobile system. In some embodiments, the signal corresponds to the proximity of an object relative to the mobile system. In some embodiments, the display is positioned on the outer surface of the mobile system and configured to display a representation of the object. In some embodiments, the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior. In some embodiments, the one or more programs include instructions for: detecting the proximity of the object relative to the mobile system via the one or more sensors; and, in response to detecting the proximity of the object relative to the mobile system, displaying a representation of the object via the display such that the representation of the object is not visible from a first position within the interior at least partially surrounded by the outer surface.
[0007] In some embodiments, a computer system is described that includes an outer surface and communicates with one or more sensors and a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the one or more sensors are configured to detect signals corresponding to the environment outside the outer surface of the mobile system. In some embodiments, the signal corresponds to the proximity of an object relative to the mobile system. In some embodiments, the display is positioned on the outer surface of the mobile system and configured to display a representation of the object. In some embodiments, the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior. In some embodiments, the computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting the proximity of an object relative to the mobile system via the one or more sensors; and, in response to detecting the proximity of the object relative to the mobile system, displaying a representation of the object via the display such that the representation of the object is not visible from a first position within the interior at least partially surrounded by the outer surface.
[0008] In some embodiments, a computer system is described that includes an outer surface and communicates with one or more sensors and a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the one or more sensors are configured to detect signals corresponding to the environment outside the outer surface of the mobile system. In some embodiments, the signal corresponds to the proximity of an object relative to the mobile system. In some embodiments, the display is positioned on the outer surface of the mobile system and configured to display a representation of the object. In some embodiments, the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior. In some embodiments, the computer system includes components for performing each of the following steps: detecting the proximity of an object relative to the mobile system via the one or more sensors; and, in response to detecting the proximity of the object relative to the mobile system, displaying a representation of the object via the display such that the representation of the object is not visible from a first position within the interior at least partially surrounded by the outer surface.
[0009] In some embodiments, a computer program product is described. In some embodiments, a computer program product is described comprising one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with one or more sensors and a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the one or more sensors are configured to detect signals corresponding to the environment outside the outer surface of the mobile system. In some embodiments, the signals correspond to the proximity of an object relative to the mobile system. In some embodiments, the display is positioned on the outer surface of the mobile system and configured to display a representation of the object. In some embodiments, the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior. In some embodiments, the one or more programs include instructions for: detecting the proximity of an object relative to the mobile system via the one or more sensors; and, in response to detecting the proximity of the object relative to the mobile system, displaying a representation of the object via the display such that the representation of the object is not visible from a first position within the interior at least partially surrounded by the outer surface.
[0010] In some embodiments, a method is described that is performed at a computer system including an outer surface and communicating with one or more sensors and a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the one or more sensors are configured to detect signals corresponding to the environment outside the outer surface of the mobile system. In some embodiments, the signal corresponds to the proximity of an object relative to the mobile system. In some embodiments, the display is positioned on the outer surface of the mobile system and configured to display a representation of the object. In some embodiments, the display is obscured from the interior such that the representation of the object is not visible from a first position within the interior. In some embodiments, the method includes: detecting the proximity of an object relative to the mobile system via the one or more sensors; and, in response to detecting the proximity of the object relative to the mobile system, displaying a representation of the object via the display such that the representation of the object is not visible from a first position within the interior at least partially surrounded by the outer surface.
[0011] In some embodiments, a mobility system is described. In some embodiments, the mobility system includes: an outer surface that at least partially surrounds an interior; a first display positioned on the outer surface and disposed on a first side of a longitudinal centerline of the mobility system; and a second display positioned on the outer surface and disposed on a second side of the longitudinal centerline of the mobility system, the second side opposite to the first side, wherein the first display is configured to display a first representation of an object outside the interior, wherein the first representation corresponds to the position of the object relative to the first side, and the second display is configured to display a second representation of the object, wherein the second representation corresponds to the position of the object relative to the second side.
[0012] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a first display and a second display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the first display is positioned on the outer surface and disposed on a first side of the longitudinal centerline of the computer system. In some embodiments, the second display is positioned on the outer surface and disposed on a second side of the longitudinal centerline of the computer system. In some embodiments, the second side is opposite to the first side. In some embodiments, the first display is configured to display a first representation of an object outside the interior. In some embodiments, the first representation corresponds to the position of the object relative to the first side. In some embodiments, the second display is configured to display a second representation of the object. In some embodiments, the second representation corresponds to the position of the object relative to the second side. In some embodiments, the one or more programs include instructions for: displaying a first representation of an object inside or outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side.
[0013] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a first display and a second display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the first display is positioned on the outer surface and disposed on a first side of the longitudinal centerline of the computer system. In some embodiments, the second display is positioned on the outer surface and disposed on a second side of the longitudinal centerline of the computer system. In some embodiments, the second side is opposite to the first side. In some embodiments, the first display is configured to display a first representation of an object outside the interior. In some embodiments, the first representation corresponds to the position of the object relative to the first side. In some embodiments, the second display is configured to display a second representation of the object. In some embodiments, the second representation corresponds to the position of the object relative to the second side. In some embodiments, the one or more programs include instructions for: displaying a first representation of an object inside or outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side.
[0014] In some embodiments, a computer system is described that includes an outer surface and communicates with a first display and a second display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the outer surface and disposed on a first side of the longitudinal centerline of the computer system. In some embodiments, the second display is positioned on the outer surface and disposed on a second side of the longitudinal centerline of the computer system. In some embodiments, the second side is opposite to the first side. In some embodiments, the first display is configured to display a first representation of an object inside and outside the interior. In some embodiments, the first representation corresponds to the position of the object relative to the first side. In some embodiments, the second display is configured to display a second representation of the object. In some embodiments, the second representation corresponds to the position of the object relative to the second side. In some embodiments, the one or more programs include instructions for: displaying a first representation of an object inside and outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side. In some embodiments, the computer system includes one or more processors and memory configured to execute one or more programs by the one or more processors, the one or more programs including instructions for: displaying a first representation of an object inside or outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side.
[0015] In some embodiments, a computer system is described that includes an outer surface and communicates with a first display and a second display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the outer surface and disposed on a first side of the longitudinal centerline of the computer system. In some embodiments, the second display is positioned on the outer surface and disposed on a second side of the longitudinal centerline of the computer system. In some embodiments, the second side is opposite to the first side. In some embodiments, the first display is configured to display a first representation of an object inside and outside the interior. In some embodiments, the first representation corresponds to the position of the object relative to the first side. In some embodiments, the second display is configured to display a second representation of the object. In some embodiments, the second representation corresponds to the position of the object relative to the second side. In some embodiments, the one or more programs include instructions for: displaying a first representation of an object inside and outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side. In some embodiments, the computer system includes components for performing each of the following steps: displaying a first representation of the internal and external object via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side.
[0016] In some embodiments, a computer program product is described. In some embodiments, a computer program product is described comprising one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a first display and a second display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the first display is positioned on the outer surface and disposed on a first side of the longitudinal centerline of the computer system. In some embodiments, the second display is positioned on the outer surface and disposed on a second side of the longitudinal centerline of the computer system. In some embodiments, the second side is opposite to the first side. In some embodiments, the first display is configured to display a first representation of an object outside the interior. In some embodiments, the first representation corresponds to the position of the object relative to the first side. In some embodiments, the second display is configured to display a second representation of the object. In some embodiments, the second representation corresponds to the position of the object relative to the second side. In some embodiments, the one or more programs include instructions for: displaying a first representation of an object inside or outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side.
[0017] In some embodiments, a method is described that is performed in a computer system including an outer surface and communicating with a first display and a second display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the outer surface and disposed on a first side of the longitudinal centerline of the computer system. In some embodiments, the second display is positioned on the outer surface and disposed on a second side of the longitudinal centerline of the computer system. In some embodiments, the second side is opposite to the first side. In some embodiments, the first display is configured to display a first representation of an object outside the interior. In some embodiments, the first representation corresponds to the position of the object relative to the first side. In some embodiments, the second display is configured to display a second representation of the object. In some embodiments, the second representation corresponds to the position of the object relative to the second side. In some embodiments, the method includes: displaying a first representation of an object outside the interior via the first display, wherein the first representation corresponds to the position of the object relative to the first side; and displaying a second representation of the object via the second display, wherein the second representation corresponds to the position of the object relative to the second side.
[0018] In some embodiments, a mobility system is described. In some embodiments, the mobility system includes: an outer surface that at least partially surrounds an interior; an illumination source positioned on the outer surface and configured to illuminate an environment outside the outer surface, the mobility system being configured to move relative to the environment in a first direction; and a display positioned on the outer surface and configured to display a representation of an object detected near the outer surface, the display being obscured from the interior.
[0019] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and in communication with a lighting source and a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the lighting source is positioned on the outer surface. In some embodiments, the lighting source is configured to illuminate the environment outside the outer surface. In some embodiments, the moving system is configured to move relative to the environment in a first direction. In some embodiments, the display is positioned on the outer surface. In some embodiments, the display is configured to display a representation of an object detected near the outer surface. In some embodiments, the display is obscured from the interior. In some embodiments, the one or more programs include instructions for: illuminating the environment outside the outer surface via the lighting source; moving the computer system relative to the environment in a first direction; detecting an object near the outer surface; and, in response to detecting the object near the outer surface, displaying a representation of the object via the display, wherein the display is obscured from the interior.
[0020] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and in communication with a lighting source and a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the lighting source is positioned on the outer surface. In some embodiments, the lighting source is configured to illuminate the environment outside the outer surface. In some embodiments, the moving system is configured to move relative to the environment in a first direction. In some embodiments, the display is positioned on the outer surface. In some embodiments, the display is configured to display a representation of an object detected near the outer surface. In some embodiments, the display is obscured from the interior. In some embodiments, the one or more programs include instructions for: illuminating the environment outside the outer surface via the lighting source; moving the computer system relative to the environment in a first direction; detecting an object near the outer surface; and, in response to detecting the object near the outer surface, displaying a representation of the object via the display, wherein the display is obscured from the interior.
[0021] In some embodiments, a computer system is described that includes an outer surface and communicates with a light source and a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the light source is positioned on the outer surface. In some embodiments, the light source is configured to illuminate the environment outside the outer surface. In some embodiments, the moving system is configured to move relative to the environment in a first direction. In some embodiments, the display is positioned on the outer surface. In some embodiments, the display is configured to display a representation of an object detected near the outer surface. In some embodiments, the display is obscured from the interior. In some embodiments, the computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: illuminating the environment outside the outer surface via the light source; moving the computer system relative to the environment in a first direction; detecting an object near the outer surface; and, in response to detecting the object near the outer surface, displaying a representation of the object via the display, wherein the display is obscured from the interior.
[0022] In some embodiments, a computer system is described that includes an outer surface and communicates with a light source and a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the light source is positioned on the outer surface. In some embodiments, the light source is configured to illuminate the environment outside the outer surface. In some embodiments, the moving system is configured to move relative to the environment in a first direction. In some embodiments, the display is positioned on the outer surface. In some embodiments, the display is configured to display a representation of an object detected near the outer surface. In some embodiments, the display is obscured from the interior. In some embodiments, the computer system includes components for performing each of the following steps: illuminating the environment outside the outer surface via the light source; moving the computer system relative to the environment in a first direction; detecting an object near the outer surface; and, in response to detecting the object near the outer surface, displaying a representation of the object via the display, wherein the display is obscured from the interior.
[0023] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a light source and a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the light source is positioned on the outer surface. In some embodiments, the light source is configured to illuminate the environment outside the outer surface. In some embodiments, the moving system is configured to move relative to the environment in a first direction. In some embodiments, the display is positioned on the outer surface. In some embodiments, the display is configured to display a representation of an object detected near the outer surface. In some embodiments, the display is obscured from the interior. In some embodiments, the one or more programs include instructions for: illuminating the environment outside the outer surface via the light source; moving the computer system relative to the environment in a first direction; detecting an object near the outer surface; and, in response to detecting the object near the outer surface, displaying a representation of the object via the display, wherein the display is obscured from the interior.
[0024] In some embodiments, a method is described that is performed at a computer system including an outer surface and communicating with a light source and a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the light source is positioned on the outer surface. In some embodiments, the light source is configured to illuminate the environment outside the outer surface. In some embodiments, the moving system is configured to move relative to the environment in a first direction. In some embodiments, the display is positioned on the outer surface. In some embodiments, the display is configured to display a representation of an object detected near the outer surface. In some embodiments, the display is obscured from the interior. In some embodiments, the method includes: illuminating the environment outside the outer surface via the light source; moving the computer system relative to the environment in a first direction; detecting an object near the outer surface; and, in response to detecting the object near the outer surface, displaying a representation of the object via the display, wherein the display is obscured from the interior.
[0025] In some embodiments, a mobile system is described. In some embodiments, the mobile system includes: an outer surface that at least partially surrounds an interior; a display positioned on the outer surface; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for simultaneously displaying via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0026] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and in communication with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0027] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and in communication with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0028] In some embodiments, a computer system is described that includes an outer surface and communicates with a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the computer system includes: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for simultaneously displaying via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0029] In some embodiments, a computer system is described that includes an outer surface and communicates with a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the computer system includes components for performing each of the following steps: simultaneously displaying via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0030] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0031] In some embodiments, a method is described that is performed at a computer system including an outer surface and communicating with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the method includes simultaneously displaying, via the display: an indication of the state of the mobile system; and an indication of the state of the environment outside the mobile system.
[0032] In some embodiments, a mobile system is described. In some embodiments, the mobile system includes: an outer surface at least partially surrounding an interior; a first display positioned on the outer surface; a first illumination source at least partially surrounding the first display; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting movement of an object in an environment outside the mobile system when the first display and the first illumination source are active; in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first illumination source based on the movement of the object, based on the movement of the object in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first illumination source based on the movement of the object, based on the movement of the object in a second direction different from the first direction.
[0033] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a first display and a first lighting source. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the first display is positioned on the outer surface. In some embodiments, the first lighting source at least partially surrounds the first display. In some embodiments, the one or more programs include instructions for: detecting movement of an object in an environment outside the mobile system when the first display and the first lighting source are active; and in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a second direction different from the first direction.
[0034] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a first display and a first lighting source. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the first display is positioned on the outer surface. In some embodiments, the first lighting source at least partially surrounds the first display. In some embodiments, the one or more programs include instructions for: detecting movement of an object in an environment outside the mobile system when the first display and the first lighting source are active; and in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a second direction different from the first direction.
[0035] In some embodiments, a computer system is described that includes an outer surface and communicates with a first display and a first lighting source. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the outer surface. In some embodiments, the first lighting source at least partially surrounds the first display. In some embodiments, the computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting movement of an object in an environment outside the mobile system when the first display and the first lighting source are active; and in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first lighting source based on the movement of the object in the first direction, based on the determination that the object is moving in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first lighting source based on the movement of the object in the second direction, based on the determination that the object is moving in a second direction different from the first direction.
[0036] In some embodiments, a computer system is described that includes an outer surface and communicates with a first display and a first lighting source. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the outer surface. In some embodiments, the first lighting source at least partially surrounds the first display. In some embodiments, the computer system includes components for performing each of the following steps: when the first display and the first lighting source are active, detecting movement of an object in an environment outside the mobile system; and in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a second direction different from the first direction.
[0037] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a first display and a first lighting source. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the exterior of the surface. In some embodiments, the first lighting source at least partially surrounds the first display. In some embodiments, the one or more programs include instructions for: detecting movement of an object in an environment outside the mobile system when the first display and the first lighting source are active; and in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a second direction different from the first direction.
[0038] In some embodiments, a method is described that is performed at a computer system including an outer surface and communicating with a first display and a first lighting source. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the first display is positioned on the exterior of the surface. In some embodiments, the first lighting source at least partially surrounds the first display. In some embodiments, the method includes: detecting movement of an object in an environment outside the mobile system when the first display and the first lighting source are active; and in response to detecting movement of the object in the environment outside the mobile system: updating the first display based on the movement of the object in a first direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a first direction; and updating the first display based on the movement of the object in a second direction, but not updating the first lighting source based on the movement of the object, based on the determination that the object is moving in a second direction different from the first direction.
[0039] In some embodiments, a mobile system is described. In some embodiments, the mobile system includes: an outer surface at least partially surrounding an interior; a display positioned on the outer surface; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for simultaneously displaying via the display: an indication of an autonomous state of the mobile system; and an indication of a movement intention of the mobile system, different from the indication of the autonomous state of the mobile system.
[0040] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and in communication with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of an autonomous state of the mobile system; and an indication of the mobile system's intention to move, distinct from the indication of the autonomous state of the mobile system.
[0041] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and in communication with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of an autonomous state of the mobile system; and an indication of the mobile system's intention to move, distinct from the indication of the autonomous state of the mobile system.
[0042] In some embodiments, a computer system is described that includes an outer surface and communicates with a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the computer system includes: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of an autonomous state of the mobile system; and an indication of the mobile system's intention to move, distinct from the indication of the autonomous state of the mobile system.
[0043] In some embodiments, a computer system is described that includes an outer surface and communicates with a display. In some embodiments, the outer surface at least partially surrounds an interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the computer system includes components for performing each of the following steps: simultaneously displaying via the display: an indication of the autonomous state of the mobile system; and an indication of the mobile system's intention to move, distinct from the indication of the autonomous state of the mobile system.
[0044] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the one or more programs include instructions for simultaneously displaying, via the display: an indication of the autonomous state of the mobile system; and an indication of the mobile system's intention to move, distinct from the indication of the autonomous state of the mobile system.
[0045] In some embodiments, a method is described that is performed at a computer system including an outer surface and communicating with a display. In some embodiments, the outer surface at least partially surrounds the interior. In some embodiments, the display is positioned on the outer surface. In some embodiments, the method includes simultaneously displaying, via the display: an indication of an autonomous state of the mobile system; and an indication of the mobile system's intention to move, distinct from the indication of the autonomous state of the mobile system.
[0046] In some embodiments, a mobility system is described. In some embodiments, the mobility system includes: an outer surface surrounding an interior; a suspension system; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting an intention to change the motion state of the mobility system; and in response to detecting the intention to change the motion state of the mobility system: raising the mobility system via the suspension system according to determining that the intention to change the motion state of the mobility system corresponds to a transition from a non-mobile state to a mobile state; and lowering the mobility system via the suspension system according to determining that the intention to change the motion state of the mobility system corresponds to a transition from the mobile state to the non-mobile state.
[0047] In some embodiments, a non-transitory computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a suspension system. In some embodiments, the outer surface surrounds an interior. In some embodiments, the one or more programs include instructions for: detecting an intention to change the motion state of the mobile system; and in response to detecting the intention to change the motion state of the mobile system: raising the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from a non-mobile state to a mobile state; and lowering the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from the mobile state to the non-mobile state.
[0048] In some embodiments, a transient computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a suspension system. In some embodiments, the outer surface surrounds an interior. In some embodiments, the one or more programs include instructions for: detecting an intention to change the motion state of the mobile system; and in response to detecting the intention to change the motion state of the mobile system: raising the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from a non-mobile state to a mobile state; and lowering the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from the mobile state to the non-mobile state.
[0049] In some embodiments, a computer system is described that includes an outer surface and communicates with a suspension system. In some embodiments, the outer surface surrounds an interior. In some embodiments, the computer system includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting an intention to change the motion state of the mobile system; and in response to detecting the intention to change the motion state of the mobile system: raising the mobile system via the suspension system according to determining that the intention to change the motion state of the mobile system corresponds to a transition from a non-mobile state to a mobile state; and lowering the mobile system via the suspension system according to determining that the intention to change the motion state of the mobile system corresponds to a transition from the mobile state to the non-mobile state.
[0050] In some embodiments, a computer system is described that includes an outer surface and communicates with a suspension system. In some embodiments, the outer surface surrounds an interior. In some embodiments, the computer system includes components for performing each of the following steps: detecting an intention to change the motion state of the mobile system; and in response to detecting the intention to change the motion state of the mobile system: raising the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from a non-moving state to a moving state; and lowering the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from the moving state to the non-moving state.
[0051] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system including an outer surface and communicating with a suspension system. In some embodiments, the outer surface surrounds an interior. In some embodiments, the one or more programs include instructions for: detecting an intention to change the motion state of the mobile system; and in response to detecting the intention to change the motion state of the mobile system: raising the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from a non-mobile state to a mobile state; and lowering the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from the mobile state to the non-mobile state.
[0052] In some embodiments, a method is described that is executed at a computer system including an outer surface and communicating with a suspension system. In some embodiments, the outer surface surrounds an interior. In some embodiments, the method includes: detecting an intention to change the motion state of the mobile system; and in response to detecting the intention to change the motion state of the mobile system: raising the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from a non-moving state to a moving state; and lowering the mobile system via the suspension system based on determining that the intention to change the motion state of the mobile system corresponds to a transition from the moving state to the non-moving state. Attached Figure Description
[0053] Figure 1 This is a top view of an exemplary mobile system with displays at various locations, according to some implementation schemes.
[0054] Figure 2 This is a side view of an illustrative display stack according to some implementation schemes.
[0055] Figure 3 This is a top view of an exemplary light panel assembly with encapsulation material according to some implementation schemes.
[0056] Figure 4 This is a top view of an exemplary light panel assembly having encapsulation material around multiple light-emitting components, according to some embodiments.
[0057] Figure 5 This is a side view of an exemplary light panel assembly with encapsulation material according to some implementation schemes.
[0058] Figure 6This is a top view of an exemplary light panel assembly having encapsulation material and damming material in multiple sections around each light-emitting component, according to some implementation schemes.
[0059] Figure 7 This is a top view of an exemplary light panel assembly having encapsulation material and dam material in individual sections around each light-emitting component, according to some implementation schemes.
[0060] Figure 8 This is a top view of an exemplary light panel assembly having encapsulation material and a dam material in a single section around the encapsulation material of each light-emitting component, according to some embodiments.
[0061] Figure 9 This is a side view of an exemplary display including a stack of anti-reflective layers according to some implementation schemes.
[0062] Figures 10A to 10F An exemplary display of a mobile system according to some implementation schemes is shown. Detailed Implementation
[0063] The following description illustrates exemplary systems, methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.
[0064] Systems are needed that provide efficient methods and interfaces for indicating context. For example, a mobile system may indicate the state of the mobile system (e.g., whether the mobile system is accelerating, decelerating, and / or turning in a particular direction) and / or the state of the physical environment (e.g., objects and / or hazards detected in the physical environment). The mobile system may indicate the state of the mobile system and / or the physical environment via one or more output devices that communicate with the mobile system. Such technologies can reduce the cognitive burden on subjects using and / or interacting with the mobile system, thereby improving productivity and safety. Furthermore, such technologies can reduce processor power and battery power otherwise wasted on redundant user input.
[0065] The processes described below enhance system operability and make the subject-system interface more efficient through various techniques (e.g., by helping subjects provide appropriate input and reducing user errors when interacting with the operating system / device), including providing subjects with improved visual feedback, reducing the amount of input required to perform operations, providing additional control options without cluttering the user interface with additional displayed controls, performing operations when a set of conditions has been met without requiring further user input, and / or additional techniques. These techniques also reduce power consumption and extend system battery life by enabling subjects to use the system faster and more efficiently.
[0066] Furthermore, in a method described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the described method can be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if the method requires performing a first step (if the conditions are satisfied) and a second step (if the conditions are not satisfied), those skilled in the art will know that the stated steps are repeated until both conditions are satisfied and conditions are not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to a method having discretionary steps, a system or computer-readable storage medium can repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.
[0067] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another. For example, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch, without departing from the scope of the various described embodiments. In some embodiments, a first touch and a second touch are two separate references to the same touch. In some embodiments, both a first touch and a second touch are touches, but they are not the same touch.
[0068] The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0069] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."
[0070] In some implementations, the system (such as a smartphone, smartwatch, tablet, laptop, desktop computer, accessory device, portable computer system, mobile computer system, mobile system, smart display, smart speaker, smart lighting, vehicle, or other system) has light-emitting components (such as headlights, taillights, and / or other luminaires). Headlights can be used to provide illumination of the road surface. Headlight illumination allows the system's occupants to see the road surface at night and / or in other low ambient lighting conditions (such as at dawn or dusk, when weather reduces ambient light, and / or when the system is traveling through a dark tunnel). Headlight illumination can also be used to assist autonomous driving systems. Taillights can be used to signal the system's braking and operational status and can be combined with other luminaires to communicate upcoming actions, such as turning, or can be integrated into the system's internal components. Headlights, taillights, or other luminaires can be used to display information to people outside the system, such as the system's movement, its status, or planned movement.
[0071] In exemplary arrangements, the mobile system may include a display (sometimes referred to as a display generating component) or other illumination sources having a light panel assembly or other light sources to provide illumination and / or display information about the status of the mobile system. Specifically, the display may include a light panel assembly having light-emitting components mounted on a substrate. A filler material may be provided around each of the light-emitting components. Specifically, a white filler material (or other highly reflective material) may be provided around the light-emitting components, and a black filler material (or other highly light-absorbing material) may surround the white filler material. A damming material may be included around the white and / or black filler materials to incorporate the filler material during manufacturing. The black filler material may absorb ambient light, while the white filler material may improve the efficiency of the display by redirecting stray light from the light-emitting components to the outside. Furthermore, the filler material may provide additional protection for the light-emitting components. In some embodiments, the display generating component is integrated with the mobile system. In some embodiments, the display generating component is separate from the mobile system. In some implementations, "displaying" content includes displaying content (e.g., video data rendered or decoded by a display controller) by sending data (e.g., image data or video data) to an integrated or external display generating component via a wired or wireless connection to visually generate content.
[0072] Figure 1 This is a cross-sectional top view of an exemplary moving system that may have one or more displays or lighting sources. Figure 1 In the example, mobile system 10 is a type of vehicle that can carry passengers (e.g., a car, truck, or other motor vehicle). However, if desired, mobile system 10 can be a robot (e.g., an autonomous robot) or another mobile system used to transport goods without transporting passengers. Figure 1 This includes the longitudinal axis 22 and the lateral axis 20 of the mobile system 10. It should be understood that in some embodiments, the longitudinal axis 22 and the lateral axis 20 may be used to refer to different axes and / or areas of the mobile system 10 for discussion purposes and are not included in the mobile system 10.
[0073] The mobility system 10 can be manually driven (e.g., by a human driver), operated via remote control, and / or operated autonomously (e.g., by an autonomous driving system using the control circuitry, sensors, and other components of the mobility system 10). If desired, the driving system (e.g., optionally also used as a computer-aided driving system to support fully autonomous driving) can be used to provide driving assistance functions when the mobility system 10 is being driven under manual control.
[0074] The mobility system 10 may include a vehicle body, such as a body 18. The body 18 may include mobility system structures (such as body panels formed of metal and / or other materials), and may include doors, a hood, a trunk, fenders, a chassis for mounting wheels, a roof, etc. Windows 16 may be formed in doors on the side S of the body 18, or in other desired portions of the mobility system 10, such as on the roof of the mobility system 10. If desired, a windshield 12 may be formed at the front F of the mobility system 10, and a rear window 14 (also referred to herein as rear window 14) may be formed at the rear R of the mobility system. Windows 16, windshield 12, rear window 14, doors in the body 18, and other portions of the body 18 separate the interior area 11 of the mobility system 10 from the external environment (exterior 13) surrounding the mobility system 10.
[0075] The mobility system 10 may have seating, such as seats 24, in the interior area 11. Seats 24 may include bucket seats, bench seats, and / or other seats on which mobility system occupants may sit. These seats may include forward-facing seats and / or rear-facing seats. Figure 1 The configuration is exemplary, in which the internal area 11 of the mobility system 10 accommodates one or more rear-facing bucket seats and / or bench seats and one or more forward-facing bucket seats and / or bench seats.
[0076] The mobile system 10 may include a component 26. Component 26 may include a display, speakers, internal and external lighting, actuators for adjusting the position and movement of structures within the mobile system 10, and input devices for acquiring user input. Input devices may include proximity sensors, touch sensors, force sensors, buttons, etc. Sensors may also be used in the mobile system 10 to measure environmental conditions (e.g., ambient light levels, temperature, etc.). In some configurations, component 26 may include wireless circuitry. Wireless circuitry may include ultra-wideband (UWB) circuitry, near-field communication circuitry, Bluetooth, etc. ® Circuits, wireless local area network circuits, and / or other wireless circuits. Wireless circuits can be used to detect nearby devices (e.g., wireless keychains, portable electronic devices emitting UWB signals and / or other short-range wireless signals such as watches and cellular phones). For example, wireless circuits can be used to detect the presence of nearby electronic devices, and the mobile system 10 can respond by using an actuator to unlock a door in the mobile system 10.
[0077] During operation, user input can be used to operate the mobility system 10. Components 26 of the mobility system 10 may include buttons, sensors, steering components (e.g., a steering wheel and steering system), pedals (e.g., accelerator and brake pedals), and / or other components that serve as controllers for acquiring user input to regulate the operation of the mobility system. These input devices can be used to receive user steering commands, to receive user navigation commands for an autonomous driving system, to receive user input for adjusting lighting, media playback, heating, and air conditioning, to receive input for opening and closing doors (and windows), to receive input for locking and unlocking doors (and windows), to receive input for otherwise controlling doors and / or windows, to receive input for controlling other mobility system operations, and to receive other user input. In an exemplary configuration, the mobility system 10 includes sensor circuitry (e.g., touch sensors, force sensors, proximity sensors, and / or other sensors) for receiving commands from a user (e.g., a mobility system occupant, a subject approaching the mobility system 10 from the outside, etc.). For example, the sensor circuit may include sensors that allow users to provide user input that instructs one or more electrically adjustable actuators to move a door from a retracted position to an extended position, open and / or close a door, lock / unlock a door, open and / or close a window, etc.
[0078] Component 26 may include control circuitry and input-output devices. The control circuitry and / or input-output devices in component 26 may be configured to operate mobile system systems such as steering and propulsion systems based on user input; autonomously operate mobile system systems such as steering and propulsion systems in conjunction with the operation of autonomous driving applications; operate navigation applications (e.g., applications for displaying maps on a display); operate software for controlling climate control devices, lighting, media playback, window movement, door operation, seat positioning devices, and / or support other mobile system functions. The control circuitry and / or input-output devices (sensor circuitry, other input-output components, etc.) may include processing circuitry and storage devices, and may be configured to perform operations within mobile system 10 using hardware (e.g., dedicated hardware or circuitry), firmware, and / or software. Software code and other data used to perform operations within mobile system 10 are stored on a non-transitory computer-readable storage medium (e.g., a tangible computer-readable storage medium) within the control circuitry. Remote storage devices and other remote control circuitry (e.g., circuitry on a remote server, etc.) may also be used to store software code. Software code may sometimes be referred to as software, data, program instructions, computer instructions, directives, or code. Non-transitory computer-readable storage media may include non-volatile memory, such as non-volatile random access memory, one or more hard disk drives (e.g., disk drives or solid-state drives), one or more removable flash drives, or other removable media or other storage devices. Software stored on non-transitory computer-readable storage media may execute on the processing circuitry of component 26 and / or the processing circuitry of remote hardware (such as a processor associated with one or more remote servers communicating with component 26 via wired and / or wireless communication links). The processing circuitry may include application-specific integrated circuits (ASICs) having processing circuitry, one or more microprocessors, a central processing unit (CPU), or other processing circuitry.
[0079] The input-output components (input-output devices) of component 26 may include displays, sensors, buttons (e.g., sensors for movable button components based on push-button switches), light-emitting diodes and other light-emitting devices for providing internal and / or external illumination, tactile devices, speakers, door locks, actuators for moving parts of doors, windows and / or other components, and / or other devices such as input devices for acquiring environmental measurements, information about the operation of the mobility system and / or user input. The sensors in component 26 may include ambient light sensors, touch sensors, force sensors, proximity sensors (e.g., optical proximity sensors and / or capacitive proximity sensors based on self-capacitance and / or mutual-capacitance sensor circuits), optical sensors such as cameras operating in visible, infrared, and / or ultraviolet wavelengths (e.g., fisheye cameras and / or other cameras), capacitive sensors, resistive sensors, ultrasonic sensors (e.g., ultrasonic distance sensors), microphones, three-dimensional and / or two-dimensional image sensors, radio frequency sensors such as radar sensors, lidar (light detection and ranging) sensors, door open / close sensors, seat pressure sensors and other mobility system occupant sensors, window sensors, position sensors for monitoring location, orientation, and movement, speedometers, satellite positioning system sensors, and / or other sensors. The output devices in component 26 may be used to provide tactile outputs (e.g., force feedback, vibration, etc.), audio outputs, visual outputs (e.g., displayed content, light, etc.), and / or other suitable outputs to mobility system occupants and others. Component 26 may be installed in the interior area 11 and / or the exterior area outside the body 18, and / or, if necessary, may be attached to and / or installed to other parts of the body 18.
[0080] like Figure 1 As shown, the mobility system 10 may include one or more light sources (e.g., referred to as light source 27) at the front F, rear R, or side S of the vehicle body 18. Light source 27 may be, for example, a display with a light panel assembly including light-emitting diodes that provide illumination and / or display content (e.g., images, text, patterns). Light source 27 may be formed by an opening in the vehicle body 18, may be mounted on an outer surface of the vehicle body 18, or may be otherwise coupled to the vehicle body 18.
[0081] In an embodiment where the light source 27 is located at the front F of the mobile system 10, the light source 27 may form a headlight and / or a display that shows information on the exterior of the mobile system 10. In an embodiment where the light source 27 is located at the rear R of the mobile system 10, the light source 27 may form a taillight and / or a display that shows information on the exterior of the mobile system 10. In an embodiment where the light source 27 is located at the side S of the mobile system 10, the light source 27 may form a display that shows information on the exterior of the mobile system 10 and / or illuminates the exterior 13 at the side S.
[0082] When the light source 27 is used as a display, the information displayed by the light source 27 can reflect the operating state of the mobility system 10 and / or can be used to inform the viewer of the display of the upcoming movement of the mobility system 10. For example, a controller in the mobility system 10 (e.g., part of component 26) can determine information about the operating state of the mobility system 10 and can control the display based on that information. In other words, the light source 27 can display information about the intentions of the driver of the mobility system 10 or the intentions of the mobility system 10 itself (if driving in autonomous mode).
[0083] For example, light source 27 may display text, symbols, images, patterns, or other information to indicate that the mobility system 10 is turning (e.g., based on turning motion), is about to turn, is moving in a specific direction (e.g., accelerating, decelerating, or reversing) (because it is planned to move in a specific direction), is changing speed, or needs assistance (e.g., it can be used as a hazard warning light). Additionally or alternatively, light source 27 may display information about the location or position of the mobility system 10, the speed of the mobility system 10, the upcoming lane change of the mobility system 10, the route the mobility system 10 is taking, etc. These examples are merely illustrations of the types of information that light source 27 may display, and in general, light source 27 may display any relevant information.
[0084] although Figure 1 A light source 27 is shown at the exterior of the mobile system 10, but one or more light sources can be formed inside the mobile system 10 if needed. For example, a light source 27 formed inside the mobile system 10 can provide illumination and / or display information for the driver or passengers of the mobile system 10.
[0085] Figure 2 An exemplary layer stack is shown that can form a light source 27 (and / or other light sources) in the mobile system 10. For example... Figure 2 As shown, the light source 27 may include a light plate assembly 28 mounted on a heat sink 30 and a carrier 31. A diffuser 34, a louver 36, and a cover lens 37 may be formed above the light plate assembly 28. A spacer 32 may maintain the space between the light plate assembly 28 and the diffuser 34. The diffuser 34 may be attached to the spacer 32 using an adhesive 33, and the louver 36 may be attached to the diffuser 34 using an adhesive 35. For example, adhesives 33 and 35 may be pressure-sensitive adhesives (PSA). In some embodiments, the light source 27 is a light source.
[0086] The substrate 39 can be formed below the carrier 31 and can also be formed on the substrate 39. All components of the light source 27 can be mounted in the housing 29. The controller 1 can be mounted in the rear portion of the housing 29.
[0087] In operation, a light panel assembly 28, which may include multiple light-emitting components such as light-emitting diodes (e.g., micro-LEDs), may emit light 17 via a diffuser 34, which may homogenize the light 17 via louvers 36 and a cover lens 37. The diffuser 34 may be formed of any desired diffusing material, such as particles in a transparent adhesive, or a diffusing structure (e.g., a protrusion or recess) formed on the surface of a substrate. The louvers 36 may include a material that absorbs visible light to reduce reflection of ambient light so as not to interfere with the light 17 emitted by the light panel assembly 28. The light-absorbing material may have small openings through which light from the light panel assembly 28 can pass while absorbing external light. The cover lens 37 may be formed of a transparent or translucent material. For example, the cover lens 37 may be a glass, ceramic, or polymer layer through which at least some of the light emitted by the light panel assembly 28 can pass.
[0088] The light emitted by the light panel assembly 28 can provide illumination and / or form content (e.g., when the light source 27 is used as a display). For example, light 17 can provide headlights, taillights, or ambient lighting for the mobile system. Alternatively or additionally, light 17 can form images, content, symbols, patterns, or other information for a viewer. For example, light 17 can form text, symbols, images, patterns, or other information to indicate that the mobile system 10 is turning, about to turn, is changing speed, needs assistance (e.g., can be used as a hazard warning light), or can indicate another operational status of the mobile system 10. Additionally or alternatively, light 17 can form information about the location of the mobile system 10, an upcoming lane change by the mobile system 10, the route the mobile system 10 is taking, etc. For example, controllers in the mobile system 10 (such as...) Figure 1 The controller in component 26 can control the light panel assembly 28 to display desired information based on the operating status of the mobile system 10. Generally, the light 17 from the light panel assembly 28 can be used to provide any desired illumination and / or display any desired content.
[0089] The light plate assembly 28 may be coupled to the heat sink 30 to prevent the light plate assembly 28 from overheating during operation. If necessary, the heat sink 30 may include a thermally conductive material to remove heat from the light plate assembly 28. Additionally or alternatively, the heat sink 30 may include a fan or other components to actively cool the light plate assembly 28.
[0090] The light plate assembly 28 and the heat sink 30 can be mounted to the carrier 31 using any desired fasteners, such as screws. A halo 38, which can be mounted on the printed circuit board 39, can be coupled to the opposite surface of the carrier 31 and can emit light 19 around the periphery of the light plate assembly 28 and through a cover lens 37. In some embodiments, the halo 38 may be formed of one or more light-emitting components, such as light-emitting diodes, and may additionally include light-guiding structures (such as light pipes or waveguides) if desired.
[0091] although Figure 2 Light 19 is shown emitted by a halo 38 and exits through a cover lens 37 without being diffused by a diffuser 34 or passing through a venetian blind 36 (also referred to herein as venetian blind 36 or louver 36), but this arrangement is merely illustrative. If desired, the diffuser 34, venetian blind 36, and / or other desired layers may overlap with the halo 38. In other words, light 19 may pass through 34, venetian blind 36, and / or other desired layers.
[0092] In some implementations, the light 19 from the halo 38 may form a turn signal indicator around the light panel assembly 28 (e.g., if the light panel assembly 28 is used as a headlight or taillight). However, in general, the halo 38 may be formed for any desired illumination.
[0093] The controller 1 can be used to control the light panel assembly 28 and / or the light ring 38. For example, the controller 1 can send signals to the driving circuit on the light panel assembly 28, which in turn drives the light-emitting components on the light panel assembly 28. In addition, the controller 1 can send signals to the driving circuit on the substrate 39, which in turn drives the light ring 38. For example, the controller 1 can receive signals based on the operating state of the mobile system 10 (e.g., from the controller of the mobile system 10), and can adjust the light panel assembly 28 and / or the light ring 38 based on the received signals.
[0094] In an exemplary embodiment, the light source 27 may have a circular shape (e.g., when viewed from the front of the overlay lens 37). For example, the light plate assembly 28 may have a circular shape, and the light ring 38 may have a corresponding circular shape and may surround the light plate assembly 28. However, this is merely illustrative. In general, the light source 27 may have any desired shape, such as an elliptical shape, a rectangular shape, or any non-rectangular shape.
[0095] Regardless of the shape of the light source 27 and / or the light plate assembly 28, the light plate assembly 28 may include an array of light-emitting components. Figure 3 An illustrative example of a portion of the light panel assembly 28 is shown in the figure.
[0096] like Figure 3As shown, the light panel assembly 28 may include an array of light-emitting components 40. The light-emitting components may be light-emitting diodes, micro-LEDs, OLEDs, or other desired light components. Any desired number of light-emitting components 40 may be included in the light panel assembly 28. For example, the light panel assembly 28 may include at least 1000 light-emitting components 40, at least 7000 light-emitting components 40, or at least 75,000 light-emitting components 40. Six light-emitting components 40 are shown. Figure 3 It can be just a part of the bare panel assembly 28.
[0097] In some implementations, it may be desirable to include material surrounding the light-emitting component 40. For example... Figure 3 As shown, filler material 4 and filler material 2 can be formed around each light-emitting component 40. Filler material 4 and filler material 2 together help prevent damage to the light-emitting component 40.
[0098] The filler material 4 may be formed of a light-absorbing material. For example, the filler material 4 may absorb at least 75%, at least 80%, at least 90%, or at least 95% of visible light. In other words, the filler material 4 may be an absorptive filler material. In some embodiments, the filler material 4 may be a black filler material (e.g., silicone resin, epoxy resin, or other filler materials dyed black or other colors). By surrounding each light-emitting element 40 with the absorptive filler material 4, ambient light incident on the light panel assembly 28 can be absorbed. In this way, the filler material 4 can improve the contrast of the light panel assembly 28 (e.g., by preventing ambient light from washing out the light emitted by the light-emitting element 40).
[0099] Although the filler material 4 has been described as being formed of an absorbent material such as a black filler material, the filler material 4 can be formed of a transparent filler material. Specifically, if the light plate assembly 28 is formed on an absorbent substrate (such as a black substrate (e.g., a substrate coated with a black material)), the filler material 4 can allow ambient light to pass through and reach the substrate, where the ambient light can be absorbed. As an example, the transparent material can be a transparent polymer, epoxy resin, or silicone resin.
[0100] A filler material 2 may be included between the light-emitting component 40 and the filler material 4. The filler material 2 may be formed of a light-reflective material. For example, the filler material 2 may reflect at least 70%, at least 75%, or at least 80% of visible light. In other words, the filler material 2 may be a reflective filler material. In some embodiments, the filler material 4 may be a white filler material (e.g., silicone resin, epoxy resin, or other filler materials dyed white or other colors). Therefore, the filler material 2 may reflect stray light from the light-emitting component, and the reflected stray light may exit the light panel assembly 28. By including the filler material 2 between the light-emitting component 40 and the filler material 4, the efficiency of the light panel assembly 28 can be improved.
[0101] During manufacturing, it may be difficult to include filler material 4 and / or filler material 2. Therefore, a damming material 6 may be included to contain filler material 4 and / or filler material 2 in desired locations within the bare plate assembly 28. The damming material 6 may be formed of epoxy resin, resin, polymer, or other desired materials (e.g., materials that cure before filler materials 4 and 2 are deposited on the substrate), or it may be a metal or plastic material. Figure 3 As shown, for example, the dam material 6 may surround each light-emitting component 40 and may contain filler material 4.
[0102] although Figure 3 The damming material 6 surrounding each light-emitting component 40 is shown, but this arrangement is merely illustrative. In general, the damming material 6 can surround any desired number of light-emitting components 40. Figure 4 An illustrative example of a light panel assembly with a dam material surrounding multiple light-emitting components is shown.
[0103] like Figure 4 As shown, the dam material 6 (and the filling material 4) can surround the four light-emitting components 40. Figure 4 In the example, each light-emitting component 40 may be surrounded by portions of reflective filler material 2, while a continuous portion of filler material 4 may surround each of the four light-emitting components 40. In this way, the reflective filler material 2 around each light-emitting component 40 can improve the efficiency of the light panel assembly 28, while the absorptive filler material 4 can absorb ambient light to improve the contrast of the light panel assembly 28.
[0104] Figure 4 The example is merely illustrative, in which four light-emitting components 40 are surrounded by damming material 6 and filling material 4. In general, any number of light-emitting components 40 (such as 8 or 9 light-emitting components) can be surrounded by the same damming material 6 and the same filling material 4.
[0105] Regardless of the number of light-emitting components surrounded by the dam structure and infill material, the height of the light-emitting components should be greater than the height of the infill material to prevent the infill material from interfering with the light-emitting components. Figure 5 An illustrative example of a light panel assembly with a light-emitting component having a height greater than that surrounding the filling material is shown.
[0106] like Figure 5 As shown, a light-emitting component 40 can be formed on a substrate 8. The substrate 8 can be, for example, a printed circuit board or other substrate. The light-emitting component 40 can have a height T above the substrate 8. L Height T L It can be at least 140 micrometers, at least 150 micrometers, at least 160 micrometers, 150 micrometers, or another suitable height.
[0107] Filler material 2 and filler material 4 may have a maximum height T above substrate 8. M Height T M It can be less than the height T L For example, height T M It can be less than 150 micrometers, between 100 and 150 micrometers, less than 140 micrometers, or any other suitable height. Generally speaking, by ensuring height T... M Less than height T L This prevents the filling material 2 and / or filling material 4 from diffusing above the top of the light-emitting component 40, thereby protecting the light-emitting component 40 from interference by the filling material 2 and filling material 4.
[0108] The dam material 6 may have a height T above the substrate 8. D Generally speaking, height T D It can be greater than the height T M The desired height is determined to include filler material 2 and filler material 4 between dam material 6 and light-emitting component 40. In some embodiments, height T... D It can be greater than the height T M But less than height T L In this way, the dam material 6 can contain filler material 2 and filler material 4 without blocking stray light from the light-emitting component 40.
[0109] Although the damming material 6 has been described as surrounding both the infill material 2 and the infill material 4 in direct contact, this is merely illustrative. In general, the damming material can be included anywhere within the bare plate assembly 28 to contain infill material 2 and / or infill material 4. Figure 6 An illustrative example is shown in which additional dam material is included between infill material 2 and infill material 4.
[0110] like Figure 6 As shown, the light panel assembly 28 may include additional damming material 50. The additional damming material 50 may be located between filler material 2 and filler material 4. Specifically, it may be desirable to completely separate filler material 2 and filler material 4. Although filler material 2 and filler material 4 may be formed of materials that naturally maintain separation (e.g., in…) Figure 3 (as in the example), but if needed, dam material 50 can be used to ensure that the two filling materials do not overlap.
[0111] Alternative locations, such as Figure 7 As shown, the dam material 6 can be omitted, and only the dam material 50 between the fill material 2 and the fill material 4 may exist. In this embodiment, the fill material 2 may be constrained by the dam material 50, while the fill material 4 may freely expand across the light plate assembly 28.
[0112] Furthermore, in some implementations, filler material 2 can be completely omitted. For example... Figure 8 As illustrated in the exemplary example, the filler material 4 can directly contact the side of the light-emitting component 40. In some embodiments, the light-emitting component 40 may be pre-encapsulated with a reflective material, thus eliminating the need for additional reflective material. Alternatively, in embodiments where display efficiency may be reduced, the reflective material may be omitted entirely. Figure 8 As shown, the damming material 6 can constrain the filling material 4 between the light-emitting components 40. However, the damming material 6 can be omitted (e.g., as in...). Figure 7 (in the middle) to allow the filling material 4 to diffuse across the light plate assembly 28.
[0113] By including an absorbent filler material 4 around the light-emitting component 40, ambient light can be absorbed, thereby increasing the contrast of the light panel assembly 28. Additionally, the filler material 4 and / or the filler material 2 can provide protection for the light-emitting component 40. As an alternative or supplement to including the filler material 4 to absorb ambient light and / or including the filler material 2 to improve display efficiency, a stack of anti-reflective coatings may be included in the display (e.g., above the light panel assembly). Figure 9 An illustrative example of a stacked display with an anti-reflective coating is shown in the figure.
[0114] like Figure 9 As shown, a display (such as a light source 27) may include a light panel assembly 28, a diffuser 34, a venetian blind 36, and a cover lens 37. For simplicity, in Figure 9 The above text is omitted. Figure 1 The remaining display layers described, but may include Figure 1 Some or all of the display layers in the display layer.
[0115] The light source 27 may include multiple anti-reflective coatings, such as anti-reflective coating 56, anti-reflective coating 62, anti-reflective coating 66, and anti-reflective coating 70. Figure 9 In an exemplary example, the light source 27 includes an anti-reflective coating 56 between the light plate assembly 28 and the diffuser 34. An air gap 54 separates the light plate assembly 28 and the anti-reflective coating 56.
[0116] An anti-reflective coating 62 may be formed between the diffuser 34 and the veil 36. An air gap 60 may separate the anti-reflective coating 62 from the diffuser 34. An anti-reflective coating 66 may be formed on the veil 36, and an anti-reflective coating 70 may be formed on the cover lens 37. An air gap 68 may separate the anti-reflective coating 70 from the anti-reflective coating 66.
[0117] Generally speaking, using an anti-reflective coating can reduce the amount of ambient light reflected by the light source 27. For example, Figure 9The anti-reflective coating can reduce display reflections by at least 10%, at least 15%, or at least 20%. Furthermore, due to the presence of the anti-reflective coating, the light source 27 can have higher brightness. In this way, the anti-reflective coating improves the efficiency and contrast of the light source 27.
[0118] Although antireflective coatings 56, 62, 66, and 70 are in Figure 9 It is shown as being in a specific position, but Figure 9 The arrangement is merely illustrative. Any desired amount of antireflective coating may be included in the light source 27, and the antireflective coating may be formed in, on, or between any desired layers of the light source 27.
[0119] Figures 10A to 10F Exemplary user interfaces for indicating context are illustrated according to some embodiments. The user interfaces in these figures are used to illustrate some embodiments described herein.
[0120] In some implementations, the techniques described below relate to accessibility features, wherein systems (e.g., computer systems, mobile systems, mobile computer systems, mobile systems and / or mobile computer systems, such as...) Figure 1 The mobile system 10) is connected via one or more display generating components (e.g., displays, screens, touch-sensitive displays, light sources, and / or projectors, such as...) included in and / or communicating with the system. Figure 1 The light source 27) is used to convey information. In some embodiments, the techniques described below allow a subject in the physical environment of the system to obtain information about (1) the current and / or expected movement of the system and / or (2) other information conveyed by the system. In some embodiments, one or more display generating components are disposed on the system such that the display generating components are positioned away from the system and / or the subject in the physical environment can see the information displayed by the one or more display generating components. In some embodiments, the system includes a motion actuator configured to move the system in a first set of one or more directions (e.g., forward, backward, left and / or right) and / or in a second set of one or more directions that are different from and / or perpendicular to the first set of one or more directions (e.g., forward, backward, left and / or right). In some embodiments, the system automatically displays and / or updates one or more portions of the user interface via one or more display generating components based on the movement of the system and / or the movement of the subject in the physical environment.
[0121] Figures 10A to 10FA left display 1000a and a right display 1000b are illustrated. In some embodiments, the left display 1000a and / or the right display 1000b include one or more features, components, and / or functions as discussed above with respect to light source 27. In some embodiments, the left display 1000a is and / or corresponds to Figure 1 The lower left example of light source 27. In some embodiments, the right display 1000b is and / or corresponds to Figure 1 The top left instance of light source 27 in the image.
[0122] In some embodiments, the left display 1000a and the right display 1000b are disposed on a common outer surface of the system (e.g., the vehicle body 18). In some embodiments, the left display 1000a and the right display 1000b are positioned on the system at a common depth from the common outer surface. For example, the left display 1000a and the right display 1000b may extend inward and / or outward by the same amount from the vehicle body 18 of the moving system 10 (e.g., as described above). Figure 1 (Referring to the location). In some embodiments, the left display 1000a and the right display 1000b are on and / or coupled to the common side of the system (e.g., the front, side, or rear of the system, such as the front F of the mobile system 10). In some embodiments, the left display 1000a and the right display 1000b are positioned on the system such that the left display 1000a and the right display 1000b are directed away from the interior of the system (e.g., within the vehicle body 18). In some embodiments, the left display 1000a and the right display 1000b are on the longitudinal axis of the system (e.g., as described above regarding...). Figure 1 On the opposite side of the longitudinal axis 22 discussed and / or on the transverse axis of the system (e.g., as Figure 1 On the same side of the horizontal axis 20 shown (to the left). In some embodiments, the left display 1000a and the right display 1000b face and / or point in different and / or non-overlapping directions. For example, the left display 1000a may face the left area in front of the system, while the right display 1000b may face the right area in front of the system. In some embodiments, the left display 1000a is closer to the first side of the system (e.g., on the left side of the horizontal axis 20 shown). Figure 1 The edge of the side portion S on the bottom side (e.g., corresponding to the side portion S on the bottom side) Figure 1 The edge where the front part F intersects with the side part S on the lower left side), rather than closer to the other side of the system (e.g., Figure 1 The edge of the side portion S on the top side (e.g., corresponding to the side portion S on the top side) Figure 1 The edge where the front part F intersects with the side part S on the upper left side). In some embodiments, the right display 1000b is closer to the second side of the system (e.g., different from the first side) (e.g., Figure 1 The edge of the side portion S on the top side (e.g., corresponding to the side portion S on the top side) Figure 1 The edge where the front part F intersects with the side part S on the upper left side), rather than closer to the other side of the system (e.g., Figure 1 The edge of the side portion S on the bottom side (e.g., corresponding to the side portion S on the bottom side) Figure 1 The edge where the front portion F intersects with the side portion S on the lower left side. In some embodiments, the left display 1000a is closer to the edge of the first side than the right display 1000b. In some embodiments, the right display 1000b is closer to the edge of the second side than the left display 1000a.
[0123] In some implementations, the left display 1000a is covered by a lens (e.g., as described above regarding...). Figure 2 The described overlay lens 37) covers the right display 1000b. In some embodiments, the right display 1000b is covered by the same overlay lens as the left display 1000a or a different overlay lens (e.g., as described above regarding...). Figure 2 The described covering lens 37) covers.
[0124] In some embodiments, the system controls the display operation of the left display 1000a and / or the right display 1000b. In some embodiments, another system (e.g., a smartphone, smartwatch, tablet, laptop, desktop computer, accessory device, smart display, smart speaker, and / or smart light fixture) (e.g., different from and / or external to the system, the left display 1000a, and / or the right display 1000b) controls (e.g., via the system and / or directly with the left display 1000a and / or the right display 1000b). In some embodiments, the left display 1000a and / or the right display 1000b controls the display operation of the left display 1000a and / or the right display 1000b.
[0125] Figures 10A to 10FA left display 1000a is illustrated, showing a user interface comprising an inner region 1010a and an outer region 1020a. In some embodiments, the inner region 1010a and the outer region 1020a are displayed via a single display generating component (e.g., the left display 1000a). In some embodiments, the inner region 1010a is displayed by a first display generating component (e.g., a light panel assembly 28), and the outer region 1020a is displayed by a second display generating component (e.g., a halo 38) different from the first display generating component. In some embodiments, the first display generating component is at a depth different from the depth of the second display generating component relative to the surface of the system (e.g., the vehicle body 18). In some embodiments, the first display generating component and / or the second display generating component is at a depth different from the depth of one or more lamps (e.g., headlights and / or taillights of the same size as the first and / or second display generating components) relative to the surface of the system (e.g., the vehicle body 18). In some embodiments, the inner region 1010a occupies the entire display of the first display generating component. In some implementations, the outer region 1020a occupies the entire display of the second display generating component. For example... Figures 10A to 10F As illustrated, the outer region 1020a surrounds and / or encloses the inner region 1010a. It should be appreciated that in some embodiments, the outer region 1020a may partially and / or incompletely surround and / or enclose the inner region 1010a.
[0126] Figures 10A to 10FAn example is illustrated of a right display 1000b that displays a user interface including an inner region 1010b and an outer region 1020b. In some embodiments, the inner region 1010b and the outer region 1020b are displayed via a single display generating component (e.g., the right display 1000b). In some embodiments, the inner region 1010b is displayed by a third display generating component (e.g., a light panel assembly 28) (e.g., different from the first and / or second display generating components), and the outer region 1020b is displayed by a fourth display generating component (e.g., a halo 38) that is different from the third display generating component (and in some embodiments, the first and / or second display generating components). In some embodiments, the third display generating component is at a depth different from the depth of the fourth display generating component relative to the surface of the system (e.g., the body 18). In some embodiments, the third and / or fourth display generating components are at a depth different from the depth of one or more lamps (e.g., headlights and / or taillights of the same size as the third and / or fourth display generating components) relative to the surface of the system (e.g., vehicle body 18). In some embodiments, the inner region 1010a occupies the entire display of the third display generating component. In some embodiments, the outer region 1020a occupies the entire display of the fourth display generating component. Figures 10A to 10F As illustrated, the outer region 1020b surrounds and / or encloses the inner region 1010b. It should be appreciated that in some embodiments, the outer region 1020a may partially and / or incompletely surround and / or enclose the inner region 1010b.
[0127] In some implementations, a portion of the internal region 1010a (e.g., including) Figure 10A The visual characteristics 1012a in the image) and a portion of the internal region 1010b (e.g., including the ... Figure 10A The display of the visual feature 1012b is synchronized, such that the portion of the inner region 1010a matches the portion of the inner region 1010b. In some embodiments, the inner regions 1010a and 1010b are synchronized when the system is moving, has been determined to move within a predefined time period (sometimes referred to herein as the initialization time), and / or when the system stops, no subject is detected in the predefined region outside the system. In some embodiments, when the system stops (and / or has been determined not to move within a predefined time period (sometimes referred to herein as the stop time) and a subject has been detected in the predefined region outside the system, a portion of the inner region 1010a (e.g., excluding the portion of the visual feature 1012b) is displayed synchronously, such that the portion of the inner region 1010a matches the portion of the inner region 1010b. Figure 10A The portion of visual characteristic 1012a and the portion of internal region 1010b (e.g., excluding) Figure 10AThe visual characteristic 1012b in the inner region is out of sync. In some embodiments, the display of the inner region 1010a is synchronized with the display of the inner region 1010b, regardless of the system's motion state. In some embodiments, based on the determination that the system is inactive, powered off, and / or operating in a non-autonomous mode, the left display 1000a stops, abandons, and / or does not display the visual characteristic 1012a.
[0128] In some implementations, the internal area 1010a, external area 1020a, internal area 1010b, and / or external area 1020b are not visible from positions within the system. For example, the internal area 1010a, external area 1020a, internal area 1010b, and external area 1020b are not visible from seated and / or standing positions within the system.
[0129] In some embodiments, the left display 1000a and the right display 1000b (1) operate as headlights of the system (while in some embodiments, the system does not include one or more other headlights), and (2) are coupled to the front portion of the system (e.g., moving the front F of the system 10) (e.g., adjacent to the windshield 12). In some embodiments, the left display 1000a and the right display 1000b (1) operate as taillights of the system (while in some embodiments, the system does not include one or more other taillights), and (2) are coupled to the rear portion of the system (e.g., moving the rear R of the system 10) (e.g., adjacent to the rear window 14).
[0130] In some embodiments, in addition to the left display 1000a and the right display 1000b, the system includes one or more headlights. In some embodiments, the one or more headlights are positioned and / or coupled to the same side of the system as the left display 1000a and / or the right display 1000b. In some embodiments, the one or more headlights face a direction similar to or the same as the left display 1000a and / or the right display 1000b, such that the one or more headlights illuminate the area of the physical environment with a view of the left display 1000a and / or the right display 1000b. In some embodiments, in addition to the left display 1000a and / or the right display 1000b, the system includes one or more taillights. In some embodiments, the one or more taillights are positioned and / or coupled to the same side of the system as the left display 1000a and / or the right display 1000b. In some embodiments, the one or more taillights face a direction similar to, the same as, and / or different (e.g., opposite) to the left display 1000a and / or the right display 1000b. For example, one or more taillights may illuminate and / or output light to an area of the physical environment having a view of the left display 1000a and / or the right display 1000b. As another example, one or more taillights may illuminate and / or output light to an area of the physical environment that does not have a view of the left display 1000a and / or the right display 1000b, such as when the area of the physical environment having a view of the left display 1000a and / or the right display 1000b is facing the front portion of the system (e.g., Figure 1 When the front part F) and one or more taillights are facing the rear part of the system (e.g., the rear part R of the moving system 10).
[0131] This article discusses Figures 10A to 10F The description of the left display 1000a, inner region 1010a, and / or outer region 1020a applies to the right display 1000b, inner region 1010b, and / or outer region 1020b. That is, the left display 1000a and right display 1000b, and their respective components, may have the same, consistent, and / or similar functionality. In some embodiments, because the left display 1000a and right display 1000b are located on the same system (e.g., mobile system 10), the left display 1000a and right display 1000b move in tandem throughout the physical environment. That is, when the left display 1000a moves in a corresponding direction in the physical environment as described below, the right display 1000b also moves in that corresponding direction, and vice versa. In some embodiments, the left display 1000a and right display 1000b move independently.
[0132] In some implementations, the left display 1000a and / or the right display 1000b show indications (e.g., graphical and / or textual indications) regarding whether the system is on, active, moved, and / or will move within a predetermined time period (e.g., via their respective display areas, such as within internal areas 1010a and / or internal areas 1010b). Figures 10A to 10F As illustrated, the indication takes the form of visual characteristic 1012a. For example... Figures 10A to 10F As illustrated, visual characteristic 1012a is a color (e.g., black) that fills a portion of the inner region 1010a. In some embodiments, portions of the inner region 1010a not filled with visual characteristic 1012a are filled with another color. In some embodiments, portions of the inner region 1010a not filled with visual characteristic 1012a are not filled with color. In some embodiments, the indicator and / or inner region 1010a includes more colors than black and white (e.g., more than two colors), such as... Figure 10A As shown. For example, the indication may include (1) a first set of one or more colors indicating a driving mode (e.g., the system is currently being autonomously driven and / or is navigating to a destination), and (2) a second set of one or more colors indicating whether the system is currently in a static state and / or it has been determined that the system will not move during the stationary period. In some embodiments, the left display 1000a displays the outer area 1020a with the same visual characteristics and / or patterns as visual characteristic 1012a. In some embodiments, visual characteristic 1012a is a brightness level, tint level, corresponding hue, pulse frequency level, and / or corresponding hue, as an alternative to and / or supplement to color. In some embodiments, visual characteristic 1012a is an image (e.g., an image including or excluding text) and / or video. It should be recognized that in Figures 10A to 10F The illustration of visual characteristics 1012a (e.g., height growth and / or contraction) is intended as an example, and other animations may be used in conjunction with the techniques described herein, such as visual representations of expanding and contracting anatomical features (e.g., eyes) from regions, and / or using changes to different colors.
[0133] It is worth noting that in some figures, visual feature 1012a is included in a first portion of the inner region 1010a, but not in another portion of the inner region 1010a. In some embodiments, the first portion of visual feature 1012a is included (e.g., as shown in the figure). Figure 10A (As illustrated) indicates that the system is currently being autonomously driven and / or is navigating to a destination. In some implementations, the second part of visual feature 1012a is not included (e.g., as shown). Figure 10A (As illustrated) Indicates that the system is currently static and / or it has been determined that the system will not move during the stop time.
[0134] In some implementations, the appearance of the indication may change based on the system's motion state (e.g., (1) whether the system is on, active, moving, and / or will move during the initialization period, (2) whether the system is autonomously or manually navigating, (3) whether the system is moving, (4) the system's speed, acceleration, and / or direction of travel, and / or (5) whether the system has determined to stop and / or move). For example, the left display 1000a may display an indication of whether the system is in an autonomous driving state, such as by Figure 10A The visual feature 1012a is illustrated in the example. For instance, the left display 1000a may display an indication of whether the system has been determined to move (e.g., when stopped) and / or is moving, such as by... Figure 10B The visual feature 1012a is illustrated in the example. For instance, the left display 1000a may display an indication of whether the system has been determined to stop (e.g., during movement) and / or is stopping, such as from... Figures 10B to 10D The visual characteristics 1012a illustrate this. It should be understood that such examples of indications and the discussion below are for illustrative purposes only, and different representations of the indications may be used with the techniques described herein.
[0135] exist Figure 10A At this point, it is determined that the system will not move during the stopping time. In some implementations, since it is determined that the system will not move during the stopping time, the system displays (1) visual characteristics 1012a within the internal region 1010a and (2) visual characteristics 1012b within the internal region 1010b.
[0136] exist Figure 10A In some embodiments, determining that the system will begin moving within an initialization timeframe is based on detecting one or more user actions (such as user interaction with the system, user and / or system initiation of movement, and / or user sending one or more requests to the system). In some embodiments, determining that the system will begin moving is based on one or more micro-movements (e.g., small vibrations) made by the system, such as movements detectable by a gyroscope and / or heart rate sensor external to the system (e.g., worn by the driver and / or passenger). In some embodiments, determining that the system will begin moving is based on an autonomous driving system navigating the system to its destination.
[0137] like Figure 10B As illustrated, based on the determination that the system will begin moving within the initialization time and / or that the system is moving outside the initialization time, the left display 1000a increases the size of the visual feature 1012a. Therefore, in Figure 10B At that location, visual characteristics 1012a are compared to those at... Figure 10AThe visual characteristics 1012a cover more of the interior area 1010a. Additionally, in Figure 10B Based on the determination that the system will begin moving within the initialization time and / or that the system is moving outside the initialization time, the right display 1000b increases the size of the visual feature 1012b.
[0138] In some embodiments, as part of increasing the size of the visual feature 1012a, the left display 1000a displays an animation of the visual feature 1012a filling the inner region 1010a over time (e.g., an upward sliding animation and / or a fill animation, wherein the visual feature 1012a slowly rises to cover more of the inner region 1010a). In some embodiments, the rate of the animation of the visual feature 1012a filling the inner region 1010a is not based on the system's movement rate. That is, the visual feature 1012a fills the inner region 1010a at a constant rate, regardless of the rate at which the system accelerates. In some embodiments, the left display 1000a completes the display of the animation of the visual feature 1012a filling the inner region 1010a before the system moves in one direction (e.g., forward, backward, and / or sideways).
[0139] In some implementations, the system's elevation height automatically (e.g., without intermediate user input) increases based on the determination that the system will begin moving within a predetermined time period (sometimes referred to as the elevation time). In some implementations, the system's elevation height remains elevated while the system is in motion (e.g., until the system determines it will stop and / or during the descent time, as discussed further below). In some implementations, the elevation height of the elevation system includes the front portion of the elevation system (e.g., Figure 1 The elevation height of at least a portion of the region to the left of the transverse axis 20 in the system, while raising or maintaining the rear portion of the system (e.g., Figure 1 The elevation height of at least a portion of the area to the left of the horizontal axis 20 in the system. In some embodiments, the display of the left display 1000a and / or the right display 1000b changes with the elevation height of the system (e.g., to indicate the elevation height of the system). In some embodiments, the appearance of the outer area 1020a and / or the outer area 1020b does not change with the elevation height of the system.
[0140] In some embodiments, the system's elevation height decreases automatically (e.g., without intermediate user input) as the system stops and / or during a predetermined time period (sometimes referred to herein as the reduction time) from the start of the stop. For example, the system's elevation height decreases to the level of a sidewalk, allowing passengers to safely exit the system. In some embodiments, reducing the system's elevation height includes reducing the elevation height of the front portion of the system and raising or maintaining the elevation height of the rear portion of the system. In some embodiments, the system outputs sound as the elevation height decreases. In some embodiments, the audio characteristics (e.g., pitch, bass, and / or volume) of the system's output sound change with the system's elevation height. For example, the sound volume decreases as the elevation height decreases. In some embodiments, the left display 1000a displays visual characteristics 1012a (e.g., as shown in the image) within a portion of the internal area 1010a. Figure 10D (As illustrated) to indicate that the system is not moving and is in an autonomous state. In some embodiments, the display of the outer region 1020b changes with the system's elevation height (e.g., to indicate the system's elevation height). In some embodiments, the display of the inner region 1010a, outer region 1020a, visual feature 1012a, and / or visual feature 1012b changes with the system's elevation height (e.g., to indicate the system's elevation height). For example, as the system's elevation height increases, the inner region 1010a and / or visual feature 1012a may gradually fill with one or more colors. Similarly, as the system's elevation height decreases, the inner region 1020b and / or visual feature 1012b may gradually fade one or more colors.
[0141] In some implementations, the appearance of the outer region 1020a is based on system characteristics different from those of the inner region 1010a. For example, the appearance of the outer region 1020a may be altered based on the system's energy level (e.g., the system's battery level) and / or the system's driving direction (e.g., left or right turn) or indications (e.g., hazard lights), as discussed further below. Figure 10B Based on the determination that the system will begin moving within the initialization time, the left display 1000a will not change the display of the outer area 1020a.
[0142] exist Figure 10B At this point, the left display 1000a continues to display as shown. Figure 10B The presented internal region 1010a and visual characteristics 1012a are maintained until it is determined that the system has stopped or is beginning to stop (e.g., as described below regarding...). Figures 10C to 10D (To be further discussed). Figure 10B At this point, determine whether the system is turning left or intends to turn left. Additionally, at... Figure 10BAt a certain point, it is determined that the system is about to stop and / or will cease movement within a predetermined time period (sometimes referred to herein as the stop time). In some implementations, the system is determined to stop because street signs, pedestrian crossings, bike lanes, people, and / or hazards are detected in the system's path.
[0143] As explained above, the appearance of the outer region 1020a is based on the characteristics of the system. As discussed in more detail below, the appearance of the outer region 1020a is based at least on the system's current direction of travel and / or its future direction of travel. In some embodiments, the appearance of the outer region 1020a may be based on several different characteristics of the system, such as the system's velocity and / or the system's acceleration.
[0144] like Figure 10C As illustrated, based on the determination that the system is turning left (and / or intends to turn left), the left display 1000a displays visual characteristic 1018a within the outer area 1020a. Visual characteristic 1018a is an indication of the state of one or more characteristics of the system. More specifically, in Figure 10C At this point, visual feature 1018a is an indication that the system is turning left and / or intends to turn left. Although in Figure 10C In this respect, visual characteristic 1018a is similar in appearance to visual characteristic 1012a (for example, both are solid colors), but in Figure 10C The appearance of visual features 1018a and 1012a is merely exemplary. In some embodiments, visual feature 1018a within the outer region 1020a has a different color, brightness level, and / or hue than visual feature 1012a. In some embodiments, visual feature 1018a within the outer region 1020a pulses (e.g., similar to a turn signal), while visual feature 1012a does not pulse. In some embodiments, the left display 1000a changes the display of both the outer region 1020a and the inner region 1010a based on a determination that the system (e.g., moving system 10) will turn left. For example, when the system decelerates to make a left turn, the left display 1000a changes the display of both the outer region 1020a and the inner region 1010a. In some embodiments, the left display 1000a does not change the display of the inner region 1010a based on a determination that the system will turn left.
[0145] In some implementations, the appearance of external regions 1020a and 1020b indicates different states of the system. For example, in Figure 10C In this case, the right display 1000b does not display the corresponding visual characteristics within the outer area 1020b because it is determined that the system will turn left (instead of right). That is, the left display 1000a updates the appearance of the outer area 1020a to indicate the first type of turn of the system (e.g., a left turn), and as described below... Figure 10F As discussed in more detail below, the right display 1000b updates the appearance of the outer area 1020b to indicate a second type of turn in the system (e.g., a right turn). In some embodiments, both outer areas 1020a and 1020b are updated to indicate a change in the state of the system. For example, both outer areas 1020a and 1020b may be updated to indicate that the system is performing or intends to perform a U-turn. For another example, outer areas 1020a and / or 1020b may be updated to indicate a system malfunction, such as one or more components not operating as expected (e.g., low air in the tires and / or one or more light sources not operating).
[0146] Returning to the discussion of the display of visual feature 1012a, when the system stops, the display of visual feature 1012a changes to indicate that the system is stopping. For example, visual feature 1012b may fade out as the system stops, reduce the frequency of the pulses of visual feature 1012a, change the amount of shading and / or coloring, and / or change the color. Figure 10C Based on the determination that the left display 1000a is about to stop (e.g., decelerate), the left display 1000a reduces the amount of visual feature 1012a displayed within the internal region 1010a. Figure 10C In this embodiment, the left display 1000a reduces the amount of visual feature 1012a displayed within the inner region 1010a by displaying an animation of visual feature 1012a being removed from the inner region 1010a (e.g., a slide-down animation and / or a fade-out animation). In some embodiments, the rate of the animation (e.g., the speed at which visual feature 1012a is removed) is based on the rate at which the system decelerates. For example, when the system stops at a faster rate, the left display 1000a removes visual feature 1012a at a faster rate, and when the system stops at a slower rate, the left display 1000a removes visual feature 1012a at a slower rate. In some embodiments, the left display 1000a outputs sound while reducing the amount of visual feature 1012a. For example, the left display 1000a may output a sound simulating the deceleration of a car (e.g., the sound of a brake pad when it contacts the rotor of a wheel and / or the sound of an engine when its revolutions per minute decrease). In some implementations, the volume or pitch of the sound is reduced proportionally to the reduction in the amount of visual characteristic 1012a. Figure 10C A hazard is detected in the physical environment (e.g., by the left display 1000a, the right display 1000b, and / or the system).
[0147] exist Figure 10D At that location, the left display 1000a has reduced the amount of visual characteristics 1012a displayed within the internal region 1010a based on the determination that the system is about to stop (e.g., decelerate). Figure 10D At this point, the system has completely stopped, and most of the visual feature 1012a has been removed from the internal region 1010a. However, a portion of the visual feature 1012a remains in the internal region 1010a (e.g., when the left display 1000a was initially in...). Figure 10A (The same portion that exists within the internal region 1010a when the process stops).
[0148] In some embodiments, the left display 1000a and / or the right display 1000b may indicate information about conditions detected within the physical environment via external areas 1020a and / or external areas 1020b. For example, the appearance of external areas 1020a and / or external areas 1020b may be altered to indicate weather conditions, hazards in the system's path, and / or hazards related to the system's operation. Therefore, external areas 1020a and / or external areas 1020b may be configured to indicate changes in the system's status and / or conditions detected in the physical environment.
[0149] like Figure 10D As illustrated, based on the determination that a hazard is within the physical environment, the left display 1000a displays visual characteristic 1018a within the outer area 1020a, and the right display 1000b displays visual characteristic 1018b within the outer area 1020b. In some embodiments, the left display 1000a and the right display 1000b simultaneously display hazard information that pulsates at the same time and / or at the same frequency (e.g., the same visual characteristics in the outer areas 1020a and 1020b) (e.g., similar to hazard signals on a vehicle). In some embodiments, either the outer area 1020a or the outer area 1020b displays an indication of a hazard detected based on the hazard's location relative to the system. For example, if the hazard is closer to the left display than the right display, the outer area 1020a will display an indication of the hazard, and the outer area 1020b will not display a corresponding indication of the hazard. In some implementations, the left display 1000a and right display 1000b may display an indication of danger in external areas 1020a and 1020b based on the determination that the system (e.g., mobile system 10) has malfunctioned and / or that the user of the system wants to convey danger information. For example, based on the determination that the user is drowsy, experiencing a medical emergency, and / or unable to operate the system, the left display 1000a and / or right display 1000b may display an indication of the user's status in external areas 1020a and / or 1020b. As an additional example, based on the determination that the system's wheel pressure per square inch (e.g., PSI) is below a threshold and / or the system's steering signal is inoperable, the left display 1000a and / or right display 1000b may display an indication of the system's status in external areas 1020a and / or 1020b.
[0150] In some embodiments, the left display 1000a and / or the right display 1000b do not change the display of the internal areas 1010a and / or 1010b based on the detection of a hazard. In some embodiments, the left display 1000a and / or the right display 1000b change the appearance of the internal areas 1010a and / or 1010b based on the detection of a hazard, but do not change the appearance of the external areas 1020a and / or 1020b. For example, the left display 1000a and the right display 1000b may display a graphic and / or text representation of the detected hazard within their respective display areas. In some embodiments, when the left display 1000a indicates a detected hazard, it displays the external area 1020a with a different amount of corresponding visual characteristics compared to when the left display 1000a signals to the system that a turn is occurring. For example, the left display 1000a may display the outer area 1020a in light blue based on determining that the system is making a left turn and / or will make a left turn, and the left display 1000a may display the outer area 1020a in dark blue in response to detecting a hazard. As an additional example, the left display 1000a may display the outer area 1020a in a purely static color based on determining that the system is making a left turn and / or will make a left turn, and the left display 1000a may display the outer area 1020a in an appearance that rotates between two or more colors based on determining that a hazard has been detected.
[0151] exist Figure 10D An individual is detected (e.g., by the system and / or by the right display 1000b) within a predetermined area on the right display 1000b (e.g., when the system is stopped). The first individual is detected as an adult. In some embodiments, the first individual is detected via one or more sensors of the system (e.g., one or more cameras and / or one or more depth sensors).
[0152] In some implementations, in addition to displaying indications of the system's status, the left display 1000a and / or the right display 1000b also display indications of various types of objects detected within the physical environment. For example, the left display 1000a may display static solid colors, animated colors, text representations, and / or graphical representations of objects detected in the physical environment. The appearance of the object representation may change as the object moves relative to the system within the physical environment. For example, the object representation may grow in size as the distance between the object and the system decreases, or the color of the object representation may increase in intensity as the distance between the object and the system increases. As another example, the pulsation frequency of the object representation may increase (or decrease) as the distance between the object and the system increases.
[0153] like Figure 10EAs illustrated, based on the detection of a first body within a predetermined area of the right display 1000b, the right display 1000b displays a representation of the individual 1032 within an internal area 1010b. For example, the first body may be located 1 to 100 feet away from the right display 1000b, or the first body may be within the field of view of a camera communicating with and / or corresponding to the right display 1000b. In some embodiments, the representation of individual 1032 is only visible from a location outside the system. For example, the representation of individual 1032 may be obscured from passengers of the system.
[0154] exist Figure 10E In some embodiments, the right display 1000b does not update the display of the outer area 1020b based on the detection of a first body within a predetermined area of the right display 1000b. In some implementations, the right display 1000b does not display representations of immovable and / or non-movable objects (e.g., trees, buildings, and / or traffic signals) (and / or non-human / animals) located within the physical environment, regardless of the distance between the immovable and / or non-movable objects and the system. In some implementations, the left display 1000a and the right display 1000b only display representations of movable and / or mobile objects located within the physical environment.
[0155] The right display 1000b displays an indication of an object detected in the environment based on the object's appearance. For example, because the first body is detected as an adult, the appearance of the representation of individual 1032 corresponds to the appearance of an adult. In some embodiments, the appearance of the indication of object detection is not based on the object's appearance. For example, in some embodiments, when an animal is detected in the physical environment, the right display 1000b displays a blue circle. In some embodiments, the representation of individual 1032 is not a live feed and / or does not actually resemble (e.g., does not look like) the first body. For example, the representation of individual 1032 does not mimic the movement of the first body. In some embodiments, the representation of individual 1032 does not have a fixed shape (e.g., the representation of individual 1032 is a spot), where the size and / or shape of the first body is not represented by the representation of individual 1032. However, in some embodiments, the representation of individual 1032 includes one or more facial features of the first body. In some embodiments, the first display 1000b moves the representation of individual 1032 such that the representation of individual 1032 mimics the movement of the first body in the physical environment.
[0156] In some implementations, when the distance between the first body and the right display 1000b (e.g., and / or the system) is greater than a predetermined distance threshold (e.g., 1 foot to 100 feet), the right display 1000b does not display a representation of individual 1032. In some implementations, the right display 1000b initiates the display of a representation of individual 1032 based on determining that the distance between the first body and the system changes from greater than the predetermined distance threshold to less than the predetermined distance threshold. For example, the right display 1000b may initiate the display of a representation of individual 1032 based on the system having moved closer to the first body, the first body moving towards the system, or both the first body and the system having moved closer to each other. In some implementations, the right display 1000b displays a representation of individual 1032 based on the dimension of the distance between the right display 1000b and the first body. For example, the closer the first body is to the system, the larger the representation of the individual 1032 is displayed on the right display 1000b, and the farther the first body is from the system, the smaller the representation of the individual is displayed on the right display 1000b.
[0157] In some embodiments, the display of the representation of individual 1032 is dynamic, while the visual characteristic 1012b is static. For example, the display of the representation of individual 1032 may simulate the movement and / or behavior of the first individual, while the visual characteristic 1012b is displayed as a purely static color. In some embodiments, the right display 1000b stops displaying the representation of individual 1032 when it is determined that the first individual is no longer located in a predetermined area or zone of the right display 1000b. In some embodiments, the right display 1000b does not display the representation of individual 1032 when the system is in motion.
[0158] It should be noted that, Figure 10E At this point, the left display 1000a does not show an indication that the first body has been detected in the physical environment. Because the first body is determined to be within a predetermined area (e.g., orientation) of the right display 1000b (e.g., not the left display 1000a), the right display 1000b shows an indication of the first body, while the left display 1000a does not.
[0159] The right display 1000b simultaneously shows indications of the status and indications of objects detected in the physical environment. More specifically, such as... Figure 10EAs illustrated, the right display 1000b displays a representation of individual 1032 (e.g., for an individual within a predetermined area) in an inner region 1010b, while a portion of visual feature 1012b continues to be displayed in the inner region 1010b. The display of the representation of individual 1032 does not overlap with the display of visual feature 1012b (e.g., visual feature 1012b and the representation of individual 1032 are displayed on different non-overlapping portions of the inner region 1010b). In some embodiments, the representation of individual 1032 has the same color (or brightness) as visual feature 1012b. In some embodiments, the representation of individual 1032 is displayed at the location where visual feature 1012b was previously included (e.g., as shown in the image). Figure 10B exemplified).
[0160] exist Figure 10E At this point, it is determined that the first body has moved outside the predetermined area of the right display 1000b and within the predetermined area of the left display 1000a. Furthermore, in Figure 10E At this point, the second body is determined to move within a predetermined area on the right display 1000b. Figure 10E At this point, it was determined that the second individual was a child. Finally, in Figure 10E In the middle, it is determined that the system will turn right.
[0161] The left display 1000a and the right display 1000b can work in conjunction to display an indication of a detected object as the object moves between a predetermined area on the left display 1000a and a predetermined area on the right display 1000b. Figure 10F Since it is determined that the first individual has moved outside the predetermined area of the right display 1000b and into the predetermined area of the left display 1000a, the right display 1000b stops displaying the representation of individual 1032, and the left display 1000a displays the representation of individual 1032. Similar to the right display 1000b, the left display 1000a does not update the display of the outer area 1020a based on the detection of the first individual within the predetermined area of the left display 1000a. In some embodiments, even if the subject is within the predetermined area of the left display 1000a, the left display 1000a does not display the visual representation of the subject who is not an individual (and / or animal). Therefore, in some embodiments, the left display 1000a displays the representations of some subjects within the physical environment, but not the representations of other subjects within the physical environment. In some embodiments, when the system is in motion and / or has been determined to move within the initialization time, the left display 1000a and / or the right display 1000b do not display the representation of the subject.
[0162] exist Figure 10FSince the second body 1040b is determined to have moved within a predetermined area of the right display 1000b, the right display 1000b displays a representation of body 1034. As explained above, the indication of an object can have an appearance based on the detected appearance of the object. Figure 10F Since the second individual was detected as a child, the appearance of individual 1034 corresponds to the appearance of a child.
[0163] Additionally, because it is determined that the system is turning right, the right display 1000b displays visual feature 1080b within the outer area 1020b. Therefore, as... Figure 10FAs illustrated, the right display 1000b simultaneously displays representations of visual characteristics 1020b, visual characteristics 1012b, and individual 1032. In some embodiments, predetermined regions (e.g., those of the left display 1000a and / or the right display 1000b) are continuous regions. The predetermined region of the left display 1000a may include a continuous region without any holes, gaps, or other interruptions to continuity. For example, the predetermined regions of the left display 1000a and the right display 1000b may be continuous regions with redundancy (and / or overlap) between them. In such examples, during the entire movement from one predetermined region (e.g., the left display 1000a) to another predetermined region (e.g., the right display 1000b), an object moving from that predetermined region to that other predetermined region may be visually represented in one or both of the left display 1000a and the right display 1000b. In some implementations, the predetermined regions (e.g., those of the left display 1000a and / or the right display 1000b) are not continuous regions. For example, the predetermined region of the left display 1000a may include a sparse region, where certain portions of the region are not represented in the left display 1000a. As another example, the region between the predetermined region of the left display 1000a and the predetermined region of the right display 1000b may not be represented in either the left display 1000a or the right display 1000b. In such examples, during the entire movement from one predetermined region (e.g., the left display 1000a) to another predetermined region (e.g., the right display 1000b), the object moving from that predetermined region to that other predetermined region may not be visually represented in either the left display 1000a or the right display 1000b. In some implementations, whether the predetermined regions are continuous depends on the distance of the object from the system (e.g., the predetermined regions of the left display 1000a and / or the right display 1000b may have a tapered shape that increases in distance from the system). For example, as an object gets closer to the system, the predetermined regions overlap less, such that when the object is in a specific region between a predetermined region on the left display 1000a and a predetermined region on the right display 1000b, the object cannot be represented on either the left display 1000a or the right display 1000b. In such examples, when the object is at least a certain distance from the system, the predetermined regions can overlap, such that when the object moves from a predetermined region on the left display 1000a to a predetermined region on the right display 1000b, the object is represented on at least one of the left display 1000a and the right display 1000b.
[0164] Although accessibility characteristics have already been described above. Figures 10A to 10F However, it should be understood that the techniques described above can be used in one or more other applications. For example, interior regions 1010a and 1010b may each be headlights on a mobile system (e.g., a vehicle, boat, bicycle, truck, and / or lorry) that will display information based on the movement of the mobile system using one or more of the techniques described herein via interior regions 1010a and 1010b. Figures 10A to 10F User interface.
[0165] The foregoing is merely illustrative and various modifications can be made to the described implementation scheme. The foregoing implementation scheme can be implemented individually or in any combination.
[0166] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to indicate the detection of objects in a physical environment. Some features of the exemplary mobile system described below may optionally be combined, modified, and / or omitted.
[0167] As described below, the exemplary mobile system provides an intuitive way to indicate the detection of objects in the physical environment. The exemplary mobile system described below increases the safety of the operation of the mobile system. For battery-powered mobile systems, indicating the detection of objects in the physical environment in a faster and more efficient manner saves power and increases the time interval between battery charging.
[0168] In some embodiments, the mobile system (e.g., 10) includes an outer surface (e.g., 18) that at least partially surrounds the interior (e.g., 11). In some embodiments, the outer surface completely surrounds the interior. In some embodiments, the outer surface does not completely surround the interior.
[0169] In some embodiments, the mobile system (e.g., 10) includes one or more sensors (e.g., telephoto cameras, wide-angle cameras, ultra-wide-angle cameras, temperature sensors, lidar sensors, radar sensors, and / or motion sensors) configured to detect signals corresponding to the environment (e.g., 13) outside (e.g., outside, near, and / or at a distance from) the outer surface (e.g., 18) of the mobile system (e.g., the environment wholly and / or partially surrounds the mobile system and / or covers the mobile system), which corresponds to (e.g., associated with, indicating, and / or used to determine) the proximity of an object (e.g., an individual, animal, and / or a static object (e.g., a tree, fence, and / or fire hydrant)) relative to the mobile system (e.g., relative to the outer surface of the mobile system and / or relative to one or more sensors). In some embodiments, one or more sensors are attached to the outer surface. In some embodiments, one or more sensors are within the outer surface. In some embodiments, one or more sensors are included internally. In some embodiments, one or more sensors are not included internally. In some embodiments, the signals are used to determine the position and / or orientation of an object. In some implementations, the signal is used to determine the distance of the object from the moving system.
[0170] In some embodiments, the mobile system (e.g., 10) includes a display (e.g., 1000a and / or 1000b) (e.g., display generating components (e.g., projector, display screen, and / or touch-sensitive display), the display being positioned on an outer surface (e.g., 18) of the mobile system (e.g., 10) (e.g., attached to the outer surface, located on the outer surface, and / or presenting content in a direction away from the outer surface) (e.g., positioned on one or more portions of the outer surface and / or the display spanning a large portion of the outer surface), and the display being configured to display a representation of an object (e.g., 1032 and / or 1034) (e.g., based on a. determining that one or more signals detected via the one or more sensors correspond to an object and / or the object is near the mobile system), the display being obscured from the interior (e.g., 11) (e.g., at least partially obscured) such that the representation of the object is not visible from a first position (and / or one or more positions) within the interior. In some embodiments, the display is configured to show a representation of an object in appearance corresponding to one or more characteristics of the object (e.g., speed, movement size, and / or shape). In some embodiments, the representation of the object is displayed on one or more displays. In some embodiments, the display is configured to show a representation of the object in appearance based on the state of the mobile system (e.g., the mobile system is about to stop, the mobile system has stopped, and / or the mobile system is accelerating). In some embodiments, the display is configured to display a representation of the object when one or more criteria are met (e.g., the object is within the field of view of one or more cameras of the mobile system, the brightness level of the physical environment is below a threshold amount, and / or the distance between the mobile system and the object is below a distance threshold). By obscuring a display positioned on the outer surface of the mobile system from the interior of the mobile system, this display is configured to show a representation of an object near the mobile system. This provides a subject outside the mobile system with information about what the mobile system is detecting, thereby providing improved visual feedback and enhancing the safety of the operation of the mobile system.
[0171] In some embodiments, the outer surface (e.g., 18) includes a first end (e.g., an end corresponding to 12 or 14) (e.g., the front, rear, or side portion of the outer surface) and a second end different from the first end (e.g., an end corresponding to 12 or 14) (e.g., the front, rear, or side portion of the outer surface). In some embodiments, the first end is positioned at a first location on a longitudinal axis (e.g., 22) of the moving system (e.g., 10) (e.g., an axis spanning the length of the moving system). In some embodiments, the second end is positioned at a second location on the longitudinal axis of the moving system. In some embodiments, the first and second locations are on opposite sides of a transverse axis (e.g., 20) of the moving system (e.g., an axis spanning the width of the moving system). In some embodiments, a display (e.g., 1000a and / or 1000b) is positioned on the first end of the outer surface (and / or not on the second end of the outer surface). In some embodiments, a display is positioned on both the first and second ends of the outer surface. In some embodiments, the display is located on a first portion of the first end and a second portion of the first end (e.g., a portion different from and / or dissimilar to the first portion). In some embodiments, multiple displays, including the display, are located on the first end of the outer surface. In some embodiments, the display is on the front portion of the outer surface. In some embodiments, the mobile system is configured to move in a first direction corresponding to the first end of the outer surface (e.g., when in a first mode (e.g., moving forward)). In some embodiments, the mobile system is configured to move in a second direction (e.g., different from the first direction) corresponding to the second end of the outer surface (e.g., when in a second mode different from the first mode (e.g., moving backward)). Positioning the display on the first end of the outer surface of the mobile system provides visual feedback to the subject in the main direction of travel of the mobile system regarding the state of the mobile system and / or the state of the environment, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0172] In some implementations, the display (e.g., 1000a and / or 1000b) is configured to display representations of a first type of object (e.g., 1032 and / or 1034) (e.g., movable objects (e.g., individuals and / or animals) and / or living objects) (e.g., objects of the first type that are determined to be in a first orientation relative to one or more sensors and / or mobile systems and / or objects of the first type that are within a predefined distance from one or more sensors and / or mobile systems) and is not configured to display representations of a second type of object different from the first type (e.g., immovable objects (e.g., rocks, traffic signs, buildings and / or trees) and / or inanimate objects) (e.g., objects of the second type that are determined to be in a second orientation relative to one or more sensors and / or mobile systems (e.g., different from the first orientation)) (e.g., objects of the second type that are determined to be outside a predefined distance from one or more sensors and / or mobile systems) (e.g., objects of the second type that are determined to be in a second orientation relative to one or more sensors and / or mobile systems) (e.g., objects of the second type that are determined to be within a predefined distance from one or more sensors and / or mobile systems). In some embodiments, the display is configured to show representations of both a first type of object and a second type of object. In some embodiments, the display is configured to show a representation of the second type of object and not to show a representation of the first type of object. Configuring the display to show the first type of object, rather than the second type, provides information to a subject outside the mobile system about what the mobile system is detecting, while limiting such information to a specific type of object, thereby providing improved visual feedback and enhancing the safety of the mobile system's operation.
[0173] In some embodiments, the mobile system (e.g., 10) has a first operating state (e.g., powered on, performing one or more operations and / or configured to perform one or more operations), a second operating state (e.g., powered on, performing one or more operations and / or configured to perform one or more operations), and a non-operating state (e.g., powered off, not configured to perform one or more operations and / or in a lower state (e.g., lower than the first operating state and / or the second operating state and / or powered off)) (and / or one or more other operating states) (and / or one or more other states). In some embodiments, the non-operating state differs from the second operating state and the first operating state. In some embodiments, the second operating state differs from the first operating state. In some embodiments, the first operating state corresponds to (e.g., is, includes, and / or is associated with) the mobile state (e.g., the mobile system is configured to move when the mobile system is in the first operating state). In some embodiments, when in the first operating state and / or simultaneously, the mobile system is moving and / or has been determined to move within a predetermined time period. In some embodiments, the mobile system changes to the first operating state in response to determining that the mobile system will move within the predetermined time period. In some embodiments, the second operating state corresponds to (e.g., is, includes, and / or is associated with) a non-moving state (e.g., the mobility system and / or a portion of the mobility system are configured to not move while in the second operating state and / or simultaneously for a predetermined time period (e.g., the mobility system is in a corresponding gear (e.g., parking gear) and / or the mobility system's brakes are applied (e.g., by a user and / or by the mobility system) to one or more sets of wheels). In some embodiments, when in the second operating state and / or simultaneously, the mobility system does not move and / or has been determined not to move for a predetermined time period. In some embodiments, the mobility system changes to the second operating state in response to determining that the mobility system will not move for the predetermined time period. In some embodiments, when the mobility system is in a non-operating state... In some embodiments, the mobile system is inoperable (e.g., the mobile system is powered off and / or the mobile system's battery life is below a power threshold) (e.g., and / or configured not to move). In some embodiments, one or more sensors are not configured to detect signals corresponding to the environment when in the non-operating state, the first operating state, and / or the second operating state. In some embodiments, one or more sensors are configured to detect signals corresponding to the environment when in the non-operating state, the first operating state, and / or the second operating state. In some embodiments, the mobile system does not move when in the non-operating state. In some embodiments, the mobile system has not and / or has not performed any operation to move the mobile system when in the non-operating state. In some embodiments, the display is off and / or inactive in the non-operating state.In some embodiments, the display is on and / or active in the non-operating state. In some embodiments, the display is on and / or active in a first operating state and / or a second operating state. In some embodiments, the display is off and / or inactive in the first operating state and / or the second operating state. A mobile system having two operating states and one non-operating state allows the mobile system to configure the display and sensors differently depending on how the mobile system operates, thereby providing improved visual feedback and enhancing the safety of mobile system operation.
[0174] In some embodiments, the display (e.g., 1000a and / or 1000b) is configured to display a representation of the object (e.g., 1032 and / or 1034) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system (e.g., 10) has transitioned from a first operating state to a second operating state (and / or when, in, and / or in response to the mobile system transitioning from the first operating state to the second operating state). In some embodiments, the display is configured not to display a representation of the object based on a determination that the mobile system has transitioned from the second operating state to the first operating state. In some embodiments, the display is configured to display a representation of the object when the mobile system is in the second operating state but not in the first operating state and / or a non-operating state. In some embodiments, the display is not configured to display a representation of the object when the mobile system is in the first operating state and / or a non-operating state. In some embodiments, the display is configured not to display a representation of the object when the mobile system is in the first operating state and / or a non-operating state. In some implementations, a transition from a first operating state to a second operating state causes the mobile system to configure the display to show a representation of an object detected by one or more sensors. In some implementations, a transition from a second operating state to a first operating state causes the mobile system to configure the display to no longer show a representation of an object detected by one or more sensors. A display having a representation of an object configured to automatically display when a set of predetermined conditions is met allows the mobile system to configure the display to perform a display operation indicating the current operating state of the mobile system, thereby performing the operation when a set of conditions has been met without requiring further user input.
[0175] In some implementations, the first position corresponds to a seating position within the interior (e.g., 11) (e.g., on the floor of the mobile system or on a chair, bench, and / or seat within the mobile system) (e.g., the seating position of a user, person, and / or subject) (e.g., as described above regarding...). Figure 10A(As discussed). In some implementations, the representation of the object is not visible from any location within the interior. The display being invisible to the subject in their seated position within the interior avoids the display becoming an interference with the subject, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0176] In some embodiments, the representation of the object (e.g., 1032 and / or 1034) is visible from the external environment (e.g., 13) of the mobile system (e.g., 10) to the outer surface (e.g., 18) (e.g., an internal / external and / or external location) (e.g., not from an internal / internal location) (e.g., substantially only visible, sometimes visible, only visible, and / or almost only visible). In some embodiments, the representation of the object is visible from multiple locations within the environment. In some embodiments, the representation of the object is not visible from one and / or any location within the internal environment. The visibility of the display to the subject outside the outer surface of the mobile system allows the display to inform the subject what the mobile system is detecting, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0177] In some implementations, when a display (e.g., 1000a and / or 1000b) is configured to display a representation of an object (e.g., 1032 and / or 1034) and the object is determined (e.g., by a mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) to have a first set of characteristics (e.g., object size, color, movement speed, distance from the mobile system, and / or shape), the display is configured to display the representation of the object with the first set of visual characteristics (e.g., the size, color, shape, movement on the display, display speed of the object representation) (e.g., the first set of visual characteristics is based on and / or corresponds to the first set of characteristics). Figure 10E (Discussed in the context of the above). In some embodiments, when a display (e.g., 1000a and / or 1000b) is configured to display a representation of an object (e.g., 1032 and / or 1034) based on a second set of characteristics (e.g., size, color, speed of movement, distance from the mobile system, and / or shape of the object) that differ from a first set of characteristics (e.g., a different number of characteristics, different size, different shape, and / or different color), the display is configured to display a representation of the object with a second set of visual characteristics (e.g., size, color, speed of movement, distance from the mobile system, and / or shape of the object) that differ from a first set of characteristics (e.g., different number of characteristics, different size, different shape, and / or different color). (e.g., the second set of visual characteristics corresponds to and / or is based on the second set of characteristics). Figure 10E(Discussed in the context of this document). In some embodiments, the display is configured to show a first representation of a first object using a first set of visual characteristics, and a second representation of a second object using a second set of visual characteristics. In some embodiments, the display is configured to show a representation of an object using the first set of visual characteristics before or after the display shows a representation using the second set of visual characteristics. Configuring the display to show a representation of an object using a corresponding set of visual characteristics based on the characteristics of the object when a set of predetermined conditions is met automatically allows the mobile system to selectively configure the display based on one or more characteristics of the object, thereby performing operations when a set of conditions is met without requiring further user input.
[0178] In some implementations, (e.g., when the mobile system is not moving or is moving) the display (e.g., 1000a and / or 1000b) is configured to display a first indication (e.g., 1012a and / or 1012b) of whether (and / or) the mobile system (e.g., 10) will be in a mobile state (and / or is moving) for a first predetermined amount of time (e.g., 1 second to 30 seconds) (e.g., a determination made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) (e.g., animation of graphic indication and / or animation of text indication) (e.g., the mobile system will transition from a mobile state to a non-mobile state or the mobile system will remain in a non-mobile state). In some embodiments, the display stops displaying a first indication based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system will not be in a mobile state for a predetermined amount of time (e.g., 1 second to 30 seconds). In some embodiments, the display stops displaying a first indication based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system will be in a mobile state for a predetermined amount of time (e.g., 1 second to 30 seconds). In some embodiments, the display is simultaneously configured to display an indication that the mobile system will not be in a mobile state for the first predetermined amount of time and a representation of an object. In some embodiments, the display is simultaneously configured to display a first indication and a representation of an object. Configuring the display to display an indication that the mobile system will move within a predetermined amount of time provides visual feedback to a subject external to the mobile system regarding how long the mobile system will remain in a non-mobile state, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0179] In some embodiments, (e.g., when the mobile system is not moving or is moving) a display (e.g., 1000a and / or 1000b) is configured to display a representation of an object (e.g., 1032 and / or 1034) and a second indication (e.g., 1012a and / or 1012b) (e.g., animation of a graphic indication and / or animation of a text indication) that the mobile system (e.g., 10) will not be in a moving state for a second predetermined amount of time (e.g., 1 second to 30 seconds) is determined (e.g., by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system). In some embodiments, the display stops being configured to display the second indication based on the determination that the mobile system will be in a moving state for a predetermined amount of time. Configuring the display to display an indication that the mobile system will not move for a predetermined amount of time provides a subject outside the mobile system with visual feedback about when the mobile system will transition from a moving state to a non-moving state, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0180] In some implementations, when a display (e.g., 1000a and / or 1000b) is configured to display a representation of an object (e.g., 1032 and / or 1034) and based on determining that the object is a first type of object (e.g., a living object (e.g., an individual or animal) or an inanimate object (e.g., a vehicle, tree, building, traffic sign, and / or traffic light)) (and / or the object is a first subject), the display is configured to display the representation as a first type of representation (e.g., the object has a specific color, size, shape, and / or positional orientation on the display) (and / or has a first visual appearance) (e.g., as described above regarding Figures 10E to 10F (As described). In some embodiments, the first type of representation and / or the first visual appearance differs from the appearance of the object. In some embodiments, when a display (e.g., 1000a and / or 1000b) is configured to display a representation of an object (e.g., 1032 and / or 1034) and based on the determination that the object is different from the first type of object (e.g., different size, different weight, different color, different brand, different model, and / or different species) of a second type of object (e.g., a living object (e.g., an individual or animal) or an inanimate object (e.g., a vehicle, tree, building, traffic sign, and / or traffic light) (and / or the object is a second subject different from the first subject), the display is configured to display a second type of representation that differs from the first type of representation (e.g., different color, size, shape, and / or positional orientation on the display) (e.g., as described above regarding...). Figures 10E to 10F(as described) (and / or have a second visual appearance different from the first visual appearance). In some embodiments, the appearance of the object representation is based on the object's appearance. In some embodiments, the second type of representation and / or the second visual appearance differs from the object's appearance.
[0181] In some embodiments, the mobile system (e.g., 10) further includes a group of one or more audio output devices (e.g., speakers, televisions, subwoofers, tweeters, horns, and / or air horns). In some embodiments, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) the group of one or more audio output devices are configured to output audio (e.g., one or more audio tones, a single discrete tone, a continuous tone, and / or a repetitive tone) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is transitioning from a mobile state to a non-mobile state (e.g., the mobile system is decelerating, the mobile system is transitioning from a speed above a threshold (e.g., 1 to 25 miles per hour) to a speed below a threshold, or the mobile system will stop moving for a period of time (e.g., 1 second to 60 seconds) based on the speed of the mobile system (e.g., the rate of movement). Figure 10C (As described above) (e.g., the pitch, tone, bass, and treble of the audio depend on the speed of the mobile system). In some embodiments, based on the determination that the mobile system is transitioning from a mobile state to a non-mobile state and that the current speed of the mobile system is a first speed (and / or the current acceleration of the mobile system is a first acceleration), the group of one or more audio output devices is configured to output a first audio. In some embodiments, based on the determination that the mobile system is transitioning from a mobile state to a non-mobile state and that the current speed of the mobile system is a second speed different from the first speed (and / or the current acceleration of the mobile system is a second acceleration different from the first acceleration), the group of one or more audio output devices is configured to output a second audio different from the first audio. In some embodiments, based on the determination (e.g., by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is transitioning from a non-mobile state to a mobile state (e.g., the mobile system is accelerating, the mobile system is transitioning from traveling at a speed below a threshold to traveling at a speed above a threshold, and the mobile system will begin to move during this time period) (e.g., as described above in... Figure 10AAs described herein, the group of one or more audio devices is configured to output audio that is not based on the speed of the mobile system. In some embodiments, the group of one or more audio devices is configured to output third audio based on the determination that the mobile system is transitioning from a non-mobile state to a mobile state and that the current speed of the mobile system is a third speed (and / or the current acceleration of the mobile system is a third acceleration). In some embodiments, the group of one or more audio devices is configured to output third audio based on the determination that the mobile system is transitioning from a non-mobile state to a mobile state and that the current speed of the mobile system is a fourth speed different from the third speed (and / or the current acceleration of the mobile system is a fourth acceleration different from the third acceleration). In some embodiments, the third speed is a second speed. In some embodiments, the fourth speed is a first speed. In some embodiments, the third speed is a first speed. In some embodiments, the third speed is a first speed. In some embodiments, the fourth speed is a second speed. In some embodiments, the third acceleration is a second acceleration. In some embodiments, the fourth acceleration is a first acceleration. In some embodiments, the third acceleration is a first acceleration. In some embodiments, the fourth acceleration is a second acceleration. The group of one or more audio output devices is configured to output audio based on the speed of the mobile system when a set of predetermined conditions are met (e.g., when the mobile system is transitioning from a mobile state to a non-mobile state). This allows the mobile system to automatically provide audio output indicating the speed of the mobile system when the mobile system decelerates, thereby configuring the group of one or more audio output devices to perform operations when a set of conditions are met without requiring further user input.
[0182] In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) the mobile system (e.g., 10) is in a first state (e.g., a moving state, a non-moving state, the mobile system is accelerating, the mobile system is decelerating, and / or the mobile system is not moving) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) and the display (e.g., 1000a and / or 1000b) is configured to display a representation of the physical environment (e.g., a text representation and / or a graphical representation) (e.g., as in...). Figure 10E and Figure 10FThe environment discussed (e.g., environmental characteristics (e.g., ambient temperature, ambient noise level, ambient pollution level, ambient brightness level) and / or representations of objects in the environment) (e.g., the external state of the physical environment (e.g., outside the mobile system)). In some embodiments, based on determination (e.g., by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that the mobile system is in a second state different from the first state (e.g., a moving state, a non-moving state, the mobile system is accelerating, the mobile system is decelerating, and / or the mobile system is not moving), the display is configured not to display a representation of the physical environment (e.g., 1032 and / or 1034) (e.g., as in...). Figure 10E (The location discussed) (and / or the representation of the physical environment and / or the representation of the external state of the physical environment). Configuring the display to show a representation of the physical environment when a set of prescribed conditions is met allows the mobile system to automatically configure the display to alert the subject to the state of the mobile system (e.g., whether the mobile system is moving) when a set of conditions has been met, thereby enabling the execution of actions without further user input, providing improved visual feedback, and increasing the safety of operating the mobile system.
[0183] In some embodiments, the display (e.g., 1000a and / or 1000b) is a first display (1010a and / or 1010b). In some embodiments, the mobile system (e.g., 10) also includes a second display (1010a and / or 1010b) different from the first display. In some embodiments, the second display is positioned on an outer surface of the mobile system (e.g., 18) (e.g., attached to the outer surface, located on the outer surface, and / or presenting content in a direction away from the outer surface) (e.g., positioned on one or more portions of the surface and / or the display spans a large portion of the outer surface), and the display is configured to display one or more representations of one or more objects (e.g., 1032 and / or 1034) (e.g., based on a. determining that one or more signals detected via one or more sensors correspond to one or more objects and / or one or more objects are near the mobile system). In some embodiments, the second display is obscured from the interior (e.g., 11) (e.g., at least partially obscured) such that one or more representations of one or more objects are not visible from a second location (and / or one or more locations) within the interior. In some embodiments, the mobile system further includes a first illumination source (e.g., 1020a and / or 1020b) that at least partially surrounds the first display (and, in some embodiments, is not the second display). In some embodiments, the first illumination source completely surrounds the first display. In some embodiments, the mobile system further includes a second illumination source (e.g., 1020a and / or 1020b) that at least partially surrounds the second display (and, in some embodiments, is not the first display). In some embodiments, the second illumination source completely surrounds the second display. In some embodiments, the second illumination source is different from (and / or independent of) the first illumination source. In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) a first illumination source, but not a second illumination source, is active (and / or is emitting illumination) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is performing a first operation (e.g., signaling a change in the mobile system's navigation (e.g., the mobile system will turn left)). (e.g., the first illumination source is active, and the second illumination source is inactive (e.g., off, inactive, and / or in a low-power state)).In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) a second illumination source, instead of the first illumination source, is active (and / or is outputting illumination) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is performing a third operation (e.g., signaling a change in navigation to the mobile system (e.g., the mobile system will turn right)). (e.g., the second illumination source is active, and the first illumination source is inactive (e.g., off, inactive, and / or in a low-power state)). In some implementations, a first illumination source and a second illumination source are active (and / or are outputting illumination (e.g., simultaneously and / or separately) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is performing a second operation different from the first operation (e.g., the mobile system is braking, signaling the status of the mobile system, and / or signaling the status of a user within the mobile system).
[0184] It should be noted that the details of the exemplary mobile system described above also apply in a similar manner to other exemplary mobile systems described herein. For the sake of brevity, these details will not be repeated below.
[0185] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to selectively indicate the presence of objects in a physical environment. Some features of the exemplary mobile system described below are optionally combined, modified, and / or omitted.
[0186] As described below, the exemplary mobile system provides an intuitive way to selectively indicate the presence of objects in the physical environment. The features described below increase the safety of the mobile system's operation. For battery-powered mobile systems, indicating the presence of objects in the physical environment in a faster and more efficient manner saves power and increases the time interval between battery charging sessions.
[0187] In some implementations, the mobile system (e.g., 10) includes an outer surface (e.g., 18) that at least partially surrounds the interior (e.g., 11) (e.g., the outer surface surrounds the entire interior or is smaller than the entire interior).
[0188] In some embodiments, the mobile system (e.g., 10) includes a first display (e.g., 1000a and / or 1000b) positioned on an outer surface (e.g., 18) (e.g., a display screen and / or a touch-sensitive display), which is disposed on a first side of the longitudinal centerline (e.g., 22) of the mobile system (e.g., 10) (e.g., the first display communicates with the mobile system and / or is integrated into the mobile system on the first side of the longitudinal centerline).
[0189] In some embodiments, the mobile system (e.g., 10) includes a second display (e.g., 1000a and / or 1000b) positioned on an outer surface (e.g., 18) (e.g., a display screen and / or a touch-sensitive display), the second display being disposed on a second side of the longitudinal centerline (e.g., 22) of the mobile system (e.g., 10) (e.g., the first display communicates with the mobile system and / or is integrated into the mobile system on a first side of the longitudinal centerline), the second side being opposite to the first side (e.g., the second side is on the left front side of the mobile system and the first side is on the right front side of the mobile system, or the second side is on the left side of the mobile system and the first side is on the right side of the mobile system), wherein the first A display (e.g., 1000a and / or 1000b) is configured to display a first representation (e.g., 1032 and / or 1034) of an object inside (e.g., 11) outside (e.g., the first display is configured to display the representation on a majority of the first display or on a majority smaller than the first display), wherein the first representation corresponds to the position of the object relative to a first side, and a second display is configured to display a second representation (e.g., 1032 and / or 1034) of the object (e.g., the second display is configured to display the second representation on a majority of the second display or on a majority smaller than the second display), and wherein the second representation corresponds to the position of the object relative to a second side. In some embodiments, the first and / or second displays are configured to display the first and / or second representations of the object in appearance corresponding to one or more characteristics of the object (e.g., speed, movement size, and / or shape). In some embodiments, the first and / or second representations of the object are displayed on one or more displays. In some embodiments, the first and second representations have the same appearance. In some embodiments, the first and second representations have different appearances. By configuring a first display on a first side of the longitudinal centerline of the mobile system to display a first representation of an object and a second display on a second side of the longitudinal centerline of the mobile system to display a second representation of an object, the subject is provided with visual feedback about which objects in the environment the mobile system can detect, thereby providing improved visual feedback and enhancing the safety of the operation of the mobile system.
[0190] In some embodiments, a first display (e.g., 1000a and / or 1000b) has a first field of view (e.g., 0° to 180°). In some embodiments, a second display (e.g., 1000a and / or 1000b) has a second field of view (e.g., 0° to 180°) that is different from (and / or dissimilar to) the first field of view. In some examples, the first and second fields of view at least partially overlap. In some examples, the first and second fields of view do not overlap. In some embodiments, a common object exists within the first and second fields of view. In some embodiments, no common object exists within the first and second fields of view. Having the first display have a first field of view and the second display have a second field of view different from the first field of view allows each display to correspond to a different area of the environment and allows the subject to view any display more relevant to a particular area, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0191] In some implementations, the second field of view does not overlap with the first field of view (e.g., as mentioned above regarding...). Figure 10A (As described). Non-overlapping fields of view allow the mobile system to maximize the display space while ensuring that subjects inside and outside the mobile system can correctly identify their location detected by the mobile system, thereby providing improved visual feedback and enhancing the safety of the mobile system's operation.
[0192] In some embodiments, the first display (e.g., 1000a and / or 1000b) has a third field of view (e.g., 0° to 360°). In some embodiments, the first display is configured to display a first representation (e.g., 1032 and / or 1034) when an object is within the third field of view. In some embodiments, the first display is configured not to display a first representation when an object is outside the third field of view. In some embodiments, the first display is configured to display a first representation based on determining that an object is within the third field of view rather than the field of view of a second display. Configuring the first display to automatically display a first representation when a set of predetermined conditions is met allows the mobile system to automatically configure the first display to perform a display operation that indicates to the subject which objects in the environment are within the field of view of the first display and which objects in the environment are not within the field of view of the first display, thereby performing the operation when a set of conditions has been met without requiring further user input.
[0193] In some embodiments, the second display (e.g., 1000a and / or 1000b) has a fourth field of view (e.g., 0° to 180°) (e.g., the fourth field of view is different from the third field of view). In some embodiments, the second display is configured to display a second representation when an object is within the fourth field of view. In some embodiments, the second display is configured not to display a second representation when an object is outside the fourth field of view. In some embodiments, the second display is configured to display a second representation based on determining that an object is within the fourth field of view rather than the field of view of the first display. Configuring the display to automatically display a second representation when a set of predetermined conditions is met allows the mobile system to automatically configure the second display to perform a display operation that indicates to the subject which objects in the environment are within the field of view of the second display and which objects in the environment are not within the field of view of the second display, thereby performing the operation when a set of conditions has been met without requiring further user input.
[0194] In some embodiments, the first display (e.g., 1000a and / or 1000b) has a fifth field of view (e.g., 0° to 180°). In some embodiments, the second display (e.g., 1000a and / or 1000b) has a sixth field of view (e.g., 0° to 180°) (e.g., the fifth field of view is different from and / or dissimilar to the sixth field of view). In some embodiments, the first display is configured to display a first representation (e.g., 1032 and / or 1034) when the object is positioned within the fifth field of view (e.g., and not the sixth field of view) (e.g., outside the outer surface of the mobile system and / or within the physical environment surrounding the outer surface of the mobile system) (e.g., on a first portion of the first display (e.g., the first portion of the first display corresponds to and / or is based on the position of the object)) (e.g., and the second display is configured not to display a second representation). In some embodiments, after the first display is configured to display the first representation when the object is positioned at the first location, the first display is configured to display the first representation when the object is positioned within the fifth field of view (e.g., as described above regarding...). Figure 10FThe first representation is displayed when the object is located at a second position (e.g., different from / different from the first position) within the described (e.g., and the sixth field of view) (e.g., outside the outer surface of the mobile system and / or within the physical environment surrounding the outer surface of the mobile system) (e.g., different from / different from the first position) (e.g., on the second portion of the first display (e.g., the second portion of the display is different from and / or different from the first portion of the first display)). The second representation is configured to be displayed based on determining that the object is positioned at a second position within the fifth field of view (e.g., and the sixth field of view). In some embodiments, the first display is configured to display the first representation at different portions of the first display based on the position of the object within the fifth field of view (e.g., the first representation is displayed at the portion of the first display corresponding to the position within the fifth field of view). In some embodiments, the second position is different from the first position. In some embodiments, after the first display is configured to display the first representation when the object is positioned at the second position, the first display is configured to be configured when (and / or in response to) the object, for example, being positioned outside the fifth field of view (e.g., as described above regarding...). Figure 10F The first indication is not displayed at a third position (e.g., outside the outer surface of the mobile system and / or within the physical environment surrounding the outer surface of the mobile system, as described) (and / or within the sixth field of view) (e.g., different from / dissimilar to the first and / or second positions). Configuring the first display to display the first indication when a set of predetermined conditions is met allows the mobile system to automatically configure the first display to perform a display operation that instructs the subject how the mobile system detects movement of objects within the environment relative to the mobile system, thereby performing the operation when a set of conditions has been met without requiring further user input.
[0195] In some embodiments, the first display (e.g., 1000a and / or 1000b) has a seventh field of view (e.g., 0° to 180°). In some embodiments, the second display has an eighth field of view (e.g., 0° to 180°) (e.g., the eighth field of view is different from and / or dissimilar to the seventh field of view). In some embodiments, the second display (e.g., 1000a and / or 1000b) is configured to display a second representation (e.g., 1032 and / or 1034) when an object is positioned within the eighth field of view (e.g., not the seventh field of view) (e.g., outside the outer surface of the mobile system and / or within the physical environment surrounding the outer surface of the mobile system) (e.g., on a first portion of the second display (e.g., the first portion of the second display corresponds to and / or is based on the position of the object)) (e.g., and the first display is configured not to display the first representation). In some embodiments, after the second display is configured to display the second representation when the object is positioned at the third location, the second display is configured to display the second representation when the object is positioned at the fourth location (e.g., on a second portion of the second display (e.g., different from and / or different from the first portion of the second display) within the eighth field of view (e.g., and the seventh field of view) (e.g., outside the outer surface of the mobile system and / or within the physical environment surrounding the outer surface of the mobile system) (e.g., different from / different from the third location) (e.g., on a second portion of the second display (e.g., different from and / or different from the first portion of the second display)). (For example, the first display is configured to display the first representation based on determining that the object is positioned at the fourth location within the seventh field of view (e.g., and the eighth field of view). In some embodiments, the second display is configured to display the second representation at different portions of the second display based on the position of the object within the eighth field of view (e.g., the second representation is displayed at the portion of the second display corresponding to the position within the eighth field of view). In some embodiments, the third location is different from the fourth location. In some implementations, after the second display is configured to display the second representation when the object is positioned at the fourth position, the second display is configured not to display the second representation when (and / or in response to) the object, for example, is positioned at a corresponding position n that is not within the eighth field of view (and / or within the seventh field of view) (e.g., outside the outer surface of the mobile system and / or within the physical environment surrounding the outer surface of the mobile system) (e.g., different from / dissimilar to the third and / or fourth positions) (as described above). Figure 10F (As described in the description). The second display is configured to display a second indication when a set of predetermined conditions is met, allowing the mobile system to automatically configure the second display to perform a display operation that instructs the subject how the mobile system detects movement of objects within the environment relative to the mobile system, thereby performing the operation when a set of conditions is met without requiring further user input.
[0196] In some embodiments, a first display (e.g., 1000a and / or 1000b) has a ninth field of view (e.g., 0° to 180°). In some embodiments, a second display (e.g., 1000a and / or 1000b) has a tenth field of view (e.g., 0° to 180°) (e.g., the ninth and tenth fields of view are different). In some embodiments, the first display is configured to display a first representation (e.g., 1032 and / or 1034) when an object is detected within the ninth field of view. In some embodiments, the first display is configured not to display a first representation when the object is not within the ninth field of view. In some embodiments, the second display is configured to display a second representation (e.g., 1032 and / or 1034) when the object is within the tenth field of view. In some embodiments, the second display is configured not to display a second representation when the object is not within the tenth field of view. The mobile system is configured to automatically configure the first and second displays to perform corresponding display operations when a set of predetermined conditions are met. These display operations indicate to the subject what objects the mobile system has detected in the environment, thereby performing the operation when a set of conditions are met without further user input.
[0197] In some embodiments, the object is a first type of object (e.g., a movable object and / or a living object). In some embodiments, a first display (e.g., 1000a and / or 1000b) and a second display (e.g., 1000a and / or 1000b) are configured not to display representations of a second type of object (e.g., a non-movable object and / or an inanimate object) that differs from the first type of object (e.g., 1032 and / or 1034). In some embodiments, the first and second displays are configured to display both living and inanimate objects. In some embodiments, the appearance of the representation (e.g., size, color, and / or shape) is based on the appearance of the object. Configuring the displays to display the first type of object and not the second type reduces the amount of distractions and / or content included on the displays when viewed by a subject inside or outside the mobile system, thereby providing improved visual feedback and enhancing the safety of the mobile system's operation.
[0198] In some implementations, (e.g., before, after, and / or simultaneously with the first display being configured to display a first representation of the object, and before, after, and / or simultaneously with the second display being configured to display a second representation of the object) the mobile system (e.g., 10) is in a first state (e.g., a moving state, a non-moving state, an accelerating state, and / or a decelerating state) according to a determination (e.g., made by the mobile system, a computer system within the mobile system, and / or a computer system outside the mobile system), a first portion of the first display (e.g., 1000a and / or 1000b) (e.g., smaller than the entire first display, a majority of the first display, a small portion of the first display) and a second portion of the second display (e.g., 1000a and / or 1000b) (e.g., smaller than the entire first display, a majority of the first display, a small portion of the first display) are configured to be synchronized (e.g., as described above regarding...). Figure 10A (as described above) (e.g., displaying the same graphical objects and / or displaying the same animations). In some implementations, (e.g., before, after, and / or simultaneously with the first display being configured to display a first representation of the object, and before, after, and / or simultaneously with the second display being configured to display a second representation of the object) the first portion of the first display and the second portion of the second display are configured to be out of sync (e.g., as described above regarding) the mobile system being in a second state different from the first state (e.g., a moving state, a non-moving state, an accelerating state, and / or a decelerating state) based on a determination (e.g., a determination made by the mobile system, a computer system within the mobile system, and / or a computer system outside the mobile system). Figure 10A (As described) (e.g., the first and second displays do not display the same graphic objects and / or do not display the same animations). Synchronizing portions of the first and second displays when a set of predetermined conditions is met allows the mobile system to automatically indicate to the subject whether the mobile system is in a mobile or non-mobile state, thereby performing display operations when a set of conditions is met without requiring further user input, and improving the security of the mobile system's operation.
[0199] In some embodiments, a first display (e.g., 1000a and / or 1000b) and a second display (e.g., 1000a and / or 1000b) are positioned on a common side of the lateral axis (e.g., 20) of the mobile system (e.g., 10). Positioning the first and second displays on the common side of the lateral axis of the mobile system allows the displays to cover a larger field of view in a particular direction, while also allowing such content to be displayed in different locations, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0200] In some embodiments, the first display (e.g., 1000a and / or 1000b) and the second display (e.g., 1000a and / or 1000b) are disposed on the mobile system (e.g., 10) at a first depth (e.g., 1 inch to 36 inches) from a first surface (e.g., front surface, top surface, bottom surface, rear surface, and / or side surface) of the mobile system. In some embodiments, the first display and the second display are disposed on two or more surfaces of the mobile system (e.g., as described above regarding...). Figure 10A (as described).
[0201] In some embodiments, the mobile system (e.g., 10) further includes a third display (e.g., 1000a and / or 1000b) (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the third display is configured to display the first movement intention of the mobile system (e.g., 1010a, 1010b, 1020a and / or 1020b) (e.g., determining, performing an action, and / or anticipating a direction) (e.g., the mobile system is turning and / or will turn within a predetermined amount of time (e.g., 1 second to 360 seconds). In some embodiments, the first display (e.g., 1000a and / or 1000b) and the second display (e.g., 1000a and / or 1000b) are not configured to display the movement intention of the mobile system (e.g., the first movement intention and / or different movement intentions). Having a third display configured to display the first movement intention of the mobile system allows the mobile system to provide the subject with visual feedback about the current and future movement intentions of the mobile system, thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0202] In some embodiments, the first display (e.g., 1000a and / or 1000b) and the second display (e.g., 1000a and / or 1000b) are disposed on the mobile system (e.g., 10) at a second depth (e.g., 1 inch to 36 inches) from a second surface (e.g., front surface, top surface, bottom surface, rear surface, and / or side surface) of the mobile system. In some embodiments, the third display is disposed on the mobile system at a third depth (e.g., 1 inch to 36 inches) from the second surface of the mobile system, which is different from the second depth (e.g., the third depth is greater than or less than the second depth) (e.g., as described above regarding...). Figure 10A(As described). In some embodiments, the first, second, and third displays are disposed on the mobile system at a common depth from the second surface. In some embodiments, the first, second, and third displays are disposed on a common surface of the mobile system. In some embodiments, the first display is disposed on the mobile system at a second depth from the first corresponding surface. In some embodiments, the third display is disposed on the mobile system at a third depth from the first corresponding surface. In some embodiments, the second display is disposed on the mobile system at a second depth from a second corresponding surface different from the first corresponding surface.
[0203] In some embodiments, the mobile system (e.g., 10) further includes a fourth display (e.g., 1000a and / or 1000b) (e.g., a display screen and / or a touch-sensitive display). In some embodiments, the fourth display is positioned at a fourth depth (e.g., 1 inch to 36 inches) along the longitudinal axis of the mobile system (e.g., 22) (e.g., the longitudinal axis along the centerline of the mobile system or a longitudinal axis offset from the centerline of the mobile system). In some embodiments, the first display (e.g., 1000a and / or 1000b) and the second display (e.g., 1000a and / or 1000b) are positioned at a fifth depth (e.g., 1 inch to 36 inches) along the longitudinal axis, which is different from the fourth depth (e.g., greater than or less than the fourth depth). In some embodiments, the fourth display is configured to display a third movement intention of the mobile system (e.g., determining, performing an operation, and / or the expected direction).
[0204] In some embodiments, the mobile system further includes a group of one or more lighting sources (e.g., 1020a and / or 1020b) that at least partially surround the first display (e.g., 1000a and / or 1000b). In some embodiments, based on determining that the mobile system (e.g., 10) is performing a first operation (e.g., signaling a change in the navigation direction of the mobile system (e.g., the mobile system will turn left and / or the mobile system will turn right)), a first portion (e.g., less than all, most, or a small portion) of the group of one or more lighting sources is configured to illuminate (e.g., with steady-state illumination and / or with patterned illumination) and a second portion of the group of one or more lighting sources is configured not to illuminate (e.g., as described above). Figure 10C , Figure 10D and / or Figure 10F(As described above). In some embodiments, based on the determination that the mobile system is performing a second operation different from the first operation (e.g., signaling to the mobile system that it is braking, signaling to the mobile system that its status is being monitored, and / or signaling to the user within the mobile system that their status is being monitored), the first portion of the group of one or more lighting sources and the second portion of the group of one or more lighting sources are configured to illuminate (e.g., as described above). Figure 10C , Figure 10D and / or Figure 10F (As described herein). Configuring a set of one or more lighting sources to illuminate a corresponding portion of that set of one or more lighting sources when a set of predetermined conditions is met (e.g., whether the mobile system is signaling a turn or signaling a hazard) allows the mobile system to automatically configure that set of one or more lighting sources, enabling the mobile system to indicate to the subject whether the navigation direction of the mobile system will change or whether the mobile system has detected a hazard, thereby performing an operation when a set of conditions is met without further user input, and improving the operation of the mobile system.
[0205] It should be noted that the details of the exemplary mobile system described above also apply in a similar manner to other exemplary mobile systems described herein. For the sake of brevity, these details will not be repeated below.
[0206] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to indicate the presence of an object immediately adjacent to the mobile system. Some features of the exemplary mobile system described below may optionally be combined, modified, and / or omitted.
[0207] As described below, the exemplary mobile system provides an intuitive way to selectively indicate the presence of objects immediately adjacent to the mobile system. The features described below enhance the safety of the mobile system's operation. For battery-powered mobile systems, indicating the presence of objects immediately adjacent to the mobile system in a faster and more efficient manner saves power and increases the time interval between battery charging cycles.
[0208] In some implementations, the mobile system (e.g., 10) includes an outer surface (e.g., 18) that at least partially surrounds the interior (e.g., 11) (e.g., the outer surface surrounds the entire interior or is smaller than the entire interior).
[0209] In some embodiments, the moving system includes a light source (e.g., 1020a and / or 1020b) positioned on an outer surface (e.g., 18) (e.g., a single light source (e.g., a single bulb or a single lamp) or an array of one or more light sources (e.g., an array of bulbs or an array of lamps)) (e.g., the light source is positioned on a portion (e.g., less than most) of the outer surface, or the light source is positioned on most of the outer surface), the light source (e.g., 1020a and / or 1020b) being configured to illuminate an environment (e.g., 13) outside the outer surface (e.g., 1020a and / or 1020b), and the moving system (e.g., 10) being configured to move relative to the environment (e.g., the interior) in a first direction.
[0210] In some implementations, the mobile system includes a display (e.g., 1020a and / or 1020b) positioned on an outer surface (e.g., 18) (e.g., a display screen and / or a touch-sensitive display) (e.g., positioned on most of the outer surface or / and less than most of the outer surface), the display being configured to display representations (e.g., 1032 and / or 1034) of objects detected near the outer surface (e.g., 1 foot to 24 feet) (e.g., graphical and / or textual representations), the display being occluded from the interior (e.g., 11). Configuring the display to display representations of objects detected near the outer surface provides the subject with visual feedback regarding which objects in the environment surrounding the mobile system are detected and which are not, thereby providing improved visual feedback.
[0211] In some embodiments, the display (e.g., 1000a and / or 1000b) includes one or more of the following: a light panel assembly (e.g., 28) (e.g., an assembly including multiple light-emitting components), a cover lens (e.g., a glass, ceramic, and / or polymer layer through which light emitted by one or more light sources passes), a diffuser (e.g., 34), a heat sink (e.g., 30) (e.g., a device for extracting heat from a heat source), a carrier (e.g., 31), and louvers (e.g., 36) (e.g., a series of angled holes). In some embodiments, spacers separate one or more components of the display. In some embodiments, the various elements of the display are connected via adhesives and / or fasteners (e.g., screws and / or nails).
[0212] In some embodiments, the display (e.g., 1000a and / or 1000b) is configured to display a first indication (e.g., 1012a, 1012b, 1018a and / or 1018b) of the state of the mobile system (e.g., 10) based on determining that the mobile system is in a first operating state (e.g., text and / or graphic indication). In some embodiments, the display is configured to display a second indication (e.g., 1012a, 1012b, 1018a and / or 1018b) of the state of the mobile system based on determining that the mobile system is in a second operating state different from the first operating state (e.g., text and / or graphic indication). In some embodiments, the second indication is different from the first indication. In some embodiments, the second indication includes the first indication. In some embodiments, the display is configured to show a third indication of a transition in the operating state of the mobile system based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is transitioning from a first operating state to a second operating state (e.g., the mobile system is transitioning from a non-mobile state to a mobile state, the mobile system is transitioning from moving in a first direction to moving in a second direction, and / or the mobile system is transitioning from a first speed to a second speed) (e.g., or will transition within a predetermined amount of time) (e.g., or has already transitioned within a predetermined amount of time). In some embodiments, the display is configured to display a first indication and / or a second indication simultaneously with the first indication. In some embodiments, the display is configured to display (1) the first indication or (2) one of the first indication and / or the second indication. The display is configured to show an indication of the state of the mobile system in addition to a representation of the object detected near the outer surface when a set of specified conditions are met. This allows the mobile system to automatically and selectively configure the display to indicate the current state and / or future state of the mobile system to the subject, thereby performing an operation when a set of conditions has been met without further user input.
[0213] In some embodiments, the moving system (e.g., 10) further includes a moving actuator (e.g., a shaft rotated via an engine (e.g., such as a drive shaft)). In some embodiments, the moving actuator (e.g., a pneumatic-hydraulic system, a set of springs, or an electro-hydraulic system) is configured to move the moving system (e.g., the entire moving system or a part of the moving system) in a first direction (e.g., at a first time) and a second direction perpendicular to the first direction (e.g., at a second time different from the first time) (e.g., as described above regarding...). Figure 10A(As described). In some embodiments, the motion actuator is configured to move the motion system upward in a third direction perpendicular to the first direction and opposite to the second direction. In some embodiments, the motion actuator is configured to move a first portion of the motion system in a fourth direction and a second portion of the motion system in a fifth direction.
[0214] In some embodiments, the mobile system (e.g., 10) further includes a first set of illumination sources (e.g., 1020a and / or 1020b) (e.g., one or more light sources or a single light source) (e.g., LED lamps, compact fluorescent lamps, and / or halogen lamps) that at least partially surround the display (e.g., 1000a and / or 1000b) (e.g., the entire periphery or a portion of the periphery of the display). In some embodiments, the first set of illumination sources is configured to output illumination to indicate the direction of travel (e.g., future travel) (e.g., turning left and / or right), the status of the mobile system (e.g., hazard), and / or that the mobile system is braking. The first set of illumination sources, at least partially surrounding the display, allows subjects inside or outside the mobile system to view in a general direction (e.g., towards the display) to see information from both the first set of illumination sources and the display, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0215] In some embodiments, the mobile system (e.g., 10) further includes a second set of one or more lighting sources (e.g., 1020a and / or 1020b) (e.g., one or more light sources or a single light source) (e.g., LED lamps, compact fluorescent lamps, and / or halogen lamps), which at least partially surround the display (e.g., 1000a and / or 1000b) (e.g., the entire periphery or a portion of the periphery of the display). In some embodiments, the second set of one or more lighting sources is configured to emit light at least partially around the light panel assembly (e.g., 28) (e.g., its periphery) of the display and through a cover lens (e.g., 37) of the display.
[0216] In some embodiments, when displaying a representation of an object (e.g., 1032 and / or 102), the representation is a first size based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the object is at a first distance from the mobile system (e.g., 10) (e.g., an outer surface, a sensor communicating with the mobile system, a sensor of the mobile system, and / or a part of the mobile system). In some embodiments, when displaying a representation of an object (e.g., 1032 and / or 102), the representation is a second size (e.g., smaller or larger) different from the first size based on a determination that the object is at a second distance from the mobile system. In some embodiments, after displaying a representation at the first size, the display is configured to display a representation at the second size based on a determination that the object is at the second distance from the mobile system. In some embodiments, after displaying a representation at the second size, the display is configured to display a representation at the first size based on a determination that the object is at the first distance from the mobile system. Representations with different sizes based on the distance of the object from the mobile system allow subjects inside and outside the mobile system to identify the distance of objects detected by the mobile system, thereby providing improved visual feedback and enhancing the safety of the mobile system's operation.
[0217] In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) the mobile system (e.g., 10) is in a first state (e.g., the mobile system is not moving, the mobile system is moving, the mobile system is decelerating, the mobile system is accelerating, the mobile system will transition from a non-moving state to a moving state within a predetermined amount of time (e.g., 1 second to 60 seconds) and / or the mobile system will transition from a moving state to a non-moving state within a predetermined amount of time (e.g., 1 second to 60 seconds)) based on a determination (e.g., the mobile system is not moving, the mobile system is moving, the mobile system is decelerating, the mobile system is accelerating, the mobile system will transition from a non-moving state to a moving state within a predetermined amount of time (e.g., 1 second to 60 seconds)) based on a determination (e.g., the mobile system will transition from a moving state to a non-moving ... is not moving, the mobile system is moving, the mobile system is decelerating, the mobile system is accelerating, the mobile system will transition from a non-moving state to a moving state within a predetermined amount of time (e.g., 1 second to 60 seconds) based on a determination (e.g., the mobile system will transition from a moving state to a non-moving state within a predetermined amount of time (e.g., 1 second to 60 seconds) based on a determination (e.g., the mobile system will transition from a moving state to a non-moving state) based on a determination (e.g., the mobile system will transition from a moving state to a non-moving state within a predetermined amount of In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) the display is configured to display a second light intensity (e.g., greater than or less than the first light intensity) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is in a second state different from the first state (e.g., the mobile system is not moving, the mobile system is moving, the mobile system is decelerating, the mobile system is accelerating, the mobile system will transition from a non-moving state to a moving state within a predetermined amount of time (e.g., 1 second to 60 seconds) and / or the mobile system will transition from a moving state to a non-moving state within a predetermined amount of time (e.g., 1 second to 60 seconds)). In some implementations, the display switches from being configured to display the first light intensity to being configured to display the second light intensity. Displaying different light intensities based on the state of the mobile system allows the mobile system to indicate its state to subjects both inside and outside the mobile system, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0218] In some embodiments, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system (e.g., 10) is accelerating (e.g., from a non-mobile state), the display (e.g., 1000a and / or 1000b) is configured to increase the output light intensity over time (e.g., to a maximum light intensity) (e.g., not based on the amount of acceleration (e.g., the light intensity increases at a rate not corresponding to the amount of acceleration)). In some embodiments, after the maximum light intensity is output, changes in acceleration do not affect the amount of light output by the display. In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) the mobile system is decelerating (e.g., to a stopped and / or non-moving state) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is decelerating (e.g., to a stopped and / or non-moving state), the display is configured to reduce the output light intensity over time (e.g., reduce to a minimum (e.g., non-zero) light intensity) (e.g., based on the amount of deceleration (e.g., the light intensity decreases at a rate corresponding to the amount of deceleration)). In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) the mobile system is decelerating but not stopping based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system is decelerating but not stopping, the display is configured not to reduce the output light intensity over time (e.g., maintain a maximum light intensity). Increasing the light intensity over time when the mobile system accelerates allows the mobile system to indicate the state of the mobile system to subjects inside or outside the mobile system, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0219] In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the object is a first type of object (e.g., an inanimate object (building, tree, traffic sign, traffic light) or a animate object (e.g., an individual or animal)) (and / or the object is a first subject), the display (e.g., 1000a and / or 1000b) is configured to display a representation (e.g., 1032 and / or 1034) as a first type of representation (and / or having a first visual appearance) (e.g., text representation, graphic representation, specific appearance, size, shape, and / or color). In some implementations, the first type of representation and / or the first visual appearance differs from the appearance of the object. In some implementations, (e.g., before, after, and / or simultaneously with the display being configured to display a representation of an object) based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the object is a second type of object different from a first type of object (e.g., an inanimate object (e.g., a building, tree, traffic sign, traffic light) or a animate object (e.g., an individual or animal)) (e.g., a different species, a different size, a different color, and / or a different size) (and / or the object is a second subject different from a first subject), the display is configured to display a representation as a second type of representation different from a first type of representation (e.g., a different size, a different color, a different shape, and / or a different appearance) (e.g., as described above regarding) a second type of representation. Figure 10E and Figure 10F (as described) (and / or having a second visual appearance different from the first visual appearance). In some embodiments, the second type of representation and / or the second visual appearance differs from the appearance of the object.
[0220] It should be noted that the details of the exemplary mobile system described above also apply in a similar manner to other exemplary mobile systems described herein. For the sake of brevity, these details will not be repeated below.
[0221] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to display different types of indications simultaneously. Some features of the exemplary mobile system described below may optionally be combined, modified, and / or omitted.
[0222] As described below, the exemplary mobile system provides an intuitive way to display different types of indications simultaneously. The features described below increase the safety of the mobile system's operation. For battery-powered mobile systems, displaying different types of indications in a faster and more efficient manner saves power and increases the time interval between battery charging.
[0223] In some embodiments, the mobile system includes: an outer surface (e.g., 18) that at least partially surrounds an interior (e.g., 11); a display (e.g., 1000a and / or 1000b) (e.g., a single display, a single display component, a single lighting source, a headlight, and / or a single headlight) positioned on the outer surface (e.g., 18); one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including methods for simultaneously displaying information to the mobile system (e.g., 1000a and / or 1000b) via the display (e.g., 1000a and / or 1000b). The system includes instructions (e.g., speed, acceleration, deceleration, indication of detected temperature, noise level, brightness level, and / or the number of occupants of the mobile system) on the state (e.g., internal state and / or motion state) of the mobile system (e.g., 1018a, 1018b, 1012a, and / or 1012b) and instructions (e.g., speed, acceleration, deceleration, indication of detected temperature, noise level, brightness level, and / or the number of occupants of the mobile system) and on the state of the environment outside the mobile system (e.g., 1032 and / or 1034) (e.g., objects detected in the environment (e.g., living and / or inanimate objects), ambient temperature, traffic signs detected in the environment). In some embodiments, the display of the indication of the state of the environment overlaps with the display of the state of the environment outside the mobile system. In some embodiments, the display of the indication of the state of the environment does not overlap with the display of the state of the environment outside the mobile system. In some embodiments, the display of the indication of the state of the environment occupies a first percentage of the display, and the display of the indication of the mobile system occupies a second percentage of the display that is different from the first percentage (e.g., less than and / or greater than the first percentage). In some embodiments, upon determining that the mobile system has transitioned from a mobile state to a non-mobile state or vice versa, the display stops showing indications of the state of the environment and the state of the mobile system. In some embodiments, the mobile system includes a movement (e.g., wheels, tires, pulleys, skis, and / or axles) wherein the mobile system is configured to traverse (e.g., traverse surfaces (e.g., ground, roads, paths, and / or streets) and / or through a medium such as air) an environment (e.g., the physical environment and / or the physical world) via a motion system. Simultaneously displaying indications of the state of the mobile system and the state of the environment outside the mobile system allows the mobile system to simultaneously communicate to the subject which objects are detected in the environment and the state of the mobile system, thereby providing improved visual feedback and increasing the safety of operating the mobile system (e.g., by alerting the subject how and / or whether the mobile system will move).
[0224] In some embodiments, when the mobile system (e.g., 10) is in a first state (e.g., the mobile system is not moving, the mobile system will not move for a predetermined amount of time (e.g., 1 second to 60 seconds), the mobile system is decelerating, the mobile system is moving, and / or the mobile system is accelerating), an indication of the state of the environment is displayed (e.g., 1032 and / or 1034). In some embodiments, the one or more procedures further include instructions for displaying an indication of the state of the external environment after displaying an indication of the state of the environment outside the mobile system and based on determining that the mobile system is in the first state (e.g., as described above regarding...). Figure 10E (As described above). In some embodiments, the one or more procedures further include instructions to abandon displaying the indication of the state of the environment outside the mobile system after displaying an indication of the state of the environment outside the mobile system and based on determining that the mobile system is in a second state different from the first state (e.g., the mobile system is not moving, the mobile system will not move within a predetermined amount of time (e.g., 1 second to 60 seconds), the mobile system is decelerating, the mobile system is moving, and / or the mobile system is accelerating). Figure 10E (As described). In some embodiments, based on determining that the mobile system has transitioned from a mobile state to a non-mobile state, the display of indications regarding the state of the environment is stopped. In some embodiments, stopping the display of indications regarding the state of the environment outside the mobile system includes displaying animations (e.g., fade-out animations, rotation animations, and / or animations indicating translation to one side of the display). Displaying indications regarding the state of the environment outside the mobile system when a set of predetermined conditions is met allows the mobile system to automatically indicate to the subject which objects in the environment the mobile system has detected and which objects in the environment the mobile system has not detected, thereby performing an action when a set of conditions has been met without requiring further user input.
[0225] In some embodiments, the one or more programs further include instructions for: (e.g., before, after, or simultaneously with displaying an indication of the state of the mobile system and / or an indication of the state of the environment outside the mobile system) detecting (e.g., via one or more sensors and / or one or more cameras communicating with the mobile system) a first object (e.g., an inanimate object (e.g., a building, tree, traffic sign, traffic light) or a living object (e.g., an individual or animal)) within the environment (e.g., 13) outside the mobile system (e.g., 10). In some embodiments, the one or more programs further include instructions for: in response to detecting the first object within the environment outside the mobile system and based on determining (e.g., by the mobile system, by a computer system within the mobile system, and / or by a mobile system outside the computer system) that the first object is a first type of object (e.g., a movable object (e.g., an object capable of moving on its own) or an immovable object (e.g., an object that cannot move on its own)), displaying a first representation of the first object (e.g., 1032 and / or 1034) via a display (e.g., 1000a and / or 1000b). In some implementations, the one or more procedures further include instructions for: in response to detecting a first object within an environment outside the mobile system and based on determining that the first object is a second type of object (e.g., a movable object (e.g., an object capable of moving on its own) or an immovable object (e.g., an object that cannot move on its own) different from a first type of object, abandoning the display of a first representation of the first object (e.g., as described above regarding...). Figure 10E (as described) (and / or any representation of the first object). In some embodiments, the display shows corresponding representations of both the first type of object and the second type of object. Displaying the first representation when a set of defined conditions is met allows the mobile system to automatically indicate to the subject the type of object detected by the mobile system in the environment, thereby performing an operation without further user input when a set of conditions has been met.
[0226] In some implementations, the one or more programs also include instructions for: (e.g., before, after, or simultaneously with displaying an indication of the state of the mobile system and / or an indication of the state of the environment outside the mobile system) detecting (e.g., via one or more sensors and / or one or more cameras communicating with the mobile system) a second object (e.g., an inanimate object (e.g., a building, tree, traffic sign, traffic light) or a animate object (e.g., an individual or animal)) within the environment (e.g., 13) outside the mobile system (e.g., 10). In some implementations, the one or more programs further include instructions for: in response to detecting a second object within an environment outside the mobile system and based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that the second object is a third type of object (e.g., an inanimate object (e.g., a building, a tree, a traffic sign, a traffic light) or a animate object (e.g., an individual or an animal)), displaying a representation of the second object (e.g., 1032 and / or 1034) (e.g., text representation and / or graphic representation) with a first set of visual characteristics via a display (e.g., 1000a and / or 1000b). In some embodiments, the one or more procedures further include instructions for: in response to detecting a second object within an environment outside the mobile system and based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that the object is a fourth type of object (e.g., a different kind, different size, different color, and / or different size) or a living object (e.g., an inanimate object (e.g., a building, tree, traffic sign, traffic light) or an animal (e.g., an individual or animal)) different from a third type of object, displaying a representation of the second object via a display with a second set of visual characteristics different from the first set of visual characteristics (e.g., 1032 and / or 1034). In some embodiments, the appearance of the object representation is based on the appearance of the object. In some embodiments, the display shows the second representation of the object before, after, and / or simultaneously with the display showing the first representation of the object. Displaying the representation with a corresponding set of visual characteristics when a set of predetermined conditions is met allows the mobile system to automatically perform a display operation instructing the subject on the type of object detected by the mobile system, thereby performing the operation without further user input when a set of conditions is met.
[0227] In some embodiments, the indication of the state of the mobile system (e.g., 1018a, 1018b, 1012a, and / or 1012b) corresponds to the movement of the mobile system (and may include an indication of the movement of the mobile system) (e.g., the mobile system is currently moving or will move within a predetermined amount of time (e.g., 1 second to 60 seconds)). In some embodiments, the indication of the state of the mobile system includes a representation of the movement of the mobile system (e.g., the speed of the mobile system, the acceleration of the mobile system, and / or the direction of movement of the mobile system) (e.g., textual and / or graphical representation) (e.g., static or dynamic representation (e.g., looping animation)). In some embodiments, the display stops displaying the indication of the state of the mobile system upon determining that the mobile system has stopped moving. In some embodiments, the display shows the indication of the state of the mobile system when the mobile system is moving at a speed greater than a speed threshold (e.g., 1 mph to 25 mph). Displaying indications of the state of the mobile system as it moves provides subjects with visual feedback on the state of one or more detected characteristics (e.g., velocity, acceleration, and / or deceleration) of the mobile system's movement at points in time when one or more detected characteristics are of high concern, thereby providing improved visual feedback and enhancing the safety of the mobile system's operation.
[0228] In some implementations, an indication of the state of the environment outside the mobile system (e.g., 10) based on a determination (e.g., by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the environment includes objects includes objects (e.g., 1032 and / or 1034) includes a representation (e.g., 1032 and / or 1034) of objects detected within the environment (e.g., detected via one or more sensors and / or one or more cameras communicating with the mobile system). In some implementations, based on a determination that no objects are detected within the environment, the display stops displaying indications of objects within the environment. Displaying indications of objects within the environment provides the subject with visual feedback about which objects in the environment the mobile system has detected and which objects in the environment the mobile system has not detected, thereby providing improved visual feedback and enhancing the safety of the operation of the mobile system.
[0229] In some embodiments, the object is a first type of object (e.g., the object is movable (e.g., the object is moving toward or away from the mobile system)). In some embodiments, when the representation of the object within the environment (e.g., 1032 and / or 1034) is displayed and according to a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that the object is at a first distance (e.g., 1 foot to 15 feet) from the display (e.g., 1000a and / or 1000b), the indication of the state of the environment outside the mobile system (e.g., 1032 and / or 1034) has a third set of visual characteristics (e.g., as described above regarding...). Figure 10E (as described above) (e.g., color, shape, size, brightness, and / or motion characteristics). In some embodiments, when displaying a representation of an object within the environment (e.g., 1032 and / or 1034) and based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that the object is at a second distance (e.g., 1 foot to 15 feet) different from the first distance from the display (e.g., the second distance is greater than or less than the first distance), the indication of the state of the environment outside the mobile system has a fourth set of visual characteristics (e.g., color, shape, size, and / or motion characteristics) different from the first set of visual characteristics (e.g., as described above regarding...). Figure 10E (As described) (e.g., different colors, different sizes, and / or different shapes). In some embodiments, the display does not show a representation of inanimate objects detected in the environment outside the mobile system. In some embodiments, the display of indications of the state of the environment outside the mobile system stops based on determining that the object is at a first distance from the display. Displaying indications with a corresponding set of visual characteristics based on the distance between the display and the object allows the mobile system to automatically perform display operations indicating the distance between the mobile system and the object, thereby performing operations without further user input when a set of conditions are met.
[0230] In some embodiments, the indication of the state of the environment outside the mobile system (e.g., 1032 and / or 1034) does not include the representation (e.g., text and / or graphic representation) of one or more second-type objects (e.g., immovable objects (e.g., buildings, sports balls, traffic signs, and / or rocks) detected in the environment (e.g., 13) (e.g., detected by the mobile system, detected by a computer system communicating with the mobile system, and / or detected by a computer system outside the mobile system). In some embodiments, the indication of the state of the environment outside the mobile system does include the indication of inanimate objects detected in the environment.
[0231] In some implementations, the display (e.g., 1000a and / or 1000b) is positioned on an outer surface (e.g., 18) such that the display is guided away from the interior (e.g., 11).
[0232] In some embodiments, indications of the state of the external environment of the mobile system (e.g., 1032 and / or 1034) are displayed on a first portion (e.g., 1010a and / or 1010b) of a display (e.g., a large portion of the display or smaller than a large portion of the display). In some embodiments, indications of the state of the mobile system (e.g., 1018a, 1018b, 1012a and / or 1012b) are displayed on a second portion of the display (e.g., 1020a and / or 1020b) different from the first portion (e.g., a large portion of the display or smaller than a large portion of the display). In some embodiments, the first portion and the second portion of the display overlap. In some embodiments, the first portion and the second portion of the display do not overlap. In some embodiments, the first portion and the second portion of the display are on opposite sides of the display. In some embodiments, the first portion occupies a larger percentage of the display than the second portion. In some embodiments, the first portion occupies half of the display. In some implementations, the first portion and the second portion of the display are different and / or dissimilar. Simultaneously displaying an indication of the state of the external environment of the mobile system on the first portion of the display and simultaneously displaying an indication of the state of the mobile system on the second portion of the display provides the subject with visual feedback regarding the state of one or more characteristics of the environment (e.g., detected by the mobile system) and the state of one or more characteristics of the mobile system (e.g., detected by the mobile system), thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0233] In some embodiments, the one or more programs further include instructions for displaying an indication of the state of the mobile system (e.g., 1018a, 1018b, 1012a, and / or 1012b) on a first portion (e.g., 1010a and / or 1010b) and a second portion (e.g., 1020a and / or 1020b) of the display before displaying an indication of the state of the environment outside the mobile system (e.g., 1032 and / or 1034). In some embodiments, the first portion and the second portion of the display occupy the entire display. In some embodiments, the first portion and the second portion of the display are less than the entire display. In some embodiments, when displaying an indication of the state of the environment outside the mobile system, the mobile system displays the indication of the state of the environment outside the mobile system on the first portion of the display and displays the indication of the state of the mobile system on the second portion of the display. Displaying indications of the state of the mobile system on the first and second portions of the display provides the subject with visual feedback on the state of one or more detected characteristics of the mobile system, thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0234] In some embodiments, the one or more programs further include instructions for: (e.g., when an indication of the state of the mobile system is displayed on a first portion and a second portion of the display) to abandon the display of an indication of the state of the environment outside the mobile system (e.g., 1032 and / or 1034) on a second portion (e.g., 1020a and / or 1020b) of the display (e.g., 1000a and / or 1000b). In some embodiments, the second portion of the display does not include an indication of the state of the environment.
[0235] In some embodiments, the indications of the state of the mobile system (e.g., 1018a, 1018b, 1012a, and / or 1012b) are static indications (e.g., the display does not animate the indications of the state of the mobile system and / or the display does not show the indications of the state of the mobile system as being in motion). In some embodiments, the indications of the state of the environment outside the mobile system (e.g., 1032 and / or 1034) are dynamic (e.g., non-static) indications (e.g., the display animates the indications of the environment outside the mobile system and / or the display shows the indications of the environment outside the mobile system as being in motion). Displaying the indications of the state of the environment outside the mobile system as dynamic indications provides the subject with real-time visual feedback on the real-time detected changes in the state of the environment, thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0236] In some embodiments, the appearance of the indication of the state of the environment outside the mobile system (e.g., 1032 and / or 1034) includes at least one color (e.g., the color corresponding to the temperature, brightness, and / or noise of the environment inside the mobile system) included in the indication of the state of the mobile system (e.g., 1018a, 1018b, 1012a, and / or 1012b). In some embodiments, the color is dynamic and changes based on changes in the state of the mobile system. Displaying the indication of the state of the environment outside the mobile system in at least one color corresponding to the state of the mobile system provides the subject with visual feedback on the current state of one or more detected characteristics of the mobile system (e.g., temperature, speed, acceleration, deceleration, noise, and / or brightness), thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0237] In some embodiments, the mobile system further includes a group of one or more light sources (e.g., 1020a and / or 1020b) that at least partially surround the display (e.g., 1000a and / or 1000b). In some embodiments, the one or more programs further include instructions for: (e.g., when the display indicates the state of the mobile system and the state of the environment outside the mobile system) illuminating a first portion (e.g., less than all, most, or a small portion) of the group of one or more light sources (e.g., illuminating in steady state and / or illuminating in a pattern) without illuminating a second portion of the group of one or more light sources (e.g., as described above regarding...) based on determining that the mobile system (e.g., 10) is performing a first operation (e.g., signaling a change in the direction of the mobile system (the mobile system will turn left, the mobile system will turn right, and / or the mobile system has detected a hazard) (e.g., less than all, most, or a small portion). Figure 10C and Figure 10F As described above); and based on determining that the mobile system is performing a second operation different from the first operation (e.g., signaling that the direction of the mobile system will change (the mobile system will turn left and / or the mobile system will turn right), signaling the status of the mobile system, signaling the status of the users within the mobile system), illuminating the second portion of the group of one or more lighting sources without illuminating the first portion of the group of one or more lighting sources (e.g., as described above regarding Figure 10C and Figure 10F (As described). Based on what operation the mobile system is performing to illuminate a corresponding part of a set of one or more lighting sources, the mobile system can automatically indicate its current state to the subject, thereby performing an operation when a set of conditions has been met without further user input, and increasing the security of the mobile system's operation.
[0238] It should be noted that the details of the exemplary mobile system described above also apply in a similar manner to other exemplary mobile systems described herein. For the sake of brevity, these details will not be repeated below.
[0239] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to indicate movement. Some features of the exemplary mobile system described below may optionally be combined, modified, and / or omitted.
[0240] As described below, the exemplary mobile system provides an intuitive way to indicate the movement of the mobile system. The features described below increase the safety of the mobile system's operation. For battery-powered mobile systems, indicating the movement of the mobile system in a faster and more efficient manner saves power and increases the time interval between battery charging.
[0241] In some embodiments, a mobile system includes: an outer surface (e.g., 18) at least partially surrounding an interior (e.g., 11); a first display (e.g., 1010a and / or 1010b) positioned on the outer surface (e.g., 18) (e.g., a single display, a single display component, a single illumination source, a headlight, and / or a single headlight); a first illumination source (1020a and / or 1020b) at least partially surrounding the first display (e.g., 1010a and / or 1010b); one or more processors; and storage configured to be processed by one or more processors. The memory of one or more programs executed by the device, the one or more programs including instructions for: when the first display (e.g., 1010a and / or 1010b) and the first lighting source (1020a and / or 1020b) are active (e.g., the first display and the first lighting source are powered on and / or the first display and the first lighting source are displaying a corresponding user interface object and / or a corresponding user interface), (e.g., via one or more cameras and / or via one or more sensors communicating with the mobile system) detecting outside the mobile system (e.g., 10). The movement of objects (e.g., living objects (e.g., individuals and / or animals) or inanimate objects (e.g., buildings, traffic signs, sports balls, rocks, and / or billboards)) in the environment (e.g., 13) of the mobile system; in response to detecting movement of objects in the environment outside the mobile system (e.g., 10), based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that the object has moved in a first direction (e.g., the first object moves relative to the mobile system toward the mobile system, away from the mobile system, to the left of the mobile system, and / or to the right of the mobile system), the first display (e.g., 1010a and / or 1010b) is updated based on the movement of the object in the first direction (e.g., brightness, display of the corresponding user interface object (e.g., movement of the corresponding user interface object, size of the corresponding user interface object, shape of the corresponding user interface object, and / or color of the corresponding user interface object) and / or color of the first display), without updating the first lighting source (1020a and / or 1020b) based on the movement of the object (e.g., as described above regarding the movement of the object). Figure 10E and Figure 10FAs described above); and based on a determination (e.g., made by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) that an object moves in a second direction different from the first direction (e.g., the first direction is opposite to the second direction, or the first and second directions have similar first direction components and different second direction components (e.g., the first direction is away from the mobile system and towards the left side of the mobile system and the right direction is away from the mobile system and towards the right side of the mobile system, or the first direction is towards the mobile system and towards the right side of the mobile system and the second direction is towards the mobile system and towards the left side of the mobile system)), the first display (e.g., 1010a and / or 1010b) is updated based on the object's movement in the second direction (e.g., brightness, display of the corresponding user interface object (e.g., movement of the corresponding user interface object, size of the corresponding user interface object, shape of the corresponding user interface object, and / or color of the corresponding user interface object) and / or color of the first display), without updating the first lighting source (1020a and / or 1020b) based on the object's movement (e.g., as described above regarding the object's movement). Figure 10E and Figure 10F (As described). In some embodiments, the mobility system includes a motion system (e.g., wheels, tires, pulleys, skis, and / or axles), wherein the mobility system is configured to traverse (e.g., traverse surfaces (e.g., ground, roads, paths, and / or streets) and / or through a medium such as air) the environment via the motion system. Updating the first display based on the detected direction of movement of the detected objects provides the subject with visual feedback about which objects in the environment the mobility system has detected are moving and in the direction the mobile system has detected the objects moving, thereby providing improved visual feedback. When a set of prescribed conditions is met, updating the first display in a specific manner based on the detected direction of movement of objects within the environment automatically allows the mobility system to perform a display operation that alerts the subject to the direction of movement of one or more objects detected by the mobility system, thereby performing the operation when a set of conditions has been met without requiring further user input.
[0242] In some embodiments, the one or more programs further include instructions for: displaying a first set of content (e.g., 1012a and / or 1012b) (e.g., one or more user interface objects, a representation of the state of the mobile system, a representation of one or more objects in the environment, and / or a corresponding user interface) via the first display while the first display (e.g., 1010a and / or 1010b) and the first lighting source (1020a and / or 1020b) are active, and displaying a second set of content (e.g., 1018a and / or 1018b) (e.g., one or more user interface objects, a representation of the state of the mobile system, a representation of one or more objects in the environment, and / or a corresponding user interface) via the first lighting source. In some embodiments, the first set of content and the second set of content are different. In some embodiments, the first set of content and the second set of content are the same. In some embodiments, the appearance of the first set of content and / or the second set of content is based on one or more detected objects in the environment. Displaying a first set of content and a second set of content when a set of specified conditions are met (e.g., the first display and the first lighting source are active) allows the mobile system to automatically perform display operations that instruct the subject on the status of the mobile system, thereby performing operations when a set of conditions are met without requiring further user input and providing improved visual feedback.
[0243] In some embodiments, the mobile system (e.g., 10) further includes a second display (1010a and / or 1010b) positioned on an outer surface (e.g., 18) (e.g., the second display is the same type of display as the first display, or the second display and the first display are different types of displays) and a second lighting source (e.g., 1020a and / or 1020b) at least partially surrounding the second display (e.g., a single lighting source or an array of lighting sources). In some embodiments, the second display is different from the first display (e.g., 1010a and / or 1010b). In some embodiments, the second lighting source is different from the first lighting source (1020a and / or 1020b). In some embodiments, the one or more programs further include instructions for: when the second display and the second illumination source are active and in response to the detection (e.g., via one or more sensors and / or one or more cameras communicating with the mobile system) of movement of an object in the environment, updating the second display based on the detected movement of the object in the environment (e.g., the second display displays a user interface object simulating the movement of the object in the environment, the second display updates the size of the user interface object corresponding to the movement of the object (e.g., if the object moves toward the mobile system, the second display increases the size of the user interface object, or if the object moves away from the mobile system, the second display decreases the size of the user interface object), and changing the color of the user interface object based on the speed of the object's movement), without updating the second illumination source (e.g., as described above regarding...). Figure 10E and Figure 10F (As described). In some embodiments, the second display and the first display are updated simultaneously. In some embodiments, the first display is updated before or after the second display is updated. In some embodiments, the first and second displays are updated in the same manner. In some embodiments, the first and second displays are updated in different manners. Updating the second display based on the detected movement of an object in the environment in response to the detection of movement of an object in the environment provides the subject with visual feedback on how the mobile system detects objects in the environment as they move throughout the environment, thereby providing improved visual feedback and enhancing the safety of the mobile system's operation.
[0244] In some embodiments, the one or more procedures further include instructions for: detecting (e.g., via one or more sensors and / or one or more cameras communicating with the mobile system) hazardous conditions (e.g., road conditions (e.g., potholes and / or objects in the road along the path of the mobile system), one or more weather conditions (e.g., excessive rain, excessive snow, fire, and / or excessive wind), the presence of individuals in the path of the mobile system, mechanical failure of the mobile system, and / or reduced power supply to the mobile system) when the first lighting source (1020a and / or 1020b) is active) (e.g., detecting hazardous conditions in the environment outside the mobile system or detecting hazardous conditions inside the mobile system). In some embodiments, the one or more procedures further include instructions for: in response to the detection of a hazardous condition, based on the detection of the hazardous condition (e.g., as described above regarding...). Figure 10D The lighting source is updated (e.g., the brightness, color, and / or display of the lighting source) in response to a detected hazard (e.g., without updating the first display). In some embodiments, updating the lighting source stops upon determining that a hazardous condition is no longer detected. In some embodiments, updating the lighting source stops upon determining that a hazardous condition is still detected. In some embodiments, updating the lighting source includes updating a portion (e.g., less than all) or all of the lighting source. Updating the lighting source in response to a detected hazardous condition allows the mobile system to indicate to the user a hazard detected in the environment by the mobile system, thereby providing improved visual feedback and increasing the safety of the mobile system's operation.
[0245] In some embodiments, a hazardous condition is detected when the first display (e.g., 1010a and / or 1010b) is active. In some embodiments, the one or more procedures further include instructions to: abandon updating the first display in response to detecting a hazardous condition. In some embodiments, the first display is updated in response to detecting a hazardous condition.
[0246] In some implementations, the one or more programs also include instructions for: detecting (e.g., via one or more sensors and / or one or more cameras in communication with the mobile system) a change in the expected direction of movement of the mobile system (e.g., 10) (e.g., the direction of movement of the mobile system will change within a predetermined amount of time (e.g., 1 second to 60 seconds), and / or the user of the mobile system performs an input that causes the direction of movement of the mobile system to change within a predetermined amount of time) (e.g., the mobile system will make a turn (e.g., a left turn or a right turn), the mobile system will change from moving in the forward direction to moving in the backward direction, or the mobile system will change from moving in the backward direction to moving in the forward direction). In some embodiments, the one or more programs further include instructions for: in response to detecting a change in the expected direction of movement of the mobile system and based on determining (e.g., by the mobile system, a computer system communicating with the mobile system, and / or a computer system outside the mobile system) the expected direction of movement of the mobile system in a first direction (e.g., the mobile system intends to turn left, turn right, cross in a forward direction, and / or cross in a backward direction), updating a first display (e.g., 1010a and / or 1010b) in a first manner (e.g., changing the color, brightness, and appearance of the display of the first display) and updating a lighting source (e.g., 1020a and / or 1020b) in a second manner (e.g., the first and second manners are the same or different) (e.g., changing the color, brightness, and appearance of the display of the lighting source). In some embodiments, the one or more procedures further include instructions for: responding to the detection of a change in the expected direction of movement of the mobile system and, based on determination (e.g., by the mobile system, a computer system communicating with the mobile system, and / or a computer system external to the mobile system) that the mobile system's direction of travel changes in a second direction different from the first direction (e.g., the mobile system intends to turn left, right, cross in a forward direction, and / or cross in a backward direction), updating the first display in a third manner different from the first manner and updating the lighting source in a fourth manner different from the second manner. In some embodiments, the first and second manners are the same. In some embodiments, the first and second manners are different. In some embodiments, the third and fourth manners are the same. In some embodiments, the third and fourth manners are different. Updating the first display and lighting source in a corresponding manner when a set of predetermined conditions is met automatically allows the mobile system to perform a display operation instructing the subject on the expected movement (e.g., future movement) of the mobile system, thereby performing the operation when a set of conditions has been met without requiring further user input and increasing the security of the operation of the mobile system.
[0247] In some implementations, the one or more procedures further include instructions for: when the mobile system (e.g., 10) is moving (e.g., the mobile system will move within a predetermined time (e.g., 1 second to 60 seconds) or the mobile system has been in a moving state for a predetermined time) (before, after, and / or simultaneously with detecting a change in the expected direction of movement of the mobile system) (e.g., via one or more sensors and / or one or more cameras communicating with the mobile system) to detect a first movement characteristic of the mobile system (the mobile system is moving in a forward direction, the mobile system is moving in a backward direction, the mobile system changes from a power-off state to a power-on state, the mobile system changes from a power-on state to a power-off state, the mobile system is moving at a corresponding speed, the mobile system is moving at a corresponding acceleration). In some embodiments, the one or more procedures further include instructions for: when the mobile system (e.g., 10) is moving, in response to detecting a first movement characteristic of the mobile system, updating a first display (e.g., 1010a and / or 1010b) based on the first movement characteristic (e.g., increasing brightness, decreasing brightness, changing the appearance of user interface objects displayed on the first display, displaying animation on the first display, stopping displaying animation on the first display, and / or stopping displaying the corresponding user interface objects), without updating the first lighting source (1020a and / or 1020b) (e.g., as described above regarding...). Figure 10B (As discussed). In response to the detection of a first movement characteristic of the mobile system, the first display is updated to provide the subject with visual feedback on how the mobile system traverses and / or will traverse the environment, thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0248] In some implementations, the one or more procedures further include instructions for: (before, after, and / or simultaneously with the detection of a change in the expected direction of movement of the mobile system) (e.g., via one or more sensors and / or one or more cameras in communication with the mobile system) (e.g., while the mobile system is moving (e.g., the mobile system will move within a predetermined time (e.g., 1 to 60 seconds) or the mobile system has been in a moving state for a predetermined time)) detecting a second movement characteristic of the mobile system (e.g., 10) (the mobile system is moving in a forward direction, the mobile system is moving in a backward direction, the mobile system changes from a power-off state to a power-on state, the mobile system changes from a power-on state to a power-off state, the mobile system is moving at a corresponding speed, the mobile system is moving at a corresponding acceleration) (e.g., the first movement characteristic and the second movement characteristic are the same or the first movement characteristic and the second movement characteristic are different). In some embodiments, the one or more procedures further include instructions for: updating a first illumination source (1020a and / or 1020b) based on the second motion characteristic of the mobile system in response to the detection of a second motion characteristic of the mobile system (e.g., increasing brightness, decreasing brightness, changing the appearance of a user interface object displayed on the first illumination source, displaying animation on the first illumination source, stopping the display of animation on the first illumination source, and / or stopping the display of the corresponding user interface object), without updating the first display (e.g., 1010a and / or 1010b). Updating the first illumination source in response to the detection of a second motion characteristic of the mobile system provides the subject with visual feedback on how the mobile system traverses and / or will traverse the environment, thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0249] It should be noted that the details of the exemplary mobile system described above also apply in a similar manner to other exemplary mobile systems described herein. For the sake of brevity, these details will not be repeated below.
[0250] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to indicate various states of the mobile system. Some features of the exemplary mobile system described below may optionally be combined, modified, and / or omitted.
[0251] As described below, the exemplary mobile system provides an intuitive way to indicate various states of the mobile system. The features described below increase the safety of the mobile system's operation. For battery-powered mobile systems, indicating the various states of the mobile system in a faster and more efficient manner saves power and increases the time interval between battery charging.
[0252] In some embodiments, the mobile system (e.g., 10) includes: an outer surface (e.g., 18) at least partially surrounding an interior (e.g., 11) (e.g., the outer surface surrounds the entire interior or is smaller than the entire interior); a display (e.g., 1000a and / or 1000b) positioned on the outer surface (e.g., 18) (e.g., a single display, a single display component, a single illumination source, a headlight, and / or a single headlight); one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for simultaneously displaying instructions on the autonomous state of the mobile system via the display (e.g., 1000a and / or 1000b). The indications (e.g., graphic and / or textual indications) (e.g., 1012a and / or 1012b) (e.g., volume level of a speaker integrated into the mobile system, brightness level of a lamp integrated into the mobile system, temperature of the mobile system, and / or speed of the mobile system) and the indications of the mobile system's (e.g., 10) intention to move (e.g., graphic and / or textual indications) (e.g., 1018a and / or 1018b) that differ from the indications of the mobile system's autonomous state (e.g., 1012a and / or 1012b) (e.g., the mobile system will accelerate within a predetermined amount of time, the mobile system will decelerate within a predetermined amount of time, the mobile system will remain in motion, the mobile system will remain stationary). In some embodiments, the indications of the mobile system's state do not overlap with the indications of the mobile system's intention to move. In some embodiments, the indications of the mobile system's state overlap with the indications of the mobile system's intention to move. Simultaneously displaying indications of the autonomous state and movement intention of the mobile system provides subjects with visual feedback on how the mobile system is controlled and how it is currently moving and / or will move, thereby providing improved visual feedback and enhancing the safety of operating the mobile system.
[0253] In some implementations, based on the determination that the mobile system (e.g., 10) is operating autonomously (e.g., the mobile system senses its environment and operates without user intervention, the mobile system navigates to a destination without user intervention, the mobile system is navigating autonomously and / or the mobile system is navigating without user input) and the mobile system is in a first movement state (e.g., the mobile system is moving or the mobile system will initiate movement within a threshold time amount (e.g., 1 second to 60 seconds), an indication of the autonomous state of the mobile system (e.g., 1018a and / or 1018b) and an indication of the movement intention of the mobile system (e.g., 1012a and / or 1012b) are displayed. When a set of prescribed conditions is met, simultaneously displaying the indication of the autonomous state of the mobile system and the indication of the movement intention of the mobile system allows the mobile system to automatically perform a display operation that alerts the subject to how the mobile system is controlled and the current and / or future movement of the mobile system, thereby performing the operation without further user input when a set of conditions has been met.
[0254] In some embodiments, the one or more procedures further include instructions for: determining that the mobile system (e.g., 10) is operating autonomously (e.g., the mobile system senses its environment and operates without user intervention, the mobile system navigates to a destination without user intervention, the mobile system is navigating autonomously and / or the mobile system is navigating without user input) and that the mobile system is in a second mobile state (e.g., the mobile system is not moving or the mobile system will stop moving within a threshold time amount (e.g., 1 second to 60 seconds)), ceasing the display of indications of the mobile system's movement intention (e.g., 1018a and / or 1018b), and continuing to display indications of the mobile system's autonomous state (e.g., 1012a and / or 1012b). In some embodiments, determining that the mobile system is operating autonomously and that the mobile system will transition from a non-mobile state to a mobile state within a predetermined time amount, re-displaying the indications of the mobile system's movement intention. The ability to stop displaying indications of the mobile system's intention to move when a set of specified conditions is met allows the mobile system to automatically stop performing display operations to indicate to the subject that the mobile system is in a second mobile state (e.g., or will soon enter a second mobile state), thereby performing operations when a set of conditions has been met without requiring further user input.
[0255] In some embodiments, the one or more procedures further include instructions for: after displaying indications of the autonomous state of the mobile system (e.g., 10) and indications of the mobile system's intention to move (e.g., when indications of the autonomous state and intention to move are not displayed) and based on determining that the mobile system is operating non-autonomously (e.g., the mobile system's navigation is controlled by the user, the mobile system responds in real time to the user redirecting the mobile system's navigation via a mechanical device (e.g., a steering wheel, and / or the direction of one or more wheels of the mobile system is controlled by the user) and the mobile system is in a third state (e.g., the mobile system is powered down, the mobile system's battery is not supplying power, and / or the mobile system's power control is active), or any combination thereof, to abandon displaying indications of the mobile system's intention to move and indications of the mobile system's autonomous state. In some embodiments, in response to the mobile system transitioning from an active state to an idle state, the mobile system stops displaying indications of the mobile system's intention to move and indications of the mobile system's autonomous state. In some implementations, in response to a change in driving settings (e.g., reverse driving settings and / or forward driving settings) of the mobile system, the mobile system stops displaying indications of movement of the mobile system and indications of the autonomous state of the mobile system.
[0256] In some embodiments, the mobile system further includes a second display (e.g., 1000a and / or 1000b) different from the first display (e.g., 1000a and / or 1000b) (e.g., the second display is a display of a different type from or the same type as the first type of display). In some embodiments, the one or more programs further include instructions for: (e.g., before, after, and / or simultaneously with the display of an indication of the autonomous state of the mobile system and / or an indication of the mobile system's intention to move) synchronizing content output at a first portion of the first display with content output at a second portion of the second display (e.g., the first and second portions are of the same size, shape, and / or located in the same area of their respective displays) (e.g., both the first portion of the first display and the second portion of the second display have the same content, the same color, the same amount of light, the same brightness, and / or the same animation). In some embodiments, the first portion of the first display and the second portion of the second display are of the same size. In some embodiments, the first portion of the first display and the second portion of the second display are positioned in the same area of their respective displays. In some embodiments, the second portion corresponds to the first portion. Synchronizing the content output at the first part of the first display with the content output at the second part of the second display provides improved visual feedback by increasing the visibility of the content and displaying it over a wide range of angles, thereby providing improved visual feedback and increasing the safety of operating the mobile system (e.g., by making the content visible to more subjects).
[0257] In some implementations, a third portion of the first display (e.g., 1000a and / or 1000b) is desynchronized with a corresponding fourth portion of the second display (1000a and / or 1000b) (e.g., the third and fourth portions are of the same size, shape, and / or located on the same area of their respective displays). In some implementations, the third portion of the first display and the fourth portion of the second display independently display representations of objects (e.g., the first display displays representations of objects within a first area, and the second display displays representations of objects within a second area different from the first area). Having a third portion of a display desynchronized with its corresponding fourth portion of the second display provides feedback by increasing the flexibility of the amount and / or type of content that the mobile system can display at any given time, thereby providing improved visual feedback and increasing the operational safety of the mobile system (e.g., by allowing the mobile system to display different types of content simultaneously).
[0258] In some embodiments, the outer surface (e.g., 18) includes a first end (e.g., a front portion, a rear portion, or a side portion of the outer surface) and a second end (e.g., a front portion, a rear portion, or a side portion of the outer surface) different from the first end. In some embodiments, the first end is positioned at a first location on a longitudinal axis (e.g., 22) of the moving system (e.g., 10) (e.g., an axis spanning the length of the moving system). In some embodiments, the second end is positioned at a second location on the longitudinal axis of the moving system. In some embodiments, the first and second locations are on opposite sides of a transverse axis (e.g., 20) of the moving system (e.g., an axis spanning the width of the moving system). In some embodiments, the distance between the first display and the first end is less than the distance between the first display and the second display. In some embodiments, the distance between the second display and the second end is less than the distance between the second display and the first display.
[0259] It should be noted that the details of the exemplary mobile system described above also apply in a similar manner to other exemplary mobile systems described herein. For the sake of brevity, these details will not be repeated below.
[0260] The following is a description of an exemplary mobile system. This exemplary mobile system is configured to adjust the lifting height of the mobile system. Some features of the exemplary mobile system described below may optionally be combined, modified, and / or omitted.
[0261] As described below, the exemplary mobile system provides an intuitive way to adjust the lift height of the mobile system. The features described below increase the safety of the mobile system's operation. For battery-powered mobile systems, adjusting the lift height of the mobile system in a faster and more efficient manner saves power and increases the time interval between battery charging.
[0262] In some embodiments, the motion system (e.g., 10) includes: an outer surface (e.g., 18) surrounding an interior (e.g., 11) (e.g., the outer surface surrounds the entire interior or is smaller than the entire interior); a suspension system (e.g., an independent suspension system, a dependent suspension system, an air suspension, a spring suspension system, a hydraulic suspension system, and / or an electromagnetic suspension system); one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting an intention to change the motion state of the motion system (e.g., 10) (e.g., the motion system is decelerating, the motion system is accelerating, the motion system will move from a non-motorized state within a predetermined amount of time (e.g., 0 seconds to 60 seconds)). (Transition from moving state to moving state), the moving system will transition from the moving state to the non-moving state within a predetermined amount of time (e.g., 0 seconds to 60 seconds); in response to detecting an intention to change the motion state of the moving system (e.g., 10) and based on determining that the intention to change the motion state of the moving system (e.g., 10) corresponds to a transition from the non-moving state (e.g., the moving system does not translate forward, backward, and / or laterally) to the moving state (e.g., the moving system will begin to move forward, backward, and / or laterally), the moving system is raised (e.g., lifted, elevated, and / or heightened) via the suspension system (e.g., 1 inch to 24 inches) (e.g., the entire moving system is raised or a portion of the moving system is raised) (e.g., as described above regarding Figure 10B As described above); and according to the intent to change the motion state of the moving system (e.g., 10), corresponding to a transition from a moving state to a non-moving state (e.g., the moving system is decelerating, the moving system is decelerating at a rate greater than a threshold, the moving system will decelerate within a predetermined amount of time (e.g., 1 second to 60 seconds), the moving system is lowered (e.g., 1 inch to 24 inches) via the suspension system (e.g., as described above regarding...). Figure 10B (As described) (e.g., the entire mobile system is lowered or a portion of the mobile system is lowered). In some embodiments, when the mobile system is in a non-mobile state, a portion of the mobile system moves. In some embodiments, when the mobile system is in a non-mobile state, no part of the mobile system moves. Changing the elevation height of the mobile system when a set of predetermined conditions is met (e.g., whether the mobile system has stopped or resumed movement) allows the mobile system to automatically perform actions that alert the subject whether the mobile system is currently in a mobile or non-mobile state and its previous state of motion, thereby performing actions when a set of conditions has been met without requiring further user input.
[0263] In some implementations, the intent to detect changes in the motion state of the mobile system (e.g., 10) does not include detecting user input (e.g., as described above). Figure 10A(As described herein) (e.g., user input pointing to a control that, when selected, causes the mobile system to be lowered or raised). In some implementations, detecting an intent to change the motion state of the mobile system includes detecting user input.
[0264] In some implementations, the one or more procedures further include instructions for: when the mobile system (e.g., 10) is raised (e.g., and after the mobile system is raised to the raised level), based on determining that a first set of one or more criteria are met (e.g., the mobile system is in a moving state, the mobile system has not yet transitioned from a moving state to a non-moving state, the speed of the mobile system is greater than or less than a speed threshold, the mobile system is transitioning from a moving state to a non-moving state, and / or the mobile system is transitioning from a non-moving state to a moving state), maintaining the raised height (e.g., the raised level) of the mobile system (e.g., as described above regarding...). Figure 10B (As described). In some implementations, the mobility system is lowered via a suspension system based on the determination that one or more criteria are not met. Maintaining the elevation of the mobility system when a set of specified conditions is met allows the mobility system to automatically alert the subject to the current and / or expected future motion state of the mobility system, thereby performing an operation without further user input once a set of conditions has been met.
[0265] In some embodiments, an intention to change the motion state of the mobile system is detected when the mobile system (e.g., 10) is raised (e.g., above the elevation height of the mobile system when it is not in motion, begins to move, and / or is about to stop). In some embodiments, the intention to change the motion state corresponds to a transition from a moving state to a non-moving state (e.g., as described above regarding...). Figure 10B As described. When specified conditions are met (e.g., the mobile system has transitioned or will transition from a mobile state to a non-mobile state), lowering the mobile system from its elevated position allows the mobile system to automatically adjust its height to warn the subject that the mobile system is about to stop and / or be stopped, thereby performing an operation when a set of conditions have been met without requiring further user input, and increasing the safety of the mobile system's operation (e.g., by providing the subject with an indication of the mobile system's intention to move).
[0266] In some implementations, the one or more procedures further include instructions for: maintaining the elevation height (e.g., the lowered level) of the mobile system when the mobile system (e.g., 10) is lowered (e.g., and after the mobile system is lowered to the lowered level), based on determining that a second set of one or more criteria are met (e.g., the mobile system is in a moving state, the mobile system has not yet transitioned from a moving state to a non-moving state, the speed of the mobile system is greater than or less than a speed threshold, the mobile system is transitioning from a moving state to a non-moving state, and / or the mobile system is transitioning from a non-moving state to a moving state). Maintaining the elevation height of the mobile system at the lowered position when a set of predetermined conditions is met (e.g., there is no intention to change the motion state of the mobile system) allows the mobile system to automatically indicate to the subject that there is no intention for the mobile system to move, thereby performing the operation when a set of conditions has been met without requiring further user input, and increasing the security of the operation of the mobile system (e.g., by providing the subject with an indication of the mobile system's intention to move).
[0267] In some embodiments, an intention to change the motion state of the mobile system is detected when the mobile system (e.g., 10) is lowered (e.g., below the elevation height of the mobile system when it is in motion, starting to move, and / or about to stop). In some embodiments, the intention to change the motion state corresponds to a transition from a non-mobile state to a mobile state (e.g., as described above regarding...). Figure 10B As described. When a set of specified conditions are met (e.g., the mobile system has transitioned or will transition from a non-mobile state to a mobile state), boosting the mobile system allows the mobile system to warn the subject that the mobile system will begin to move, thereby performing an operation when a set of conditions has been met without requiring further user input, and increasing the security of the mobile system's operation (e.g., by providing the subject with an indication of the mobile system's intention to move).
[0268] In some embodiments, the mobile system further includes a group of one or more displays (e.g., 1000a and / or 1000b) (e.g., headlights, touch-sensitive displays, displays, taillights, and / or a series of lighting sources). In some embodiments, the one or more displays further include instructions for changing the operational state of the group of one or more displays in response to detecting an intention to change the motion state of the mobile system (e.g., 10) (e.g., as described above regarding...). Figure 10B(As described) (e.g., activating the group of one or more displays, deactivating the group of one or more displays, activating a portion of the group of one or more displays, deactivating a portion of the group of one or more devices, displaying animation, pulsating the group of one or more displays). In some embodiments, the mobile system is raised or lowered while the operating state of one or more displays is changed. In some embodiments, the mobile system is raised or lowered before or after the operating state of one or more displays is changed. In some embodiments, the operating state of the group of one or more displays is temporarily changed. Changing the operating state of the group of one or more displays in response to detecting an intention to change the motion state of the mobile system provides the subject with visual feedback that the motion state of the mobile system will change (e.g., the mobile system will begin to move or the mobile system will stop moving), thereby providing improved visual feedback and increasing the safety of operating the mobile system (e.g., by providing the subject with an indication of the intention to move the mobile system).
[0269] In some embodiments, the mobile system (e.g., 10) further includes a group of one or more illumination sources (e.g., 1020a and / or 1020b) (e.g., a single illumination source or an array of illumination sources). In some embodiments, the one or more procedures further include instructions for maintaining the operational state of the group of one or more illumination sources in response to detecting an intention to change the motion state of the mobile system. In some embodiments, the group of one or more illumination sources at least partially surrounds the display of the mobile system. In some embodiments, the operational state of the group of one or more illumination sources is changed in response to detecting an intention to change the motion state of the mobile system. Maintaining the operational state of the group of one or more illumination sources (e.g., maintaining the amount of light output from the group of one or more illumination sources) allows the illumination of the group of one or more illumination sources to remain consistent even when the elevation height of the mobile system changes, thereby allowing subjects inside the mobile system to see the outside of the mobile system in the dark, and allowing subjects outside the mobile system to see the mobile system better, thereby providing improved visual feedback and increasing the safety of operating the mobile system.
[0270] In some embodiments, the mobile system (e.g., 10) further includes a first group of one or more audio output devices (e.g., speakers, smart speakers, subwoofer speakers, horns, alarms, and / or tweeters). In some embodiments, the one or more programs further include instructions for operating such that, when the elevation height of the mobile system is changed (e.g., raising or lowering the mobile system), a first audio output is output via the first group of one or more audio output devices (e.g., as described above regarding...). Figure 10B(as described) (e.g., one-time discrete tones, repetitive tones, media items, and / or warnings). In some embodiments, a first group of one or more audio output devices outputs audio output when the elevation height of the mobile system changes. In some embodiments, a first group of one or more audio output devices outputs audio output before and / or after the elevation height of the mobile system changes. Outputting a first audio output when the elevation height of the mobile system changes allows the mobile system to automatically provide the subject with an audible warning that the elevation of the mobile system is changing and / or the movement status of the mobile system is changing or about to change, thereby providing improved feedback and increasing the safety of operating the mobile system (e.g., by providing the subject with an indication of the movement intention of the mobile system).
[0271] In some embodiments, the mobile system (e.g., 10) further includes a second group of one or more audio output devices (e.g., speakers, smart speakers, subwoofer speakers, horns, alarms, and / or tweeters). In some embodiments, the one or more programs further include instructions for outputting a second audio output (e.g., a one-time discrete tone, a repeating tone, a media item, and / or an alarm) via the second group of one or more audio output devices when the elevation height of the mobile system is changed (e.g., raising or lowering the mobile system). In some embodiments, the one or more programs further include instructions for outputting a second audio output having a first value based on a determined elevation height change of the mobile system when the elevation height of the mobile system is changed (e.g., pitch, volume level, high volume, low volume, and / or a group of speakers responsible for outputting the second audio output) (e.g., as described above regarding...). Figure 10B (As described above)....
Claims
1. A mobile system, the mobile system comprising: An outer surface that at least partially surrounds the interior; A lighting source is positioned on the outer surface and configured to illuminate the environment outside the outer surface; the moving system is configured to move relative to the environment in a first direction. and A display, positioned on the outer surface and configured to display a representation of an object detected near the outer surface, the display being obscured from the interior.
2. The mobile system of claim 1, wherein the display comprises one or more of a light panel assembly, a diffuser, a heat sink, a carrier, and louvers.
3. The mobile system of claim 1, wherein the display is configured to display a first indication of the state of the mobile system based on determining that the mobile system is in a first operating state, wherein the display is configured to display a second indication of the state of the mobile system based on determining that the mobile system is in a second operating state different from the first operating state, and wherein the second indication is different from the first indication.
4. The mobile system of claim 1, wherein the mobile system further comprises a motion actuator, wherein the motion actuator is configured to move the mobile system in the first direction and in a second direction perpendicular to the first direction.
5. The mobile system of claim 1, wherein the mobile system further comprises a first set of illumination sources at least partially surrounding the display.
6. The mobile system of claim 1, wherein the mobile system further comprises a second set of one or more illumination sources at least partially surrounding the display, and wherein the second set of one or more illumination sources are configured to at least partially surround a light panel assembly of the display and emit light through a cover lens of the display.
7. The mobile system according to claim 1, wherein: When the representation of the object is displayed: Based on the determination that the object is at a first distance from the mobile system, the distance is represented as a first dimension; and Based on the determination that the object is at a second distance from the mobile system, the second distance is represented as a second size different from the first size.
8. The mobile system according to claim 1, wherein: Based on the determination that the mobile system is in a first state, the display is configured to display a first light intensity; and Based on the determination that the mobile system is in a second state different from the first state, the display is configured to display a second light intensity different from the first light intensity.
9. The mobile system according to claim 1, wherein: Based on the determination that the mobile system is accelerating, the display is configured to increase the amount of output light over time.
10. The mobile system according to claim 1, wherein: Based on the determination that the object is a first type of object, the display is configured to display the representation as a representation of the first type; and Based on the determination that the object is a second type of object different from the first type of object, the display is configured to display the representation as a second type of representation different from the representation of the first type.
11. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with a lighting source and a display, the one or more programs including instructions for: The environment outside the outer surface is illuminated via the light source; The computer system is moved relative to the environment in a first direction; Detect objects near the outer surface; as well as In response to detecting an object near the outer surface, a representation of the object is displayed via the display, wherein the display is obscured from the interior.
12. A method, the method comprising: In a mobile system that includes an outer surface and communicates with a lighting source and a display, wherein the outer surface at least partially surrounds the interior, the lighting source is positioned on the outer surface, and the display is positioned on the outer surface: The environment outside the outer surface is illuminated via the light source; The mobile system moves relative to the environment in a first direction; Detect objects near the outer surface; as well as In response to detecting an object near the outer surface, a representation of the object is displayed via the display, wherein the display is obscured from the interior.