A capsule containing an aqueous fill composition that comprises water, a derivatized cyclodextrin, such as sulfoalkyl ether cyclodextrin (SAE-CD) or hydroxypropyl cyclodextrin (HPCD), optionally one or more active agents and optionally one or more excipients is stabilized from degradation, erosion, swelling or dissolution of its shell during storage. The derivatized cyclodextrin is present in an amount sufficient to reduce, eliminate or inhibit degradation, erosion, swelling and/or dissolution of the shell by water present in the fill composition. Alternatively, the derivatized cyclodextrin and another shell-stabilizing material together stabilize the shell from degradation, erosion, swelling and/or dissolution by water present in the fill composition. The derivatized cyclodextrin can reduce the water activity of the fill composition.