The invention discloses a chip card retaining structure which comprises a body, a tray and a cover plate, wherein the tray is used for bearing a chip card, the cover plate is fixed to one end of the tray, an installing hole and a concave port communicated to the installing hole are formed in the body, the tray enters and exits the interior of the body through the installing hole, the cover plate is separably contained in the installing hole, the cover plate comprises an operation plate made of elastic materials and a fixing board fixed to the operation plate, the fixing board is connected to the tray, and the operation plate is arranged by adjoining the concave port. The chip card retaining structure is made of the elastic materials, and a user can operate the chip card retaining structure conveniently.