The castle's origins go back to the Sengoku period. A fortification was built at this located by the shugō of Shinano Province, Shimadachi Sadanaga of the Ogasawara clan during the Eisho era (1504-1520). This minor border post was originally called Fukashi Castle. In 1550 it was seized by the Takeda clan following the Siege of Fukashi.