In the second half of the fourteenth century the bishops of Warmia Lyna built a Gothic castle. Built on a square plan with an internal courtyard krużgankowym consisted of the castle proper and ward. At the corners of the tower had a square. Repeatedly destroyed by fire then rebuilt.

Hosted Nicolaus Copernicus in the early sixteenth century. Fortified earthen fortifications in the early seventeenth century. The last bishop who had his headquarters here was Ignacy Krasicki. In the hands of the bishops remained for three centuries. The castle still has the original Gothic style with a small baroque reconstruction. Currently, the Museum of Warmia - Branch of the Museum of Warmia and Mazury in Olsztyn.