From 1241 years comes the first mention of a wooden watchtower built by the Teutonic Knights in the bend of the river Sajny. Earlier in this place probably existed Prussian castle, the settlement was founded by guards in 1337 received city rights.

1350, Bishop John I of Meissen began to climb out of the existing brick castle, construction lasted half a century. From 1355 to 1373 years continued to build his successor - John II Styprock. In recent years, the castle received its first form - one wing with a room adapted to live on other sides surrounded by a courtyard wall. It is possible that the wall there were some other, smaller buildings. The second phase of construction falls for the next 25 years. This phase should be combined with Bishop Henry III Sörbom that the new south wing arranged living quarters for the bishops. At the turn of the fourteenth and fifteenth centuries the Western Wall smaller wing arose as an adaptation to the arcade at the entrance gate. In this form, the castle has survived to this day only slightly changed. Originally there were still arcaded cloisters, which, however, have not survived to today demolished in 1822. In the north-western corner is a huge tower square in the lower part of the round at the top.

In the course of archaeological work in the south-eastern corner foundations that could be the basis of the tower in this place like the opposite. Also during the work, it turned out that the original gate was located in the southern wall, but it was moved here after the construction of the residential wing. At the north wing found the remains of a wooden floor belonging to the building erected earlier than the wing - probably during the reconstruction of the sixteenth century.

In 1466 years Reszel was incorporated into Polish. In 1505 years the castle was built around the defensive wall with bastions półcylindrycznymi type of tower. In the thirties of the sixteenth century was carried out renovation work at the east wing, and was built at the entrance gate guardhouse. Again, renovation work was carried out in the years 1594-1597 during the reign of Cardinal Andrew Bathory, then the tower was raised and adapted room on the east wing rooms. On the outer side of the perimeter wall built during the remaining traces of these works buildings demolished in the nineteenth and twentieth centuries.

The castle lost its importance in the second half of the eighteenth century, used only a few rooms. Vetting carried out in 1767 shows the image of the castle much destroyed. Until 1795 it was changed into a prison, which was related to some simple adaptive work.

At the beginning of the nineteenth century, the castle was hit by fire twice - in 1806 and 1807 years. After these events only in the twenties of the nineteenth century, after the transfer of the castle of the Lutheran community started renovation of dilapidated buildings. During this renovation pretty much changed the appearance of the castle, this applies mainly changes in the southern wing, which was changed to the church. Bricked up window openings of the demolished walls and ceiling of doing a new one. Other wings were adapted for residential purposes, only the watchtower waiting for repair until the twentieth century.

In the interwar period to the next overhaul started a neglected subject. Rebuilt the outer fortification with bastions string, rebuilt the interior of the west wing and part of the east.

After the renovation begun in 1976, the castle was put in operation in 1985. Today it houses the art gallery of folk Warmia and Mazury. Creative Work also found their place here, it can spend.