Castle, which existed in the present north-west corner of the city belonged to the family of the Czech Dewinów. He was in the borders of the duchies of Lower Silesia. After the death of Devin Albrecht in 1280, Zary passed into the hands of the family von Packs. Brick castle, they began to rise at the end of the thirteenth century.

The castle had a square plan, was built of stone and brick. The residential building was dostawiony to the northern wall and the gate was right next to him in the eastern wall. Residential house when he was three storeys, was jednotraktowy basement. The lower floor is stone, the next two were built of brick in the system wendyjskim. In that form of the castle did not have a tower.

The first extension is also identified as a second stage of construction was responsible for 1329 years. He was also the west wing and the brick tower of the quadrangle plan.

The next development was made by subsequent owners - Bibersteins who as a dowry took over the castle in 1355. In the middle of the fifteenth century in the south-east corner stood another building. He was like the first three floors and basements, foundations and ground floor stone, above built of brick in the Gothic system. In the middle of the sixteenth century from the courtyard arcades beautified the southern and eastern wing which gave him a Renaissance features.

In 1558 the castle was bought Baltazar Promnitz, whose descendants in the years 1710 to 1716 built a new palace east of the existing buildings.

In 1824, the castle was spent on prison, which existed here until 1935, when it replaced the regional museum. At the end of the Second World War the castle was consumed by fire. Until now it was not rebuilt and burned walls are closed to visitors. The castle has been preserved arcaded courtyard, Gothic and Renaissance paintings and decorations graphite.