Kasztelański city wood-gas existed in nica certainly already in the early thirteenth century. The first element of brick was erected within its fortifications at the turn of the thirteenth and fourteenth century cylindrical tower with a diameter of 11 meters. At the beginning of the fourteenth century was created principality Olesnicki, therefore the seat of the dukes had to be developed. He did this before the middle of the fourteenth century Duke Konrad I raising a large castle on a plan similar to a square the side of which almost 50 meters, which have the main wing houses along the north-west curtain walls and smaller wing at the south-western curtain. In the corner of the south was a four-sided tower, a cylindrical tower located at the corner of East defended the entrance located in the north-eastern curtain. The castle was within the city's fortifications, but was also surrounded by the town moat. Construction work on the first assumption was even taken before the end of the fourteenth century.

After 1492, after the death of the last of the princes of Oleśnica castle was in the hands of Czech. In 1542 Duke John of Podiebrad began rebuilding Renaissance house in the transformation of the north-west wing. Later, according to the design of Francis Parra was erected east of the castle walls a new wing, called the house of widows, and a cylindrical tower was extended with ośmiobocznie and crowned with a Renaissance helmet. Another Prince Charles II mansion Podiebrad expanded in the years 1585-1610, and the work was hired architect Bernard Niuron. When the cylindrical tower built two new wings - first south-east, then north-east of the entrance gate, which was connected with the house of widows. The whole premise was surrounded by modern earth bastion fortifications.

In the years 1613-1616 covered porch was built, connecting the castle with the parish church, where there was a princely lodge. Minor construction work suitable decoration elements of Baroque castle was carried out during the seventeenth and eighteenth centuries, and in the nineteenth century was rebuilt wing of the north-east. In the years 1896-1901 the castle was restored, the leading work J.Maas decided to restore the appearance of the Renaissance.

During World War II unaccompanied castle declined slightly, but the reconstruction in the years 1970-1976 restored to its former glory. In the castle were a museum and other cultural institutions.