St Peter's was erected in 1788 in what was then almost a rural location when it was built, the church was almost surrounded by fields. The church survived as a Catholic building until 1976, after which it served the local Polish community for a short time. For this reason it is affectionately known as the Polish Church'. It is one of the oldest buildings in the city centre, and although recently its prospects looked bleak, the building's future has been secured and is now being converted to offices!

The Parish closed 1978.