St Gregory's was built in 1851 to a George Gilbert Scott design, as a memorial to Archbishop William Howley. The parish was derived from part of St Mary Northgate. The church was made redundant in 1975. Today, the building is owned by Canterbury Christ Church University College, based in North Holmes Road opposite the church, and used for music studies as 'The St Gregory's Centre'.

Fuller Pilch, Kent cricketer for 12 years in Victorian times. Famous for clearing the grass from his wicket with a scythe. He ran the 'Saracen's Head' in the Burgate in retirement, until his death in 1870. The obelisk that used to mark his grave has been moved to St Lawrence cricket ground.