The 1834 Foundation Act refers to religion only once:

And be it further enacted that it shall and may be lawful ...... [to] appoint such officers and also such Chaplains and Clergymen of the Established Church of England or Scotland.......

The first recorded Christian service took place on Kangaroo Island on 27 July 1836, led by Captain Robert Morgan of the Duke of York.