Building work began in the 13th century, though the church's most striking features date from the High Gothic period of the 14th century, when construction was completed. The tower, however, is older still, having originally served as a defensive structure at a time when the church formed part of the island's network of fortified churches. Surviving loopholes can still be seen in the surrounding churchyard wall.
Inside, extensive wall paintings from around 1300–1400 cover much of the interior; these were restored in 1994. On the north wall a battle scene between knights is depicted. Local tradition holds that a great battle once took place just outside the church and that the painting recalls this event, though another interpretation links the image to the martyrdom of the Theban Legion under the Roman emperor Decius. The two explanations are not reconciled, and visitors may draw their own conclusions.
Among the church's furnishings is a well-preserved poor box carved from limestone in the 13th century, signed in runic script by the stonemason Lafrans Botvidarson; it may also have served as a base for a crucifix. The font dates from the 13th century, and the altarpiece from 1689, giving the interior a layered sense of history spanning several centuries.
The organ is a notable survival: built in 1755–56 for the French Reformed Church in Stockholm by the noted organ builders Jonas Gren and Petter Stråhle, it was acquired by Bunge parish in 1870. A later restoration in the 1970s returned it to its original mechanical form, making it of particular interest to those curious about historic Swedish organ-building.
Beside the church stand the ruins of the medieval rectory, known as Munkhuset, said to have once been an imposing and lofty building, though little now remains to convey its former grandeur.