In medieval times, Ilderton was a member of the barony of Wark-on-Tweed. Some medieval documents record the number of people who had to pay tax and this gives an idea of how many people lived here at that time. For example, in 1296 there were 13 taxpayers and in 1377 43 adults were liable. The medieval village probably lay near the church.