Private banks play a key role in increasing government debts by acting as middlemen for government spending. They use their own deposit money to buy government bonds, which helps boost the money supply. This process involves two money circuits: one starting from the central bank and the other from private banks to the final recipients of government funds. By allowing only private banks to buy government bonds initially, they can fund these purchases with their own deposit money.