The concept of arbitrage is crucial in finance, as it ensures fair pricing without the need for everyone to be rational. The Fundamental Theorem of Asset Pricing shows that absence of arbitrage, a positive pricing rule, and a hypothetical agent who prefers more to less are all connected. This can be represented by risk-neutral pricing and state price density. These ideas are used in various financial applications like option pricing and investments.