The concept of marginal probability in a multivariate distribution helps us understand the individual probabilities of variables when considering multiple variables together. Marginal distributions show the probability of one variable without considering the others. It is important to note that these individual probabilities do not fully determine the joint distribution of all variables.