The International Olympic Committee has committed to paying more than $100 million directly to athletes