It is to do with noise insulation (NVH).
The felt isolates any contact between the seat belt receptacle and surrounding hard trim when the passenger seat is unoccupied. It is not a requirement on the drivers side as the seat belt should always be engaged when the car is driven.