Does it cost money to play OFP multiplayer games on the Internet?

No. It's free. Of course, should you choose to buy a registered version of Gamespy Arcade or the All Seeing Eye, you'll pay for that software alone but the time you play online is always unlimited.