I don't know if the RER window will validate a Eurailpass, but the same station also serves the TGV, so maybe the SNCF window would validate.

(Speaking of TGV - how are you getting to Germany? About six times a day, Thalys trains leave CDG for Brussels where you can connect to Cologne.)