Welcome to the site !!
About the only way you can make it work is to use the 05 subframe and motor mounts and hardware , along with the 05 tank , i believe the radiators should swap , and the engine and wheels and forks , the shock needs to be measured as the clevis may be a different length , the swingarm chain guide mount will be different as will the linkage , so what you need is most of the 05 components to make the swap feasible, so in short for 04 parts
Forks = yes
Engine = yes
complete electronics must swap with engine
Wheel sets = yes
that's about it , airbox , swingarm , tank , subframe , plastics , exhaust system ,will not swap , even the seat is different