Welcome to the site !!
Do you know what springs are in the bike for sure ?? , if it was sprung for a 250 lbs guy , it will be tough for it to feel comfortable for you at 180
Have you checked the sag settings ?? , this will tell you if the springs are too stiff or not , the stock springs will be about right for someone from about 165 to 185
The stock settings are:
FORKS:
Compression: 14 clicks out from full in
Rebound: 7 clicks out from full in
SHOCK:
Spring Length:10.18 inches (258.5mm)
Sag: 100 - 110mm
High Speed Compression Adjustor:(the adjuster that looks like a nut surrounding the low speed compression adjuster that is a flat screwdriver slot on the reservoir tank) 3/4" - 1 1/4" Turns out from full in (the adjustment will vary depending on riding conditions)
Low Speed Compression Adjuster: 10 clicks out from full in
Rebound Adjuster:(bottom of shock on the clevis , its on the same side as the other adjusters) 11 - 14 clicks out from full in
***Only slightly seat each adjuster when turning in , if you really snug it down you can damage the adjuster***
You can compensate for the high feeling by going with the 110 sag and RAISING your fork tubes 2mm in the clamps , this will keep the bike balanced front to rear but slightly lower the bike to give you better footing
You can also get a Kouba Link (this is only after making sure you have the proper springs for your weight) , and RAISE the forks 4mm to 6mm in the clamps depending on which Link size you get , the 1.75 link **what i have on my 06** lowers the bike 1 3/4" , and you go 6mm up in the clamps , that along with a cut down seat foam makes riding a bit less challenging when needing to put your foot down in precarious situations , (you think the X is tall , try riding a KTM , they are about a inch or more taller than a X)
Hope that helps !!