A chemical battery will recover some charge when it is allowed to rest, but not very much. The fact is that batteries simply don’t charge them self’s, so once a battery is down then it stays down. It is possible that you have a bad wire or wire connection. Check your connections for corrosion and wires for continuity.
Old school that I am I remember having to bang on a starter while someone was turning the key because the starter needed help engaging. Do you think that your starter needs to be cool to work? Or is it the starter relay? It sounds like you are describing an issue that only occurs when the bike is hot.
jason0364 wrote: After riding for a bit we stopped for a break. I shut my bike off, then guess what? Didn't have enough juice to restart.
So what happened next? Did you push the bike home? Let it cool then it started? Did you push start it? Does this happen all the time? Do you charge the bike at night?