Rhythm and tone are two completely separate dimensions of music and represent two entirely different areas of physical and mental activity. Many people have trouble reconciling them, as I did for many years. Rhythm is usually the first one to be emphasized in pedagogy and it quickly becomes tyrannical, blocking out whatever chance tone might have had to exercise equivalent power.
I learn about this mostly from the music of Ludwig van Beethoven.