Welcome to s101. Could the handicap be causing you to tremble ?? If not, it could be many things.
The most common reason for being unsteady is just not knowing what you're doing. In other words, you're not sure where you hand/holding the brush is supposed to go and it takes longer, thus...