Since he was asked if he wanted to buy the design, and did not. He is aware
that it does not belong to him. Give him a call, or send him a bill, or both.
I would not bother with a lawyer, but I'd make him aware that if he uses the
design for anything else, he could be facing litigation.