I doubt they would ever hurt him, he is after all a Targaryen. So depending on which fan theory you wanna run with, he was born to ride those dragons and they know it as seen by the look of admiration from the dragons in the last part of that scene.