mógłby / mogłaby - A question of gender

If someone could clarify this for me please.

Example, the phrase:
Czy pan mógłby mnie zawieźć do... (whereever).

Ok, I know mógłby (mogłaby) changes with gender, but whose gender? Mine or the person I'm asking? I think it's the person I'm asking, but want to make sure.

Dziękuję!

of course the person you're asking, you refer to them as 'you' but the verb changes accordingly to their gender.

Thanks. That's what I thought. Please forgive my silly questions; I'm still learning the basics.