How do you know when you're officially going out with him?

yup, thats the way it works. if he doesnt say in clear words "Will you be my girlfriend?" or you say "Will you be my boyfriend?" then you two are just flirt buddies. Clear it up now before he hurts you & says "we never even went out anyways!"