Most definitely as a baby or toddler, yes you have. And if it was not asphalt it was similar stuff like walls and such.

As soon as one has enough data and a brain developed enough one absolutely can tell the feel and taste of stuff even if not tested.

Bonus points if your a parent. Toddlers WILL force stuff in your mouth and you WILL have the chance to test the theories.