Middle finger???

How did the idea of the middle finger get started? I don't get why its not your pinkie or some other finger. Everytime I ask an adult they said "because its been like that" or some other remark like that. Thanks alot.