Many factors influence your body's ability to absorb and tolerate alcohol. Additionally, the less you weigh, the more you will be affected by a given amount of alcohol.
Direct alcohol tolerance is largely dependent on body size. Large-bodied people will require more alcohol to reach insobriety than lightly built people. Thus men, being larger than women on average, will typically have a higher alcohol tolerance.