Your gums bleed as a result of inflammation caused by the presence of bacteria in your mouth. This bacteria, when not properly cleaned off your teeth will result in an irritation of the gum tissue. This irritation, called gingivitis, will result in red, puffy, and bleeding gums. Gone untreated, it can progress into periodontal disease, bone loss, and loose teeth.