The Anglican Church of Uganda said Saturday that it has severed ties with the Episcopal Church of the United States for elevating an openly gay man to the rank of bishop.