Joseph Smith was blatantly racist. And a pedophile who married 14 year old girls and trafficked children into marriage to other older men. 

• Had black church members sealed as SLAVES to him for all eternity AGAINST THEIR WILL in temple ceremonies. 
• Denied black men access to the priesthood. The church continued this ban until 1978. (For context the RLDS, a break off church from the mormons, ordained black men in 1865, a century before the mainstream mormons got their shit together)
• Wrote scripture that taught that righteousness living makes your skin whiter and evil living makes your skin darker
• Taught black skin was a result of the curse of Ham and Cain
• Taught slavery was created by God as a result of that curse
• Taught slaves could not be baptized without their master's approval

The church has never reversed the sealing of Jane Elizabeth Manning James, a black woman, who was sealed as a slave to Joseph Smith. They've also never apologized.

Remove his portrait from this chapel immediately. 

Update:

Many claim that Joseph Smith "ordained" black men. He didn't. Others ordained white passing men (1/8 black)  and he signed off on the priesthood card. And it was less than 6 people total. And they made this racist distinction between negroes and mulattoes. 

"4thly, Concerning free negroes and mulattoes.—
Do not laws of Missouri provide abundantly for [p. 10] the removal from the state of all free negroes and mulattoes? (except certain priviledged ones;) and also for the punishment of those who introduce or harbor them?
The statement concerning our invitation to them to become Mormons, and remove to this state, and settle among us, is a wicked fabrication, as no such thing was ever published in the Star, or any where else, by our people nor any thing in the shadow of it; and we challenge the people of Jackson, or any other people, to produce such a publication from us.
In fact, one half dozen negroes or mulattoes, never have belonged to our Society, in any part of the world, from its first organization to this day, 1839."

https://www.josephsmithpapers.org/paper-summary/parley-p-pratt-history-of-the-late-persecution-1839/11

Elijah Abel. Elijah had a half black grandmother and was labeled an "octoroon" meaning 1/8 black and was considered white passing. He was ordained by Ambrose Palmer NOT Joseph Smith. 

They actually tried to discourage any new converts from Africa. And members with darker skin, like Jane Manning James, were denied access to priesthood ordinances.