Fulton Police officials released this photo of Floyd Palmer, who opened fire at a church in Atlanta (Source/ Fulton County Police)

U.S marshals apprehended Floyd Palmer at a Macy’s store in Atlanta on Wednesday afternoon after he calmly left the church where he opened fire, said The Houston Chronicle.

SEE ALSO: The Math on Gun Control

Police said Palmer walked into the church and shot several rounds at 39-year-old worship leader Greg McDowell, WXIA-TV reported. None of the other 25 members were targeted.

McDowell was on stage and leading prayer when he was shot.

This is Palmer’s second arrest for a gun-related crime.  In 2004, he pled guilty to assault and carrying in Baltimore and was committed to a psychiatric hospital. Records state he was released the following year, said CNN.

SEE ALSO: What Does It Take To Get A Gun

Police are still investigating whether the shooter went to church specifically to attack the worship leader.  Palmer was a former volunteer at the church before he resigned in August.

Read more coverage on gun control here.