In the year 1939, a small gathering of people worshipped in a small building called a "Store." This building was located on the North New York Avenue. Rev Hines was the Pastor at that time and the congregation did not have a name as of yet. The members later moved to 10th Street and Lincoln Avenue. After a while they purchased a hall at 115 West 5th Street. Under the leadership of Reverend Seymour Dixon the congregation adopted "New Jerusalem Missionary Baptist Church” as its official name.

Later the Reverend A. R. Robinson was called to pastor the church until his demise in 1953. Reverend J. Robinson was called after carrying out revival services for the church. Under his leadership several accomplishments were made namely; a baptismal pool was installed, new pews were purchased, and various other renovations were achieved. Succeeding Reverend Robinson was Reverend T. J. Davis, who led the congregation into purchasing a church parsonage at 116 East 5th Street. Following Rev. Robinson, Reverend H.D. Mitchell was called to pastor the flock. Under his leadership the parsonage was paid off and the land that was being bought for the church was paid off, and the land where present Sanctuary sits was purchased.

In 1970, Reverend Louis Rentz was called as Pastor of the church. Under his administration there were numerous accomplishments made, to name a few there was a new church building constructed in 1972 at 1125 North New York Avenue and a new \church parsonage was constructed in 1982, at 1525 Wright Drive. Many other ministry functions were established under the leadership of Reverend Rentz.