Prayer Service, Memorial Day Parade starts