Abstract: Logistic regression is one of the method of statistics and closely related to machine learning. Optimization technique plays very important role while building any Machine learning model.