Insulated water bottle with handle