"This decision has come after careful thought and is not without sadness," Tamil Nadu BJP state secretary Sumathi Venkatesh said