While Concrete ML tries to follow closely the scikit-learn API, we chose to use a more advanced version than the available neural networks implemented in scikit-learn. If you use the sklearn API in Concrete ML for neural network, the training will be done using the torch wrapper called Skorch. This allows us to display the nice sklearn API and still have some flexibility for the training/activations/layers (thanks to torch).