ToDo Getting rid of the PyTorch dependency. It is a massive dependency for just using it as a C++ compiler wrapper Remove multiple instantiations of the environment (instantiated at multiple times to e.g. read the observation and action dim)