absolutely if you have a filesystem heavy operation and are accessing files inside the container in aufs instead of a local mount, you are going to pay a massive docker tax.
Just use overlayfs and your performance issues are history. Works perfectly on Ubuntu 16.04 and I hope nobody needs to use significantly older systems.