After restarting the LP16 the problem seems to have gone away!
I will soon try to make complete songs for a setlist 🙂
If this device works (it seems like it does! 🙂 ) it will save my band a lot of trouble instead of bringing laptop and interface and stuff to gigs. Very convienient thing!