FYI all
I figured it out, I had to use ZRAM not a normal swap, it seems.
Something like: https://serverfault.com/questions/794954/add-swap-partition-on-zram-device-using-udev-rule seems to work.
I can now boot Arch and run Firefox, Thunderbird, Docker, Gimp etc - not bad for a cheap ARM...