I just tried it and failed miserably ...
Note that the R documentation states that cross-building is not possible:
https://cran.r-project.org/doc/manuals/r-release/R-admin.html
The point where I get stuck is in building the base library:
byte-compiling package 'base'
Error in eval(expr, envir, enclos) :
may already be using lazy loading on base
Calls: local -> eval.parent -> eval -> eval -> eval -> eval
Execution halted
