A farmer has fields of size $144$ m$^2$ and $192$ m$^2$. He wants to divide them into smaller square plots of size $s \times s$ such that $s$ is the largest possible integer. What is $s^2$?