The line $L_1$ is given by the equation $ax + (a-3)y = 4$ and the line $L_2$ is given by $(a-1)x + 2y = 1$, where $a$ is a real constant. If $L_1$ and $L_2$ are perpendicular to each other, what is the sum of all possible values of $a$?