For any two sets $A$ and $B$, let $A \Delta B$ denote their symmetric difference. If $A = \{1, 2, 3, 4\}$ and $A \Delta X = \{3, 4, 5, 6\}$, find the set $X$.