A worker can complete a task in $x$ hours, and a second worker in $y$ hours. If $x$ is $20\%$ less than $y$, and they finish the job in $4$ hours working together, what is $x$?