Could you in theory build something from the moon to the earth?

You could built it but a elevator/ ladder wont work. The moon revolves around the earth and it would tear it apart.