Learning factories offer the possibility to plan, execute and analyze the knowledge imparted in theory on realistic industrial systems. This article analyzes the potential of developing and operating a learning factory in a virtual environment. For this purpose, institutions with learning factories are surveyed regarding the challenges and desires in the operation of learning factories and the mentioned aspects are discussed with regard to their representability in Virtual Reality. The result shows that Virtual Reality positively influences a large part of the aspects and has a high potential to solve current challenges in the establishment and operation of learning factories.