Neural Inverse Knitting: From Images to Manufacturing Instructions

  • 2019-02-07 18:05:17
  • Alexandre Kaspar, Tae-Hyun Oh, Liane Makatura, Petr Kellnhofer, Jacqueline Aslarus, Wojciech Matusik
  • 54


Motivated by the recent potential of mass customization brought bywhole-garment knitting machines, we introduce the new problem of automaticmachine instruction generation using a single image of the desired physicalproduct, which we apply to machine knitting. We propose to tackle this problemby directly learning to synthesize regular machine instructions from realimages. We create a cured dataset of real samples with their instructioncounterpart and propose to use synthetic images to augment it in a novel way.We theoretically motivate our data mixing framework and show empirical resultssuggesting that making real images look more synthetic is beneficial in ourproblem setup.


Introduction (beta)



Conclusion (beta)