Nowadays, there are plenty of works introducing convolutional neural networks(CNNs) to the steganalysis and exceeding conventional steganalysis algorithms.These works have shown the improving potential of deep learning in informationhiding domain. There are also several works based on deep learning to do imagesteganography, but these works still have problems in capacity, invisibilityand security. In this paper, we propose a novel CNN architecture named as\isgan to conceal a secret gray image into a color cover image on the senderside and exactly extract the secret image out on the receiver side. There arethree contributions in our work: (i) we improve the invisibility by hiding thesecret image only in the Y channel of the cover image; (ii) We introduce thegenerative adversarial networks to strengthen the security by minimizing thedivergence between the empirical probability distributions of stego images andnatural images. (iii) In order to associate with the human visual systembetter, we construct a mixed loss function which is more appropriate forsteganography to generate more realistic stego images and reveal out morebetter secret images. Experiment results show that ISGAN can achievestart-of-art performances on LFW, Pascal VOC2012 and ImageNet datasets.