Vijaykumar, Resmy and Ahmad, Muneer and Ismail, Maizatul Akmar and Ahmad, Iftikhar and Noreen, Neelum (2024) Deep Learning-Driven Virtual Furniture Replacement Using GANs and Spatial Transformer Networks. Mathematics, 12 (22). p. 3513. ISSN 2227-7390, DOI https://doi.org/10.3390/math12223513.
Full text not available from this repository.Abstract
This study proposes a Generative Adversarial Network (GAN)-based method for virtual furniture replacement within indoor scenes. The proposed method addresses the challenge of accurately positioning new furniture in an indoor space by combining image reconstruction with geometric matching through combining spatial transformer networks and GANs. The system leverages deep learning architectures like Mask R-CNN for executing image segmentation and generating masks, and it employs DeepLabv3+, EdgeConnect algorithms, and ST-GAN networks for carrying out virtual furniture replacement. With the proposed system, furniture shoppers can obtain a virtual shopping experience, providing an easier way to understand the aesthetic effects of furniture rearrangement without putting in effort to physically move furniture. The proposed system has practical applications in the furnishing industry and interior design practices, providing a cost-effective and efficient alternative to physical furniture replacement. The results indicate that the proposed method achieves accurate positioning of new furniture in indoor scenes with minimal distortion or displacement. The proposed system is limited to 2D front-view images of furniture and indoor scenes. Future work would involve synthesizing 3D scenes and expanding the system to replace furniture images photographed from different angles. This would enhance the efficiency and practicality of the proposed system for virtual furniture replacement in indoor scenes.
| Item Type: | Article |
|---|---|
| Funders: | King Abdulaziz University (GPIP-1424-611-2024) |
| Uncontrolled Keywords: | generative adversarial networks; indoor scene synthesis; image inpainting; furniture swap; deep learning; object placement in indoor scenes |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Faculty of Computer Science & Information Technology > Department of Information System |
| Depositing User: | Ms. Juhaida Abd Rahim |
| Date Deposited: | 19 Feb 2025 02:11 |
| Last Modified: | 19 Feb 2025 02:11 |
| URI: | http://eprints.um.edu.my/id/eprint/47379 |
Actions (login required)
 |
View Item |
