WP5. Future interaction paradigms

The objectives of this WP are the design and development of 3 new HFI applications:
i) fashion designer VR application,
ii) mobile application for fashion models, and
iii) AR application for fashion consumers for virtually trying on clothes.

Description of work

T5.1 – Enhancing the creative experience of the fashion designers through a VR application for immersive garment fitting (M5-M24): The purpose of this task is the development of a VR application that will aid fashion designers to better design clothes through a virtual reality application. More specifically, a user-friendly VR interface will be developed using state of the art game engines (Unity, Unreal engine) that will enable designers to get a better idea of their designs, by providing them with realistic simulations on how their garments fit on models/mannequins, based on the garment fitting algorithms developed in T2.2 and realistic 3D models from T2.1, T1.3. Moreover, with the advancements in the field of human-like animations that modern game engines provide, designers will be able to edit the movement of the model animations and capture their own unique virtual fashion runaways. To improve the visual fidelity and user immersion, state of the art virtual reality sdks (e.g. Oculus rift, HTC Vive) will be utilized for achieving the creation of the aforementioned application.

T5.2 – Enhancing the social experience of the fashion lovers through a mobile application for use in social media (M5-M24): With this task, we aim to develop an application that will allow users (fashion consumers, models, influencers and lovers in general) to upload a short video including some simple movement and the application will return to them the video with the digital garment simulated on it in order to upload to social media (e.g.  instagram). For the development track, the mobile interface and backend architecture system will be designed with current state of the art game engines (Unity, Unreal) handling a variety of tools provided for mobile application development and physics simulations. Moreover, the utilization of the developments from WP2 and WP3 namely, garment simulation for videos and garment recommendations for consumers will serve as leading components in the backend architecture of the application.

T5.3 – Enhancing the shopping experience of the fashion consumers through an AR application for virtually trying on clothes (M5-M24): This activity aims to adopt the latest advancements of augmented reality for improving the overall experience of virtual garment fitting. The users of the AR application will be able to scan themselves or friends using their phone’s camera and observe in real-time through the screen of their mobile device how a particular garment fits their body. To achieve this result, AR APIs such as AR foundation offered from Unity technologies will be the leading tool for the development both of the interface and backend architecture of the application. Moreover, to further improve the virtual try on experience, the application will use as input the selected garments that the user inspected as well as his/her body measurements and recommend a variety of garments that fit the consumer both in terms of comfort as well as aesthetics based on the recommendation system developed in WP3.