Virtual Cooking is a one-semester bachelor project. The project involves eleven students of Computer Science and Digital Media led by the Computer Graphics and Virtual Reality working group.

Due to fast technical development in the field of artificial intelligence, robots are taking on more and more important tasks in everyday life. Therefore, we asked ourselves whether robots are able to cook. Firstly, we handled the generation and acquisition of precise training data for the robots. For this purpose, the project consists of two main components.

On the one hand, we created a virtual kitchen environment with kitchen objects being as realistic and true to scale as possible. Photogrammetry is used to convert real objects into 3D objects.

On the other hand, we use Cybergloves and the Optitrack tracking system to record human grasping movements in virtual reality. To display the collision between the data gloves and the objects, heat maps are generated and stored in a database.

In general, we use the Unreal Engine for 3D representation and game logic, Autodesk ReCap for 3D modelling of the kitchen and objects as well as the Mongo database for storing the tracking data.