profile photo

Ayça Takmaz

I am a PhD student in the field of computer vision and augmented reality, supervised by Prof. Bob Sumner and co-supervised by Prof. Siyu Tang in the Department of Computer Science (D-INFK) at ETH Zurich. I closely collaborate with Dr. Francis Engelmann. I previously worked at ETH Zurich as a computer vision research engineer in a joint augmented reality project between ETH Media Technology Center (MTC), ETH Game Technology Center (GTC), and Disney Research Studios (DRS). My research interests mainly lie in scene understanding, 3D reconstruction, unsupervised learning, affordance prediction, and human-object interactions for augmented reality applications.

In 2021, I obtained my Master's degree in Electrical Engineering and Information Technology at ETH Zurich with a focus on computer vision, machine learning, and signal processing. I completed several research projects at the ETH Computer Vision Lab (CVL) led by Prof. Luc Van Gool, as well as the Computer Vision and Graphics (CVG) Group led by Prof. Marc Pollefeys. During the course of my research projects and master's thesis, I had the great opportunity to collaborate with Dr. Danda Pani Paudel, Dr. Thomas Probst, Dr. Ajad Chhatkuli, and Dr. Martin R. Oswald.

News

  • July 2024: I joined NVIDIA as a research intern - I will be based in Santa Clara for the upcoming months!
  • July 2024: I attended ICVSS 2024 at Sicily, Italy - and our poster for OpenMask3D won 3rd place for the Best Poster Awards!
  • July 2024: Our work Segment3D was accepted at ECCV 2024!
  • April 2024: I started my internship at Google Zurich as a student researcher!
  • April 2024: SceneFun3D is selected as an Oral Presentation for CVPR 2024!
  • April 2024: The third iteration of our Open-Vocabulary 3D Scene Understanding Workshop OpenSUN3D will be held in conjunction with ECCV'24 in Milan!
  • Febraury 2024: Our work SceneFun3D was accepted at CVPR 2024!
  • December 2023: The second iteration of our Open-Vocabulary 3D Scene Understanding Workshop OpenSUN3D will be held in conjunction with CVPR'24 in Seattle!
  • December 2023: Our NeurIPS 2023 paper on open vocabulary 3D instance segmentation OpenMask3D was featured in the Computer Vision News!
  • September 2023: Our work OpenMask3D was accepted at NeurIPS 2023!
  • July 2023: Our work Human3D was accepted at ICCV 2023!
  • March 2023: Our workshop OpenSUN3D on Open-Vocabulary 3D Scene Understanding will be held in conjunction with ICCV 2023 in Paris!
  • December 2021: I am starting my PhD in computer vision and augmented reality, under the supervision of Prof. Bob Sumner in the Department of Computer Science (D-INFK) at ETH Zurich!
  • October 2021: Our work Unsupervised Monocular Reconstruction of Non-Rigid Scenes was accepted at 3DV 2021!

Publications


Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labels
Rui Huang, Songyou Peng, Ayça Takmaz, Federico Tombari, Marc Pollefeys, Shiji Song, Gao Huang, Francis Engelmann
European Conference on Computer Vision (ECCV) 2024
project page / paper

SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes
Alexandros Delitzas, Ayça Takmaz, Federico Tombari, Robert Sumner, Marc Pollefeys, Francis Engelmann
Computer Vision and Pattern Recognition (CVPR) 2024 (Oral)
project page /paper

OpenMask3D: Open-Vocabulary 3D Instance Segmentation
Ayça Takmaz*, Elisabetta Fedele*, Robert W. Sumner, Marc Pollefeys, Federico Tombari, Francis Engelmann
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS) 2023
project page / paper

3D Segmentation of Humans in Point Clouds with Synthetic Data
Ayça Takmaz*, Jonas Schult*, Irem Kaftan, Mertcan Akcay, Bastian Leibe, Robert Sumner, Francis Engelmann, Siyu Tang
International Conference on Computer Vision (ICCV) 2023
project page / paper

Unsupervised Monocular Reconstruction of Non-Rigid Scenes
Ayça Takmaz, Danda Pani Paudel, Thomas Probst, Ajad Chhatkuli, Martin R. Oswald, Luc Van Gool
International Conference on 3D Vision (3DV) 2021
project page / paper

Learning Feature Representations for Look-Alike Images
Ayça Takmaz, Thomas Probst, Danda Pani Paudel, Luc Van Gool
Computer Vision and Pattern Recognition (CVPR) Workshops 2019
paper
web counter