Savinay Nagendra

Ph.D. Candidate at Pennsylvania State University
Specialization: Computer Vision & Deep Learning
Email: sxn265 [at] psu [dot] edu


Download Resume

Recent Highlights

about me

I am currently a Ph.D candidate in the department of Computer Science and Engineering at the Pennsylvania State University, University Park (Main Campus). I am advised by Daniel Kifer. I completed my M.S. in Electrical and Computer Enginnering at Penn State as well, advised by Yanxi Liu and Robert Collins. My primary research focus has been developing deep learning algorithms for computer vision applications, specifically, semantic and instance segmentation. The first three years of my Ph.D was funded by Google AI , under which I worked as the student tech lead to develop deep learning models for semantic segmentation of high-resolution imagery. Currently, I am continuing research in this domain by developing a few-shot prompt generator for leveraging Meta AI’s Segment Anything Model (SAM)’s zero-shot segmentation capabilities for downstream tasks such as co-saliency detection, semantic, instance, and video segmentation, and tracking. I am also working on interpretability of neural network representations when subject to differentially private stochastic gradient descent optimization. I have had an incredible opportunity to do three intersnhips as a Research Scientist Intern at Schlumberger (SLB) Research at Boston under the guidance of Kashif Rashid, Andrew Speck and Lingchen Zhu, where I worked on projects related to Reinforcement Learning, 3D Generative Vision Modeling and Semantic Segmentation.

phone

+1 (814) 325-1776

Work email

sxn265@psu.edu

Personal email

savinay95n@gmail.com

Research

Savinay Nagendra, Chaopeng Shen, Daniel Kifer

WACV 2024

PatchRefineNet (PRN) is an auxiliary network that can be appended to any base segmentation network for segmentation refinement. PRN achieves refinement by learning to correct patch-specific biases. Across a wide variety of base models, PRN consistently helps improve mIoU by 2-3%.


Savinay Nagendra, Chaopeng Shen, Daniel Kifer

arXiv 2023

In this paper, we evaluate several methods for assessing pixel-level uncertainty of landslide segmentation. Three methods that do not require architectural changes are compared, including Pre-Threshold activations, Monte-Carlo Dropout, and Test-Time Augmentation - a method that measures the robustness of predictions in the face of data augmentation.


Savinay Nagendra, Chaopeng Shen, Daniel Kifer

IEEE JSTARS 2022

In this paper, we primarily address the important questions regarding building a large-scale heterogeneous global landslide database - (1) How well do deep learning models trained in homogeneous regions perform when they are transferred to different ecoregions? (2) Does increasing the spatial coverage in the data improve model performance in a given ecoregion? and (3) Can a landslide pixel labeling model be incrementally updated with new data, but without access to the old data and without losing performance on the old data?


Savinay Nagendra, Lingchen Zhu, Peter Tilke

EAGE 2022

In this paper, we present a 3D Semantic Inpainting pipeline for generatibe physics-informed stratigraphic models conditioned on data from well-logs.



ECCV 2020

Pose stability analysis is the key to understanding locomotion and control of body equilibrium, with applications in numerous fields such as kinesiology, medicine, and robotics. In biomechanics, CenterofPressure (CoP) is used in studies of human postural control and gait. We propose and validate a novel approach to learn CoP from pose of a human body to aid stability analysis.


Savinay Nagendra, Nikhil Podila, Koshy George

ICACCI 2017

In this paper, we compare different reinforcement algorithms on the benchmark cart-pole problem.

Technical Projects

2022
Python | PyTorch | Java | Flask | C++

The aim of this project is to train a deep learning model to predict the localization (Class + Direction) of 3D sound sources, which can enhance the situational awareness of the DHH community in virtual and real-world environments.


2018
Python | Keras | Tensorflow | OpenCV | Flask

The aim of this project is to train and deploy a computer vision model to predict steering angle of a simulated car in real-time based on the left, right and center dashboard camera views.


skills

Python

Expert

C++

Proficient

C

Proficient

matlab

Proficient

Cuda

Novice

PyTorch

Expert

TensorFlow

Expert

Keras

Expert

TensorRT

Novice

PySpark

Novice

Cross-functional Collaboration

Expert

Adaptable Learning

Expert

html 5

Proficient

PHP

Proficient

java

Novice

Go

Novice

JavaScript

Novice

Google Cloud Platform

Proficient

Azure

Proficient

AWS

Proficient

Flask

Proficient

Postgresql

Proficient

Mathemtical Understanding of ml and dl

Expert

Self-Motivation

Expert

experience

  • Sep 2023 - Present

    Research Assistant

    The Pennsylvania State University

    State College, PA

    Intelligent Prompting of Large-Scale Vision Models: Developing a few-shot prompt generator for leveraging Meta AI’s Segment Anything Model (SAM)’s zero-shot segmentation capabilities for downstream tasks such as co-saliency detection, semantic, instance, and video segmentation, and tracking.

  • May 2021 - Aug 2023

    Research Assistant

    The Pennsylvania State University

    State College, PA

    Segmentaion Refinement: Developed a lightweight post-processing segmentation refinement network that refines the raw logit maps from any base segmentation network, consistently improving the segmentation performance by 2-3% (WACV 2024).

    May 2021 - Aug 2023

    Research Assistant

  • Aug 2019 - May 2021

    Research Assistant

    The Pennsylvania State University

    State College, PA

    Automated Segmentation of Global Landslide Events: Developed a SOTA deep continual learning framework in collaboration with Google AI and USGS for automated segmentation of global landslide events from satellite imagery, showing a 14% improvement in performance compared to existing models (IEEE JSTARS 2022). Featured and presented our work at the Google AI Summit, 2020, and American Geophysical Union TV.

  • May 2023 - Aug 2013

    Research Intern

    Schlumberger Doll Research

    Cambridge, MA

    Internship 3: Developed a zero-shot, domain-agnostic, interactive framework for high-quality automated region extraction from satellite imagery, showing SOTA performance when compared to supervised segmentation models (patent filed).

    May 2023 - Aug 2023

    Research Intern

  • Apr 2021 - Aug 2021

    Research Intern

    Schlumberger Doll Research

    Cambridge, MA

    Internship 2: Developed a 3D semantic inpainting deep learning framework using MoCoGan to generate high-quality, realistic 3D videos of reservoir sedimentation, conditioned on provided well-log data with 100x improvement in FPS compared to expensive simulators (EAGE 2022).

  • May 2018 - Aug 2018

    Research Intern

    Schlumberger Doll Research

    Cambridge, MA

    Internship 1: Designed a rapid, scalable, and search-efficient deep reinforcement learning framework to learn an optimal policy for valve settings of multi-lateral oil wells to maximize the Net Present Value (NPV) (patent filed).

    May 2018 - Aug 2018

    Research Intern

  • Apr 2018 - May 2019

    Research Assistant

    The Pennsylvania State University

    State College, PA

    Developed an end-to-end deep learning framework to transform kinematics (video of human action) to dynamics (foot pressure heat map) in order to extract the trajectory of the center of pressure for human gait stability analysis. (ECCV 2020)

  • May 2016 - Aug 2016

    Research Intern

    University of Southern California

    Los Angeles, CA

    Designed a framework for jerk-less point-to-point trajectory planning with dynamic obstacle avoidance for humanoid end-effectors.

    May 2016 - Aug 2016

    Research Intern

education

2013 - 2017

Bachelor of Electrical & Electronics Engineering
(GPA: 3.91/4.0)

PES Institute of Technology

Bangalore, Karnataka, India

Gold medal awardee for securing second rank in the Department of Electrical and Electronics Engineering. Ungraduate thesis was a survey of reinforcement learning algorithms applied to the benchmark cart-pole control problem. A paper on this project was accepted in the ICACCI 2017.

2017 - 2019

M.S. in Electrical and Computer Engineering
(GPA: 3.7/4.0)

The Pennsylvania State University

University Park, PA, USA

Master's thesis was a computer vision project for converting kinematics to dynamics. The aim was to convert video frames of an individual performing an action to corresponding foot pressure heatmaps. The foot pressure heatmaps were further used to approximate the trajectorey of center of pressure, thereby, analyzing the stability of the individual. A paper on this project was accepted in the ECCV 2020.

2019 - 2024* (Expected)

Ph.D. in Computer Science and Engineering
(GPA: 3.6/4.0)

The Pennsylvania State University

University Park, PA, USA

Worked as the student tech lead for multiple computer vision projects under the Google AI for social good grant, and presented my work in Google offices at London in 2019 and the Google AI Summit at San Francisco in 2020. My primary research focus is developing robust deep learning models for computer vision and differential privacy. My work during Ph.D. has resulted in multiple publications that can be found here.

Get In Touch

Savinay Nagendra

Ph.D. Candidate

phone

814-325-1776

email

sxn265@psu.edu