Back to professors

Computer Science

Vaibhav Unhelkar

Assistant Professor of Computer Science

Member, Ken Kennedy Institute

Public Rice profile source

Average rating

3.5

16 temporary mock ratings

Difficulty

3.7

course-linked average

Courses

6

in seeded sections

Public profile

Research areas

Artificial Intelligence (AI), Robotics, Human-Robot Interaction, Machine Learning, Human-in-the-Loop AI

Courses taught

COMP 390

Computer Science Projects

Theoretical and experimental investigations under staff direction. Repeatable for Credit.

Computer ScienceNone1-3 credits
4.26.2hAliakbarpour, Maryam, Chen, Hanjie, Chen, Ken, Cox, Alan L., Cutler, Scott, Ferreira Flores, Rodrigo, Hang, Kaiyu, Johnson, Dave, Kavraki, Lydia, Kyrillidis, Tasos, Lopes da Silva, Arlei, Myers, Risa, Nakhleh, Luay, Ng, T. S. Eugene, Patel, Tirthak, Sano, Akane, Schreib, Rebecca, Sedlazeck, Fritz, Subramanian, Devika, Treangen, Todd, Unhelkar, Vaibhav, Vardi, Moshe, Veeraraghavan, Ashok, Warren, Joe D., Wong, Stephen

COMP 442

Reinforcement Learning

This course introduces students to reinforcement learning (RL), a general and impactful machine learning paradigm for solving sequential decision-making problems and designing autonomous agents. The course will cover both classical and recent algorithms for reinforcement learning (including deep RL) and imitation learning (including inverse RL). Through the assignments and final project, students will get hands-on experience in applying reinforcement learning algorithms to solve problems inspired by real-world applications. The course will conclude with an overview of open problems and ongoing research in reinforcement learning. Cross-list: COMP 552.

Computer ScienceNone3 credits
4.29.7hUnhelkar, Vaibhav

COMP 490

Computer Science Projects

Theoretical and experimental investigation under staff direction. Repeatable for Credit.

Computer ScienceNone1-4 credits
4.06.7hAllen, Genevera, Byrne, Michael, Cox, Alan L., Ferreira Flores, Rodrigo, Goldman, Ron, Hang, Kaiyu, Joyner, Mack, Kyrillidis, Tasos, Mamouras, Konstantinos, Myers, Risa, Patel, Ankit, Schreib, Rebecca, Shrivastava, Anshumali, Tunnell, Chris, Unhelkar, Vaibhav, Wang, Yuke, Xing, Jiarong, Yao, Vicky

COMP 552

Reinforcement Learning

This course introduces students to reinforcement learning (RL), a general and impactful machine learning paradigm for solving sequential decision-making problems and designing autonomous agents. The course will cover both classical and recent algorithms for reinforcement learning (including deep RL) and imitation learning (including inverse RL). Through the assignments and final project, students will get hands-on experience in applying reinforcement learning algorithms to solve problems inspired by real-world applications. The course will conclude with an overview of open problems and ongoing research in reinforcement learning. Cross-list: COMP 442. Recommended Prerequisite(s): COMP 330 or COMP 440 or ELEC 478 or COMP 540

Computer ScienceNone3 credits
3.110.7hUnhelkar, Vaibhav

COMP 590

Computer Science Projects

Advanced theoretical and experimental investigations under staff direction. The student must have a full-time internship to receive 4 credits for this course. Repeatable for Credit.

Computer ScienceNone1-4 credits
3.45.7hAliakbarpour, Maryam, Baraniuk, Richard G, Chen, Hanjie, Chia, Nai-Hui, Cox, Alan L., Fallah, Alireza, Goldman, Ron, Hang, Kaiyu, Jermaine, Christopher, Joyner, Mack, Kavraki, Lydia, Kyrillidis, Tasos, Lopes da Silva, Arlei, Mamouras, Konstantinos, Mellor-Crummey, John, Myers, Risa, Nakhleh, Luay, Ng, T. S. Eugene, Ordonez Roman, Vicente, Patel, Ankit, Patel, Tirthak, Rixner, Scott, Shrivastava, Anshumali, Simar, Ray, Treangen, Todd, Unhelkar, Vaibhav, Vardi, Moshe, Wang, Yuke, Warren, Joe D., Wei, Chen, Wong, Stephen, Xing, Jiarong, Yao, Vicky

COMP 800

Graduate Research

Repeatable for Credit.

Computer ScienceNone1-15 credits
4.28.5hAliakbarpour, Maryam, Braverman, Vladimir, Chen, Hanjie, Chia, Nai-Hui, Cooper, Keith, Cox, Alan L., Fallah, Alireza, Goldman, Ron, Hang, Kaiyu, Hu, Ben, Jermaine, Christopher, Johnson, Dave, Kavraki, Lydia, Kyrillidis, Tasos, Lopes da Silva, Arlei, Mamouras, Konstantinos, Mellor-Crummey, John, Nakhleh, Luay, Ng, T. S. Eugene, Ordonez Roman, Vicente, Patel, Ankit, Patel, Tirthak, Phillips, George, Rixner, Scott, Shrivastava, Anshumali, Subramanian, Devika, Treangen, Todd, Unhelkar, Vaibhav, Vardi, Moshe, Varman, Peter, Wallach, Dan S., Wang, Yuke, Warren, Joe D., Wei, Chen, Xing, Jiarong, Yao, Vicky

Recent comments