Ishaan Domkundwar
Class of 2025Pune, Maharashtra
About
Projects
- "Improving the ability of transformers to perform pattern recognition and reasoning tasks" with mentor Alex (Working project)
Project Portfolio
Improving the ability of transformers to perform pattern recognition and reasoning tasks
Started May 23, 2024
Abstract or project description
In this project, the student will investigate and improve the ability of transformers to perform pattern recognition and reasoning tasks. First, the student will investigate various pattern recognition and sequence tasks with prompting (in-context) techniques applied in various existing LLMs. Through prompting, they will understand where the models shine and fall short on this task. This can fuel an evaluation based on the specific cases where existing widespread models fail in pattern recognition and reasoning tasks. This leads to room for innovations and original research in improving pattern recognition abilities. If time allows, the student will investigate whether training and/or fine-tuning can improve the success of pattern recognition.