I am creating a simple challenge for my students, where I have a chatBot that allows user to chat with it. there is a contribute option that allows user to add Insutrctions& Output for the model ans train. Basically I would like to showcase model poisoning. I have tried different models like qwen, distilGpt2 but I am unable to get it run on a t3a EC2 instance. My question is: What would be the most smallest llm that would allow you to have a simple chat? What would be the smallest model thay would allow training by sending few requests? Looking for CPu models only Continue reading...
