What are large vs. small language models?

What is a large model? What is a small model?

1. Concept Definition Large Language Model (LLM): The parameter scale is usually billions to hundreds of billions. Trained on large-scale and diverse ...